[T-Academy X KaKr] 성인 인구조사 소득 예측 대회

목적: 94년 미국 성인을 대상으로 한 조사를 통해 연소득이 $50,000 이 넘는지 안 넘는지 구분하기

Load Library

import pandas as pd
import pandas_profiling
import numpy as np
import seaborn as sns
import os
import matplotlib.pyplot as plt
pd.options.display.max_rows=150
%matplotlib inline

Load Data

data = pd.read_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/train.csv')
df = data.copy()
print(df.shape)
df.head()

(26049, 16)

	id	age	workclass	fnlwgt	education	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income
0	0	40	Private	168538	HS-grad	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K
1	1	17	Private	101626	9th	5	Never-married	Machine-op-inspct	Own-child	White	Male	0	0	20	United-States	<=50K
2	2	18	Private	353358	Some-college	10	Never-married	Other-service	Own-child	White	Male	0	0	16	United-States	<=50K
3	3	21	Private	151158	Some-college	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K
4	4	24	Private	122234	Some-college	10	Never-married	Adm-clerical	Not-in-family	Black	Female	0	0	20	?	<=50K

data_test = pd.read_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/test.csv')
df_t = data_test.copy()
print(df_t.shape)
df_t.head()

(6512, 15)

	id	age	workclass	fnlwgt	education	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country
0	0	28	Private	67661	Some-college	10	Never-married	Adm-clerical	Other-relative	White	Female	0	0	40	United-States
1	1	40	Self-emp-inc	37869	HS-grad	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States
2	2	20	Private	109952	Some-college	10	Never-married	Handlers-cleaners	Own-child	White	Male	0	0	25	United-States
3	3	40	Private	114537	Assoc-voc	11	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States
4	4	37	Private	51264	Doctorate	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	99	France

Data Profiling

profile = df.profile_report()
profile

Data Profile

요약

1. 총 26049 row, 6columns
2. null 값이 없다!

Columns 설명

• id: 각 개인의 고유한 ID

• age : 나이
  • 17세에서 90세까지
  • 누운 호리병 모양의 분포를 보여줍니다.

• workclass : 고용 형태
  • 총 9개의 고용 형태입니다.
    • Private: 자영업, 18123명, 69.6%
    • Self-emp-not-inc: 법인 없는 개인 사업가, 2030명, 7.8%
    • Local-gov: Local 정부 소속, 1692명, 6.5%
    • ?: 직업 알 수 없음, 1502명, 5.8%
    • State-gov: State 정부 소속, 1043명, 4.0%
    • Self-emp-inc: 법인이 있는 개인 사업가, 877명, 3.4%
    • Federal-gov: Federal 정부 소속, 765명, 2.9%
    • Without-pay: 돈 안 받음.., 11명, < 0.1%
    • Never-worked: 일 안 함, 6명, < 0.1%

• fnlwgt : 사람 대표성을 나타내는 가중치 (final weight의 약자)
  • 사후 층화 가중치, 한 표본이 몇 개를 대표하는지 의미합니다. (e.g. 모집단의 남녀 비율이 45%,55%인데 표본에서 60%,40% 일 경우 가중치를 주어 조정을 해줍니다.)
  • 값이 168538 일 경우, 이런 특성 가진 사람이 168538명 있다 라는 의미
  • 최솟값 ~ 최댓값 (13769 ~ 1484705)

• education : 교육 수준
  • 총 16개의 교육 수준을 나타냅니다.
    • Bachelors(4년제학사)
    • Some-college(전문대)
    • 11th
    • HS-grad
    • Prof-school
    • Assoc-acdm
    • Assoc-voc
    • 9th
    • 7th-8th
    • 12th
    • Masters
    • 1st-4th
    • 10th
    • Doctorate
    • 5th-6th
    • Preschool

• education_num : 교육 수준 수치 (교육 받은 햇수)
  • education을 친절하게도 햇수로 표현했습니다.
  • 높을 수록 교육을 오래 받았습니다.

• marital_status: 결혼 상태
  • Married-civ-spouse: 기혼, 11970명, 46.0%
  • Never-married: 미혼, 8568명, 32.9%
  • Divorced: 이혼, 3536명, 13.6%
  • Separated: 별거(법적 별거, 결혼 불화, 이혼 직전 등), 826명, 3.2%
  • Widowed: 사별, 796명, 3.1%
  • Married-spouse-absent: 별거(직업 등의 사유로), 334명, 1.3%
  • Married-AF-spouse: 별거(군인), 19명, 0.1%

• occupation : 업종(직업)
  • 총 15개 업종
  • Tech-support(기술자), Craft-repair(기능공), Other-service(제3서비스업), Sales, Exec-managerial, Prof-specialty, Handlers-cleaners, Machine-op-inspct, Adm-clerical, Farming-fishing, Transport-moving, Priv-house-serv, Protective-serv, Armed-Forces.

• relationship : 가족 관계
  • Husband: 남편 10541 40.5%
  • Not-in-family: 가족없음 6632 25.5%
  • Own-child: 자녀 4099 15.7%
  • Unmarried: 결혼 안 함 2740 10.5%
  • Wife: 아내 1260 4.8%
  • Other-relative: 그 외 관계 777 3.0%

• race : 인종
  • White 22315 85.7%
  • Black 2476 9.5%
  • Asian-Pac-Islander 800 3.1%
  • Amer-Indian-Eskimo 254 1.0%
  • Other 204 0.8%

• sex : 성별
  • Male 17482 67.1%
  • Female 8567 32.9%

• capital_gain : 양도 소득, 자본 소득
  • 0에서 99999 까지 인데 추가 확인 필요

• capital_loss : 양도 손실
  • 0에서 4356

• hours_per_week : 주당 근무 시간
  • 1시간에서 99시간까지

• native_country : 국적
  • 총 41개국

• income : 수익 (예측해야 하는 값)
  • 50K 이하 19744 75.8%
  • 50K 초과 6305 24.2%

# 94년 미국에서 연소득 5만 달라는 어느 정도 일까?
# 답: 중상층~재벌이다.
# 94년 미국 GNI (1인당 국민소득): 27,750 달러 / 18년 63,690
# 94년 한국 GNI: 9,910 달러 / 18년 40,090 달러 (4천5백만원)

Data Cleaning

# 각 컬럼들과 income과의 상관관계를 먼저 보려합니다.
# 컬럼들을 정리하고, one hot 인코딩해줍니다.

# 1. education 컬럼은 education_num 컬럼으로 대체 가능하니 버려줍니다.
df = df.drop('education', axis = 1)
print(df.shape)
df.head()

(26049, 15)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income
0	0	40	Private	168538	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K
1	1	17	Private	101626	5	Never-married	Machine-op-inspct	Own-child	White	Male	0	0	20	United-States	<=50K
2	2	18	Private	353358	10	Never-married	Other-service	Own-child	White	Male	0	0	16	United-States	<=50K
3	3	21	Private	151158	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K
4	4	24	Private	122234	10	Never-married	Adm-clerical	Not-in-family	Black	Female	0	0	20	?	<=50K

# 2. income 컬럼의 값은 True, False로 대체합니다.
df['income_bool'] = df['income'] == '>50K'
print(df.shape)
df[['income','income_bool']].head()

(26049, 16)

	income	income_bool
0	>50K	True
1	<=50K	False
2	<=50K	False
3	<=50K	False
4	<=50K	False

#3. fnlwgt 컬럼은 사후 층화 가중치로서, 한 표본이 몇 개를 대표하는지 의미합니다.
'https://m.blog.naver.com/stat833/221747335785'
df_fnlwgt = df.head(1)
df_fnlwgt.drop(df_fnlwgt.index[0], inplace = True)
df_fnlwgt

/home/theo/anaconda3/lib/python3.7/site-packages/pandas/core/frame.py:4170: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  errors=errors,

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool

fnlwgt 수만큼 같은 데이터를 만들어볼까?

컴퓨터 성능이 허락하질 않는다..

for i in range(1,df['fnlwgt'].shape[0]+1): print(i) for j in range(0, int(df['fnlwgt'][i])): df_fnlwgt = df_fnlwgt.append(df.head(i) ,ignore_index=True)

df_fnlwgt

from sklearn.ensemble import RandomForestRegressor
from sklearn.preprocessing import LabelEncoder
# one hot 인코딩

dtypes = df.dtypes
encoders = {}
for column in df.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df[column])
        encoders[column] = encoder
df_num = df.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num[column] = encoder.transform(df[column])
    
print(df_num.shape)
df_num.tail(10)

(26049, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
26039	26039	52	1	129177	9	0	1	1	4	0	0	0	40	38	0	False
26040	26040	39	4	30269	11	0	12	4	4	0	0	0	40	38	0	False
26041	26041	44	4	103233	13	4	1	4	2	0	0	0	40	38	0	False
26042	26042	48	6	191389	10	5	12	4	4	0	0	0	50	38	0	False
26043	26043	34	6	234960	13	2	10	0	2	1	0	1887	48	38	1	True
26044	26044	57	4	250201	7	2	8	0	4	1	0	0	52	38	0	False
26045	26045	23	4	238092	13	4	10	3	4	1	0	0	40	38	0	False
26046	26046	78	0	165694	14	6	0	1	4	0	0	0	15	38	0	False
26047	26047	26	6	151626	9	4	10	3	2	0	0	0	40	38	0	False
26048	26048	20	0	99891	10	4	0	3	4	0	0	0	30	38	0	False

# test data..
dtypes = df_t.dtypes
encoders = {}
for column in df_t.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df_t[column])
        encoders[column] = encoder
df_num_t = df_t.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num_t[column] = encoder.transform(df_t[column])
    
print(df_num_t.shape)
df_num_t.tail(10)

(6512, 15)

	id	age	workclass	fnlwgt	education	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country
6502	6502	25	4	198587	15	10	4	13	1	2	0	2174	0	50	39
6503	6503	70	6	124449	12	14	2	4	0	4	1	0	2246	8	39
6504	6504	41	4	163322	1	7	0	4	4	4	0	0	0	36	39
6505	6505	55	4	171015	15	10	4	1	3	4	0	0	0	36	39
6506	6506	56	4	112840	11	9	2	4	0	4	1	0	0	55	39
6507	6507	35	4	61343	9	13	2	12	0	4	1	0	0	40	39
6508	6508	41	5	32185	9	13	2	13	0	4	1	0	0	40	39
6509	6509	39	4	409189	4	3	2	8	0	4	1	0	0	40	26
6510	6510	35	4	180342	11	9	2	3	0	4	1	0	0	40	39
6511	6511	28	4	156819	11	9	0	6	4	4	0	0	0	36	39

# 상관관계 heatmap

plt.figure(figsize=(10,10))
sns.heatmap(data = df_num.corr(), annot=True, 
fmt = '.2f', linewidths=.5, cmap='Blues')

# age, education_num, marital_status, relationship, sex, capital_gain, capital_loss, hours_per_week 가 연관있어 보인다.

<AxesSubplot:>

EDA 1차

• 상관관계가 높은 아래 컬럼들을 살펴보겠습니다.

  1. age,
  2. education_num,
  3. marital_status,
  4. relationship,
  5. sex,
  6. capital_gain,
  7. capital_loss,
  8. hours_per_week

1. age

fa = sns.FacetGrid(df_num, aspect = 3)
fa.map(sns.kdeplot, 'age')
fa.add_legend()
# 코끼리를 삼킨 보아뱀 모양 그래프, 아직 코끼리가 식도에 있어서 위장쪽으로 옮겨줘야합니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc242d2c10>

# income을 기준으로 나눠보기
fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'age')
fa.add_legend()

# 대략 구분해보면 40~50대에 돈이 많고, 20대에는 돈이 없습니다. 늙어서는 다 똑같습니다..

<seaborn.axisgrid.FacetGrid at 0x7fbc242dc590>

sns.countplot(data = df_num, x = 'age', hue = 'income_bool')

<AxesSubplot:xlabel='age', ylabel='count'>

2. education_num

fa = sns.FacetGrid(df_num, aspect = 3)
fa.map(sns.kdeplot, 'education_num')
fa.add_legend()
# 들쭉 날쭉합니다. 대충 중졸, 고졸, 대졸, 대학원졸 그룹으로 나눌 수 있을 것 같습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc20140ed0>

# income 기준으로 나눠보기
fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'education_num')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7fbc0be17e10>

sns.countplot(data = df_num, x = 'education_num', hue = 'income_bool')

<AxesSubplot:xlabel='education_num', ylabel='count'>

pd.pivot_table(data = df_num, index = 'education_num', values = 'income_bool', aggfunc = [np.mean, np.sum])
# 공부 많이 하면 돈도 많이 법니다.

	mean	sum
	income_bool	income_bool
education_num
1	0.000000	0
2	0.037313	5
3	0.049057	13
4	0.057426	29
5	0.052632	22
6	0.072503	53
7	0.059653	55
8	0.072423	26
9	0.158544	1337
10	0.192586	1117
11	0.255474	280
12	0.255344	215
13	0.415516	1805
14	0.561684	774
15	0.733906	342
16	0.734177	232

3. marital_status

fa = sns.FacetGrid(df_num, aspect = 3)
fa.map(sns.kdeplot, 'marital_status')
fa.add_legend()
# 결혼 상태 입니다. 0, 2, 4의 상태가 두드러집니다. 인코딩이 되어 있어 어떤 상태인지 알 수 없습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0bc61990>

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'marital_status')
fa.add_legend()
# 2는 어떤 상태일까요?

<seaborn.axisgrid.FacetGrid at 0x7fbc0bc73890>

sns.countplot(data = df_num, x = 'marital_status', hue = 'income_bool')

<AxesSubplot:xlabel='marital_status', ylabel='count'>

pd.pivot_table(data = df_num, index = 'marital_status', values = 'income_bool', aggfunc = np.sum)

	income_bool
marital_status
0	371
1	10
2	5372
3	27
4	401
5	54
6	70

pd.pivot_table(data = df, index = 'marital_status', values = 'income_bool', aggfunc = [np.mean,np.sum])
# 소득이 높은 사람은 결혼했을 확률이 높습니다.

	mean	sum
	income_bool	income_bool
marital_status
Divorced	0.104921	371
Married-AF-spouse	0.526316	10
Married-civ-spouse	0.448789	5372
Married-spouse-absent	0.080838	27
Never-married	0.046802	401
Separated	0.065375	54
Widowed	0.087940	70

4. relationship

fa = sns.FacetGrid(df_num, aspect = 3)
fa.map(sns.kdeplot, 'relationship')
fa.add_legend()
# 가족관계는 0,1,3 순서로 표본이 많습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0bec0290>

fa = sns.FacetGrid(df_num, hue = 'income_bool',aspect = 3)
fa.map(sns.kdeplot, 'relationship')
fa.add_legend()
# 가족관계가 0, 5이면 돈을 많이 버는 사람일 수 있습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc20150110>

pd.pivot_table(data = df_num, index = 'relationship',values = 'income_bool', aggfunc = np.sum)

	income_bool
relationship
0	4740
1	695
2	33
3	52
4	176
5	609

sns.countplot(data = df_num, x = 'relationship', hue = 'income_bool')

<AxesSubplot:xlabel='relationship', ylabel='count'>

pd.pivot_table(data = df, index = 'relationship',values = 'income_bool', aggfunc = [np.mean, np.sum])
# 돈을 많이 버는 사람은 남편이거나 독신일 확률이 높습니다.

	mean	sum
	income_bool	income_bool
relationship
Husband	0.449673	4740
Not-in-family	0.104795	695
Other-relative	0.042471	33
Own-child	0.012686	52
Unmarried	0.064234	176
Wife	0.483333	609

5.sex

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'sex')
fa.add_legend()
# 돈을 많이 버는 사람은 남자일 확률이 높습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b90a910>

6. capital_gain,

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'capital_gain')
fa.add_legend()
# 이렇게만 봐서는 잘 모르겠습니다. 자본 소득이 있고 없고를 확인해보겠습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b906590>

df_num['capital_gain_bool'] = df_num['capital_gain'] > 0
print(df_num.shape)
df_num[['capital_gain', 'capital_gain_bool']].head()

(26049, 17)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

# test data
df_num_t['capital_gain_bool'] = df_num_t['capital_gain'] > 0
print(df_num_t.shape)
df_num_t[['capital_gain', 'capital_gain_bool']].head()

(6512, 16)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

sns.countplot(data = df_num, x= 'capital_gain_bool', hue = 'income_bool')

<AxesSubplot:xlabel='capital_gain_bool', ylabel='count'>

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'capital_gain_bool')
fa.add_legend()
# 대부분은 자본소득이 없지만, 있다면 부자일 확률이 높습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b7f0e90>

7. capital_loss

# capital_gain과 마찬가지로 유무 여부로 확인해보겠습니다.
df_num['capital_loss_bool'] = df_num['capital_loss'] > 0
print(df_num.shape)
df_num[['capital_loss', 'capital_loss_bool']].head()

(26049, 18)

	capital_loss	capital_loss_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

# test data
df_num_t['capital_loss_bool'] = df_num_t['capital_loss'] > 0
print(df_num_t.shape)
df_num_t[['capital_loss', 'capital_loss_bool']].head()

(6512, 17)

	capital_loss	capital_loss_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

sns.countplot(data = df_num, x= 'capital_loss_bool', hue = 'income_bool')

<AxesSubplot:xlabel='capital_loss_bool', ylabel='count'>

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'capital_loss_bool')
fa.add_legend()
# 대부분은 자본손실이 없지만 있으면 부자일 확률이 절반정도입니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b68ccd0>

8. hours_per_week

fa = sns.FacetGrid(df_num, aspect = 3)
fa.map(sns.kdeplot, 'hours_per_week')
fa.add_legend()
# 주 40시간, 50시간, 60시간 순으로 분포되어 있습니다, 그룹별로 만들어야겠습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b6fcc90>

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'hours_per_week')
fa.add_legend()
# 주 50, 60시간 일 한다면 부자일 확률이 높습니다.

<seaborn.axisgrid.FacetGrid at 0x7fbc0b586710>

EDA 1차 결론

• EDA 결과를 바탕으로 아래와 같이 PREPROCESSING을 진행하겠습니다.
  1. age: 40~50대에 돈이 많고, 20대에는 돈이 없습니다. / 나이가 넓게 분포되어 있는데, 두 그룹으로 나눠보겠습니다.
  2. marital_status: 기혼, 독신 두 그룹으로 나눠보겠습니다.
  3. relationship:기혼 그룹에서 돈을 많이 벌었듯이, 남편과 아내일 경우 소득이 높습니다. / 남편 or 아내 bool 값으로 바꿔보겠습니다.
  4. hours_per_week: 정규화 해보겠습니다.

---

1. education_num: 추가 작업이 필요없습니다.
2. sex: 추가 작업이 필요 없습니다.
3. capital_gain, bool 컬럼을 그대로 사용하겠습니다.
4. capital_loss, bool 컬럼을 그대로 사용하겠습니다.

EDA 2차

• workclass
• occupation
• race
• native_country

# 추가로 EDA를 진행해서 예측 결과를 높여봅시다.

print(df.shape)
df.head()

(26049, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
0	0	40	Private	168538	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K	True
1	1	17	Private	101626	5	Never-married	Machine-op-inspct	Own-child	White	Male	0	0	20	United-States	<=50K	False
2	2	18	Private	353358	10	Never-married	Other-service	Own-child	White	Male	0	0	16	United-States	<=50K	False
3	3	21	Private	151158	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K	False
4	4	24	Private	122234	10	Never-married	Adm-clerical	Not-in-family	Black	Female	0	0	20	?	<=50K	False

1. workclass

# 고용 형태를 알아봅시다.
fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'workclass')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7fbc0b509850>

sns.countplot(data = df, x = 'workclass', hue = 'income_bool')

<AxesSubplot:xlabel='workclass', ylabel='count'>

pd.pivot_table(data = df_num, index = 'workclass', values = 'income_bool', aggfunc = [np.sum,np.mean] )

	sum	mean
	income_bool	income_bool
workclass
0	153	0.101864
1	292	0.381699
2	505	0.298463
3	0	0.000000
4	3993	0.220328
5	496	0.565564
6	577	0.284236
7	289	0.277085
8	0	0.000000

pd.pivot_table(data = df, index = 'workclass', values = 'income_bool', aggfunc = [np.sum,np.mean] )

	sum	mean
	income_bool	income_bool
workclass
?	153	0.101864
Federal-gov	292	0.381699
Local-gov	505	0.298463
Never-worked	0	0.000000
Private	3993	0.220328
Self-emp-inc	496	0.565564
Self-emp-not-inc	577	0.284236
State-gov	289	0.277085
Without-pay	0	0.000000

# 고용형태가 '?' 사람들이 연 5만 달러를 초과하여 버는 것은 10% 밖에 되지 않습니다.
# 그 10%는 어떤 사람들일까요?
df[(df['workclass'] == '?') & (df['income_bool'] == True)].head(150)
# 어느정도 나이가 있고, 자본 소득이나 손실이 있습니다. 은퇴 후 주식을 하시는 분들인 것 같습니다!

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
189	189	72	?	108796	15	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
227	227	24	?	151153	10	Never-married	?	Not-in-family	Asian-Pac-Islander	Male	99999	0	50	South	>50K	True
352	352	61	?	232618	15	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
647	647	64	?	178556	6	Married-civ-spouse	?	Husband	White	Male	0	0	56	United-States	>50K	True
904	904	28	?	123147	10	Married-civ-spouse	?	Wife	White	Female	0	1887	40	United-States	>50K	True
1223	1223	67	?	45537	14	Married-civ-spouse	?	Husband	Black	Male	0	0	40	United-States	>50K	True
1927	1927	38	?	94559	13	Married-civ-spouse	?	Wife	Other	Female	7688	0	50	?	>50K	True
2157	2157	72	?	118902	16	Married-civ-spouse	?	Husband	White	Male	0	2392	6	United-States	>50K	True
2166	2166	65	?	240857	13	Married-civ-spouse	?	Husband	White	Male	0	2377	40	United-States	>50K	True
2176	2176	65	?	224472	15	Never-married	?	Not-in-family	White	Male	25124	0	80	United-States	>50K	True
2230	2230	56	?	132930	14	Never-married	?	Not-in-family	White	Female	0	0	50	United-States	>50K	True
2409	2409	69	?	164102	9	Divorced	?	Not-in-family	White	Female	0	0	40	United-States	>50K	True
2514	2514	39	?	361838	13	Married-civ-spouse	?	Wife	White	Female	0	0	6	United-States	>50K	True
2580	2580	62	?	191118	10	Married-civ-spouse	?	Husband	White	Male	7298	0	40	United-States	>50K	True
2693	2693	53	?	123011	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
2704	2704	64	?	168340	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	?	>50K	True
2786	2786	35	?	139770	11	Married-civ-spouse	?	Wife	White	Female	0	0	20	United-States	>50K	True
3183	3183	52	?	318351	10	Married-civ-spouse	?	Wife	White	Female	0	0	40	United-States	>50K	True
3391	3391	59	?	154236	9	Married-civ-spouse	?	Wife	White	Female	7688	0	40	United-States	>50K	True
3437	3437	65	?	36039	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
3578	3578	26	?	370727	13	Married-civ-spouse	?	Wife	White	Female	0	1977	40	United-States	>50K	True
3646	3646	56	?	154537	10	Divorced	?	Unmarried	White	Female	0	0	50	United-States	>50K	True
3650	3650	65	?	117162	11	Married-civ-spouse	?	Wife	White	Female	0	0	56	United-States	>50K	True
4161	4161	61	?	202106	9	Married-civ-spouse	?	Husband	White	Male	0	1902	40	United-States	>50K	True
4242	4242	66	?	177351	13	Married-civ-spouse	?	Husband	White	Male	0	2174	40	United-States	>50K	True
4411	4411	62	?	55621	10	Married-civ-spouse	?	Husband	Black	Male	0	0	35	United-States	>50K	True
4455	4455	59	?	372020	13	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
4619	4619	70	?	54849	16	Married-civ-spouse	?	Husband	White	Male	0	0	20	United-States	>50K	True
4904	4904	59	?	424468	13	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
5000	5000	57	?	208311	13	Married-civ-spouse	?	Husband	White	Male	0	0	80	United-States	>50K	True
5088	5088	60	?	204486	13	Married-civ-spouse	?	Husband	White	Male	0	0	8	United-States	>50K	True
5140	5140	80	?	29020	15	Married-civ-spouse	?	Husband	White	Male	10605	0	10	United-States	>50K	True
5643	5643	43	?	116632	10	Married-civ-spouse	?	Husband	White	Male	0	0	45	United-States	>50K	True
5704	5704	52	?	159755	11	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
5769	5769	66	?	213149	10	Married-civ-spouse	?	Husband	White	Male	0	1825	40	United-States	>50K	True
6029	6029	63	?	186809	13	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
6223	6223	63	?	222289	13	Married-civ-spouse	?	Husband	White	Male	7688	0	54	United-States	>50K	True
6346	6346	61	?	71467	9	Married-civ-spouse	?	Husband	White	Male	3103	0	40	United-States	>50K	True
6523	6523	27	?	174163	10	Married-civ-spouse	?	Wife	White	Female	0	0	40	United-States	>50K	True
6796	6796	53	?	199665	13	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
7066	7066	67	?	182378	13	Married-civ-spouse	?	Husband	White	Male	9386	0	60	United-States	>50K	True
7170	7170	34	?	353881	11	Married-civ-spouse	?	Husband	White	Male	3103	0	60	United-States	>50K	True
7442	7442	57	?	300104	3	Married-civ-spouse	?	Husband	White	Male	7298	0	84	United-States	>50K	True
7467	7467	47	?	149700	13	Married-civ-spouse	?	Husband	White	Male	0	0	36	United-States	>50K	True
7498	7498	31	?	85077	13	Married-civ-spouse	?	Wife	White	Female	0	1902	20	United-States	>50K	True
7581	7581	62	?	81578	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
7761	7761	58	?	353244	13	Widowed	?	Unmarried	White	Female	27828	0	50	United-States	>50K	True
7808	7808	63	?	150389	13	Widowed	?	Not-in-family	White	Female	0	0	40	United-States	>50K	True
7829	7829	90	?	313986	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
8513	8513	41	?	277390	13	Married-civ-spouse	?	Wife	White	Female	0	0	30	United-States	>50K	True
8826	8826	61	?	198686	12	Married-civ-spouse	?	Husband	White	Male	0	0	2	United-States	>50K	True
8858	8858	60	?	131852	3	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
8869	8869	77	?	28678	14	Married-civ-spouse	?	Husband	White	Male	9386	0	6	United-States	>50K	True
8945	8945	48	?	353824	10	Married-civ-spouse	?	Husband	White	Male	0	0	40	?	>50K	True
9677	9677	79	?	100881	12	Married-civ-spouse	?	Wife	White	Female	0	0	2	United-States	>50K	True
9705	9705	40	?	253370	9	Married-civ-spouse	?	Wife	White	Female	0	0	35	United-States	>50K	True
10009	10009	65	?	149131	13	Married-civ-spouse	?	Husband	White	Male	0	0	40	Italy	>50K	True
10535	10535	51	?	203953	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
10914	10914	55	?	106707	12	Married-civ-spouse	?	Husband	Black	Male	0	0	20	United-States	>50K	True
10946	10946	79	?	76641	14	Married-civ-spouse	?	Husband	White	Male	20051	0	40	Poland	>50K	True
11143	11143	34	?	317219	10	Married-civ-spouse	?	Wife	White	Female	0	0	20	United-States	>50K	True
11768	11768	48	?	175653	12	Divorced	?	Not-in-family	White	Female	14084	0	40	United-States	>50K	True
11872	11872	36	?	504871	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
11923	11923	43	?	109912	13	Married-civ-spouse	?	Wife	White	Female	0	0	7	United-States	>50K	True
11928	11928	63	?	221592	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
11932	11932	47	?	99127	11	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
12066	12066	60	?	268954	10	Married-civ-spouse	?	Husband	White	Male	0	0	12	United-States	>50K	True
12220	12220	75	?	111177	13	Widowed	?	Not-in-family	White	Female	25124	0	16	United-States	>50K	True
12284	12284	79	?	163140	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
12476	12476	59	?	145574	12	Married-civ-spouse	?	Husband	White	Male	0	0	35	United-States	>50K	True
13098	13098	66	?	260111	10	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
13111	13111	63	?	247986	15	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
13351	13351	62	?	160155	4	Married-civ-spouse	?	Husband	White	Male	6418	0	40	United-States	>50K	True
13521	13521	59	?	254765	10	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
13625	13625	51	?	172175	16	Never-married	?	Not-in-family	White	Male	0	2824	40	United-States	>50K	True
13826	13826	73	?	139049	9	Widowed	?	Not-in-family	White	Female	0	0	22	United-States	>50K	True
14049	14049	62	?	125493	9	Married-civ-spouse	?	Wife	White	Female	5178	0	40	Scotland	>50K	True
14965	14965	64	?	205479	13	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
15459	15459	51	?	69328	11	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
15469	15469	35	?	195946	10	Married-civ-spouse	?	Husband	Asian-Pac-Islander	Male	0	0	40	Philippines	>50K	True
15732	15732	69	?	28197	9	Married-civ-spouse	?	Husband	White	Male	0	0	60	United-States	>50K	True
16052	16052	31	?	26553	13	Married-civ-spouse	?	Wife	White	Female	0	0	25	United-States	>50K	True
16513	16513	62	?	68461	16	Married-civ-spouse	?	Husband	Amer-Indian-Eskimo	Male	0	0	40	United-States	>50K	True
16696	16696	61	?	179761	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
16760	16760	34	?	170276	13	Married-civ-spouse	?	Wife	White	Female	0	0	10	United-States	>50K	True
16908	16908	63	?	310396	5	Married-civ-spouse	?	Husband	White	Male	5178	0	40	United-States	>50K	True
16911	16911	33	?	193172	11	Married-civ-spouse	?	Own-child	White	Female	7688	0	50	United-States	>50K	True
16955	16955	27	?	129661	11	Married-civ-spouse	?	Wife	Amer-Indian-Eskimo	Female	0	0	40	United-States	>50K	True
16982	16982	60	?	141580	9	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
17186	17186	50	?	146015	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
17511	17511	55	?	270228	12	Married-civ-spouse	?	Husband	Black	Male	7688	0	40	United-States	>50K	True
17553	17553	63	?	29859	9	Married-civ-spouse	?	Husband	White	Male	0	1485	40	United-States	>50K	True
17584	17584	60	?	124487	10	Divorced	?	Not-in-family	White	Female	0	0	40	United-States	>50K	True
17755	17755	65	?	191380	6	Married-civ-spouse	?	Husband	White	Male	9386	0	50	United-States	>50K	True
17965	17965	48	?	193047	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
18025	18025	65	?	115513	13	Married-civ-spouse	?	Husband	White	Male	5556	0	48	United-States	>50K	True
18138	18138	46	?	202560	9	Married-civ-spouse	?	Wife	White	Female	0	0	40	United-States	>50K	True
18176	18176	30	?	33811	13	Married-civ-spouse	?	Wife	Other	Female	0	0	40	Taiwan	>50K	True
18185	18185	61	?	584259	14	Married-civ-spouse	?	Husband	White	Male	0	0	2	United-States	>50K	True
18328	18328	59	?	188070	14	Married-civ-spouse	?	Husband	White	Male	0	0	35	United-States	>50K	True
18595	18595	46	?	177305	11	Married-civ-spouse	?	Wife	Black	Female	0	0	35	United-States	>50K	True
18792	18792	27	?	251854	13	Married-civ-spouse	?	Wife	Black	Female	0	0	35	?	>50K	True
18873	18873	71	?	35303	13	Married-civ-spouse	?	Husband	White	Male	9386	0	30	United-States	>50K	True
18971	18971	64	?	208862	9	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
19096	19096	60	?	112821	10	Married-civ-spouse	?	Husband	White	Male	0	0	35	United-States	>50K	True
19180	19180	69	?	323016	13	Married-civ-spouse	?	Husband	White	Male	99999	0	40	United-States	>50K	True
19472	19472	50	?	204577	13	Married-civ-spouse	?	Husband	Black	Male	0	1902	60	United-States	>50K	True
19489	19489	61	?	42938	13	Never-married	?	Not-in-family	White	Male	0	0	7	United-States	>50K	True
19639	19639	49	?	271346	13	Married-civ-spouse	?	Husband	White	Male	15024	0	60	United-States	>50K	True
19745	19745	63	?	46907	13	Married-civ-spouse	?	Husband	White	Male	0	0	8	United-States	>50K	True
19793	19793	50	?	87263	9	Married-civ-spouse	?	Husband	White	Male	0	0	55	United-States	>50K	True
19950	19950	71	?	287372	16	Married-civ-spouse	?	Husband	White	Male	0	0	10	United-States	>50K	True
20086	20086	53	?	158352	14	Never-married	?	Not-in-family	White	Female	8614	0	35	United-States	>50K	True
20309	20309	52	?	92968	14	Married-civ-spouse	?	Wife	White	Female	15024	0	40	United-States	>50K	True
20313	20313	68	?	255276	10	Married-civ-spouse	?	Husband	White	Male	0	0	48	United-States	>50K	True
20518	20518	55	?	208640	9	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
20524	20524	65	?	249043	13	Married-civ-spouse	?	Husband	White	Male	10605	0	40	United-States	>50K	True
20557	20557	27	?	216479	13	Married-civ-spouse	?	Wife	White	Female	0	0	24	United-States	>50K	True
20605	20605	58	?	169982	10	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
20680	20680	19	?	200790	8	Married-civ-spouse	?	Other-relative	White	Female	15024	0	40	United-States	>50K	True
20801	20801	60	?	56248	9	Married-civ-spouse	?	Husband	White	Male	0	1485	70	United-States	>50K	True
20898	20898	35	?	98080	15	Never-married	?	Not-in-family	Asian-Pac-Islander	Male	4787	0	45	Japan	>50K	True
20945	20945	62	?	182687	10	Married-civ-spouse	?	Wife	White	Female	0	0	45	United-States	>50K	True
21502	21502	71	?	144872	10	Married-civ-spouse	?	Husband	White	Male	6514	0	40	United-States	>50K	True
21553	21553	71	?	177906	13	Married-civ-spouse	?	Husband	White	Male	0	0	10	United-States	>50K	True
21574	21574	55	?	389479	14	Married-civ-spouse	?	Husband	White	Male	0	0	50	United-States	>50K	True
21702	21702	34	?	166545	10	Married-civ-spouse	?	Wife	White	Female	7688	0	6	United-States	>50K	True
22005	22005	35	?	320084	13	Married-civ-spouse	?	Wife	White	Female	0	0	55	United-States	>50K	True
22275	22275	32	?	134886	9	Married-civ-spouse	?	Wife	White	Female	0	0	2	United-States	>50K	True
22383	22383	27	?	180553	9	Married-civ-spouse	?	Wife	White	Female	0	0	40	United-States	>50K	True
22588	22588	41	?	27187	11	Married-civ-spouse	?	Husband	White	Male	0	2415	12	United-States	>50K	True
22593	22593	68	?	146645	16	Married-civ-spouse	?	Husband	White	Male	20051	0	50	United-States	>50K	True
22598	22598	32	?	335427	13	Married-civ-spouse	?	Wife	White	Female	0	0	20	United-States	>50K	True
22735	22735	54	?	180211	10	Married-civ-spouse	?	Husband	Asian-Pac-Islander	Male	0	0	60	South	>50K	True
23376	23376	69	?	182668	9	Married-civ-spouse	?	Husband	White	Male	0	0	45	United-States	>50K	True
23457	23457	48	?	355890	13	Married-civ-spouse	?	Husband	White	Male	0	0	55	United-States	>50K	True
23630	23630	76	?	28221	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	Canada	>50K	True
23705	23705	59	?	375049	9	Married-civ-spouse	?	Husband	White	Male	0	0	41	United-States	>50K	True
23773	23773	65	?	195733	10	Married-civ-spouse	?	Husband	White	Male	0	0	30	United-States	>50K	True
24399	24399	48	?	151584	10	Never-married	?	Not-in-family	White	Male	8614	0	60	United-States	>50K	True
24487	24487	37	?	319685	11	Married-civ-spouse	?	Husband	White	Male	0	0	54	United-States	>50K	True
24551	24551	68	?	257269	13	Married-civ-spouse	?	Husband	White	Male	0	2377	35	United-States	>50K	True
24623	24623	42	?	212206	14	Married-civ-spouse	?	Wife	White	Female	0	1887	48	United-States	>50K	True
24654	24654	58	?	266792	10	Married-civ-spouse	?	Husband	White	Male	99999	0	40	United-States	>50K	True
24675	24675	62	?	178764	9	Married-civ-spouse	?	Husband	White	Male	0	0	40	United-States	>50K	True
24759	24759	40	?	351161	14	Married-civ-spouse	?	Husband	White	Male	0	0	60	United-States	>50K	True
24850	24850	38	?	70282	14	Married-civ-spouse	?	Wife	Black	Female	15024	0	2	United-States	>50K	True
24860	24860	33	?	369386	10	Married-civ-spouse	?	Wife	White	Female	5178	0	40	United-States	>50K	True
24880	24880	67	?	129188	16	Married-civ-spouse	?	Husband	White	Male	20051	0	5	United-States	>50K	True
25082	25082	72	?	33608	10	Married-civ-spouse	?	Husband	White	Male	9386	0	30	United-States	>50K	True

# 무급, 일하지 않음은 17명입니다.
df[(df['workclass'] == 'Without-pay') | (df['workclass'] == 'Never-worked')].shape

(17, 16)

# Self-emp-inc, 법인이 있는 개인 사업자 분들 중 연 소득 5만 달러 초과하시는 분들
df[(df['workclass'] == 'Self-emp-inc') & (df['income_bool'] == True)].head(150)
# occupation의 Exec-managerial, 임원이 눈에 띕니다!

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
50	50	47	Self-emp-inc	120131	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	Cuba	>50K	True
385	385	74	Self-emp-inc	231002	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	30	United-States	>50K	True
388	388	64	Self-emp-inc	179436	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	55	United-States	>50K	True
389	389	84	Self-emp-inc	172907	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	35	United-States	>50K	True
413	413	50	Self-emp-inc	283676	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	15024	0	60	United-States	>50K	True
480	480	32	Self-emp-inc	124919	13	Married-civ-spouse	Other-service	Husband	Asian-Pac-Islander	Male	0	0	50	Iran	>50K	True
584	584	45	Self-emp-inc	117605	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	48	United-States	>50K	True
762	762	54	Self-emp-inc	298215	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
809	809	41	Self-emp-inc	253060	13	Married-civ-spouse	Sales	Husband	White	Male	7688	0	45	United-States	>50K	True
909	909	49	Self-emp-inc	362654	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	50	United-States	>50K	True
971	971	60	Self-emp-inc	210827	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	7688	0	40	United-States	>50K	True
1042	1042	39	Self-emp-inc	543042	9	Married-civ-spouse	Craft-repair	Husband	White	Male	5178	0	50	United-States	>50K	True
1118	1118	50	Self-emp-inc	100029	13	Widowed	Sales	Unmarried	White	Male	0	0	65	United-States	>50K	True
1161	1161	31	Self-emp-inc	203488	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
1172	1172	30	Self-emp-inc	173858	10	Married-civ-spouse	Exec-managerial	Husband	Asian-Pac-Islander	Male	0	1902	40	South	>50K	True
1203	1203	58	Self-emp-inc	130454	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
1213	1213	43	Self-emp-inc	150533	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	68	United-States	>50K	True
1235	1235	42	Self-emp-inc	152071	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	60	Cuba	>50K	True
1278	1278	59	Self-emp-inc	122390	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	1977	48	United-States	>50K	True
1308	1308	40	Self-emp-inc	49249	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
1310	1310	56	Self-emp-inc	98418	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	99999	0	40	United-States	>50K	True
1313	1313	35	Self-emp-inc	65624	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
1392	1392	51	Self-emp-inc	100029	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	15024	0	40	United-States	>50K	True
1499	1499	45	Self-emp-inc	271901	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	32	United-States	>50K	True
1519	1519	70	Self-emp-inc	225780	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	20	United-States	>50K	True
1592	1592	43	Self-emp-inc	117158	13	Married-civ-spouse	Sales	Husband	White	Male	15024	0	60	United-States	>50K	True
1646	1646	57	Self-emp-inc	51016	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	60	United-States	>50K	True
1678	1678	60	Self-emp-inc	181196	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	40	United-States	>50K	True
1736	1736	52	Self-emp-inc	49069	10	Married-civ-spouse	Adm-clerical	Wife	White	Female	0	0	40	United-States	>50K	True
1795	1795	39	Self-emp-inc	135500	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	1977	40	United-States	>50K	True
1812	1812	43	Self-emp-inc	304906	13	Married-civ-spouse	Sales	Husband	White	Male	0	0	45	United-States	>50K	True
1841	1841	44	Self-emp-inc	187720	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
1896	1896	57	Self-emp-inc	172654	15	Married-civ-spouse	Transport-moving	Husband	White	Male	15024	0	50	United-States	>50K	True
1925	1925	41	Self-emp-inc	194636	13	Married-civ-spouse	Sales	Husband	White	Male	99999	0	65	United-States	>50K	True
1932	1932	39	Self-emp-inc	283338	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7298	0	40	United-States	>50K	True
1998	1998	42	Self-emp-inc	23510	14	Divorced	Exec-managerial	Unmarried	Asian-Pac-Islander	Male	0	2201	60	India	>50K	True
2143	2143	33	Self-emp-inc	201763	13	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
2306	2306	57	Self-emp-inc	146103	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	45	United-States	>50K	True
2374	2374	63	Self-emp-inc	110890	14	Divorced	Prof-specialty	Not-in-family	White	Male	0	0	70	United-States	>50K	True
2376	2376	54	Self-emp-inc	96460	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	7688	0	60	United-States	>50K	True
2446	2446	52	Self-emp-inc	260938	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	60	United-States	>50K	True
2497	2497	40	Self-emp-inc	157240	14	Married-civ-spouse	Exec-managerial	Wife	White	Female	15024	0	30	Iran	>50K	True
2501	2501	51	Self-emp-inc	162943	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	>50K	True
2583	2583	45	Self-emp-inc	181307	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	15024	0	43	United-States	>50K	True
2592	2592	56	Self-emp-inc	24127	11	Married-civ-spouse	Sales	Husband	White	Male	0	0	54	United-States	>50K	True
2663	2663	55	Self-emp-inc	141807	13	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K	True
2695	2695	47	Self-emp-inc	173783	13	Married-civ-spouse	Sales	Husband	White	Male	15024	0	60	United-States	>50K	True
2718	2718	45	Self-emp-inc	120131	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	50	United-States	>50K	True
2815	2815	39	Self-emp-inc	336226	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	3103	0	60	United-States	>50K	True
2832	2832	44	Self-emp-inc	104892	10	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	58	United-States	>50K	True
2927	2927	42	Self-emp-inc	443508	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	45	United-States	>50K	True
2994	2994	46	Self-emp-inc	125892	14	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
3036	3036	44	Self-emp-inc	398473	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	70	United-States	>50K	True
3139	3139	35	Self-emp-inc	135436	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	United-States	>50K	True
3306	3306	69	Self-emp-inc	107850	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	6514	0	40	United-States	>50K	True
3337	3337	39	Self-emp-inc	131288	12	Married-civ-spouse	Sales	Husband	White	Male	5178	0	48	United-States	>50K	True
3427	3427	43	Self-emp-inc	82488	13	Married-civ-spouse	Sales	Own-child	Asian-Pac-Islander	Female	0	0	40	Philippines	>50K	True
3465	3465	40	Self-emp-inc	344060	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	United-States	>50K	True
3482	3482	44	Self-emp-inc	138991	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
3545	3545	37	Self-emp-inc	26698	10	Married-civ-spouse	Sales	Husband	White	Male	0	1485	44	United-States	>50K	True
3633	3633	78	Self-emp-inc	188044	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	2392	40	United-States	>50K	True
3695	3695	49	Self-emp-inc	119539	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	60	?	>50K	True
3733	3733	37	Self-emp-inc	328466	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
3832	3832	41	Self-emp-inc	495061	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	99999	0	70	United-States	>50K	True
3841	3841	48	Self-emp-inc	30575	11	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	70	United-States	>50K	True
3870	3870	42	Self-emp-inc	348886	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	45	United-States	>50K	True
3881	3881	57	Self-emp-inc	180211	15	Married-civ-spouse	Prof-specialty	Husband	Asian-Pac-Islander	Male	0	0	50	Taiwan	>50K	True
4013	4013	52	Self-emp-inc	234286	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	40	United-States	>50K	True
4020	4020	49	Self-emp-inc	158685	9	Married-civ-spouse	Adm-clerical	Wife	White	Female	0	2377	40	United-States	>50K	True
4050	4050	57	Self-emp-inc	220789	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	45	United-States	>50K	True
4176	4176	71	Self-emp-inc	118119	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	20051	0	50	United-States	>50K	True
4194	4194	41	Self-emp-inc	177905	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7688	0	70	United-States	>50K	True
4209	4209	53	Self-emp-inc	128272	16	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	70	United-States	>50K	True
4224	4224	57	Self-emp-inc	37345	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	36	United-States	>50K	True
4258	4258	39	Self-emp-inc	116358	13	Married-civ-spouse	Sales	Husband	Asian-Pac-Islander	Male	7688	0	40	?	>50K	True
4307	4307	52	Self-emp-inc	68015	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	90	United-States	>50K	True
4367	4367	28	Self-emp-inc	113870	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	60	United-States	>50K	True
4414	4414	83	Self-emp-inc	240150	6	Married-civ-spouse	Farming-fishing	Husband	White	Male	20051	0	50	United-States	>50K	True
4420	4420	47	Self-emp-inc	201699	12	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
4439	4439	45	Self-emp-inc	151584	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	35	United-States	>50K	True
4441	4441	55	Self-emp-inc	124137	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	2415	35	Greece	>50K	True
4602	4602	43	Self-emp-inc	130126	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	45	United-States	>50K	True
4611	4611	70	Self-emp-inc	158437	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	35	United-States	>50K	True
4625	4625	39	Self-emp-inc	329980	13	Married-civ-spouse	Sales	Husband	White	Male	0	2415	60	United-States	>50K	True
4641	4641	54	Self-emp-inc	129432	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	40	United-States	>50K	True
4678	4678	43	Self-emp-inc	172826	10	Married-civ-spouse	Sales	Husband	White	Male	99999	0	55	United-States	>50K	True
4709	4709	51	Self-emp-inc	28765	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	60	United-States	>50K	True
4727	4727	59	Self-emp-inc	103948	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K	True
4738	4738	52	Self-emp-inc	287927	9	Married-civ-spouse	Exec-managerial	Wife	White	Female	15024	0	40	United-States	>50K	True
4748	4748	49	Self-emp-inc	362795	14	Divorced	Prof-specialty	Unmarried	White	Male	99999	0	80	Mexico	>50K	True
4901	4901	51	Self-emp-inc	338836	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	40	United-States	>50K	True
4930	4930	40	Self-emp-inc	207578	9	Married-civ-spouse	Adm-clerical	Husband	White	Male	0	0	50	United-States	>50K	True
4979	4979	83	Self-emp-inc	153183	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	2392	55	United-States	>50K	True
5037	5037	51	Self-emp-inc	208302	12	Married-civ-spouse	Sales	Husband	White	Male	0	0	38	United-States	>50K	True
5046	5046	45	Self-emp-inc	121836	10	Married-civ-spouse	Prof-specialty	Wife	White	Female	0	0	40	?	>50K	True
5118	5118	65	Self-emp-inc	208452	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	35	United-States	>50K	True
5174	5174	51	Self-emp-inc	46281	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
5180	5180	56	Self-emp-inc	165881	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
5185	5185	68	Self-emp-inc	52052	11	Widowed	Sales	Not-in-family	White	Female	25124	0	50	United-States	>50K	True
5244	5244	54	Self-emp-inc	383365	13	Married-civ-spouse	Sales	Husband	White	Male	0	0	70	United-States	>50K	True
5269	5269	45	Self-emp-inc	34091	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	38	United-States	>50K	True
5323	5323	30	Self-emp-inc	78530	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	65	Canada	>50K	True
5458	5458	50	Self-emp-inc	219420	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
5536	5536	43	Self-emp-inc	286750	15	Married-civ-spouse	Prof-specialty	Husband	Black	Male	0	0	99	United-States	>50K	True
5583	5583	44	Self-emp-inc	229466	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
5615	5615	49	Self-emp-inc	94606	16	Married-civ-spouse	Prof-specialty	Husband	Black	Male	0	0	60	United-States	>50K	True
5630	5630	56	Self-emp-inc	208809	9	Married-civ-spouse	Sales	Husband	White	Male	0	1902	40	United-States	>50K	True
5635	5635	24	Self-emp-inc	142404	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	40	United-States	>50K	True
5652	5652	35	Self-emp-inc	340110	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	50	United-States	>50K	True
5712	5712	34	Self-emp-inc	186824	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	15024	0	40	United-States	>50K	True
5722	5722	44	Self-emp-inc	69333	13	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	50	United-States	>50K	True
5903	5903	41	Self-emp-inc	94113	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	60	United-States	>50K	True
5912	5912	48	Self-emp-inc	81513	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
5950	5950	55	Self-emp-inc	298449	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	2415	50	United-States	>50K	True
5952	5952	32	Self-emp-inc	161153	9	Married-civ-spouse	Farming-fishing	Husband	White	Male	0	1902	55	United-States	>50K	True
5999	5999	37	Self-emp-inc	291518	13	Married-civ-spouse	Craft-repair	Husband	White	Male	15024	0	55	United-States	>50K	True
6023	6023	60	Self-emp-inc	90915	7	Married-civ-spouse	Transport-moving	Husband	White	Male	0	0	40	United-States	>50K	True
6041	6041	27	Self-emp-inc	120126	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	1887	45	United-States	>50K	True
6044	6044	51	Self-emp-inc	194995	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	45	United-States	>50K	True
6102	6102	38	Self-emp-inc	140854	13	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	50	United-States	>50K	True
6109	6109	56	Self-emp-inc	205601	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	99999	0	70	United-States	>50K	True
6183	6183	52	Self-emp-inc	114758	13	Married-civ-spouse	Sales	Husband	White	Male	15024	0	50	United-States	>50K	True
6193	6193	68	Self-emp-inc	182131	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	10605	0	20	United-States	>50K	True
6242	6242	37	Self-emp-inc	107164	6	Never-married	Transport-moving	Not-in-family	White	Male	0	2559	50	United-States	>50K	True
6352	6352	67	Self-emp-inc	411007	9	Widowed	Exec-managerial	Not-in-family	White	Female	15831	0	40	United-States	>50K	True
6384	6384	38	Self-emp-inc	269318	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	7298	0	40	United-States	>50K	True
6391	6391	49	Self-emp-inc	119565	14	Married-civ-spouse	Sales	Husband	White	Male	0	0	40	United-States	>50K	True
6417	6417	43	Self-emp-inc	221172	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	1977	40	United-States	>50K	True
6472	6472	46	Self-emp-inc	235320	14	Divorced	Sales	Not-in-family	White	Male	0	0	60	United-States	>50K	True
6488	6488	42	Self-emp-inc	78765	10	Divorced	Exec-managerial	Unmarried	White	Male	0	0	90	United-States	>50K	True
6601	6601	38	Self-emp-inc	308686	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	70	United-States	>50K	True
6633	6633	71	Self-emp-inc	38822	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	99999	0	40	United-States	>50K	True
6701	6701	44	Self-emp-inc	311357	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	United-States	>50K	True
6716	6716	58	Self-emp-inc	113806	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7688	0	30	United-States	>50K	True
6838	6838	44	Self-emp-inc	120277	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	99999	0	45	United-States	>50K	True
6878	6878	36	Self-emp-inc	184456	13	Never-married	Tech-support	Not-in-family	White	Male	27828	0	55	United-States	>50K	True
6893	6893	59	Self-emp-inc	31359	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	80	United-States	>50K	True
6896	6896	44	Self-emp-inc	151089	9	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	1887	70	United-States	>50K	True
6961	6961	38	Self-emp-inc	99146	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	15024	0	80	United-States	>50K	True
7013	7013	61	Self-emp-inc	148577	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	55	United-States	>50K	True
7160	7160	42	Self-emp-inc	123838	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	1977	50	United-States	>50K	True
7206	7206	47	Self-emp-inc	212120	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	>50K	True
7322	7322	60	Self-emp-inc	197553	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	7688	0	50	United-States	>50K	True
7401	7401	49	Self-emp-inc	44671	12	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	>50K	True
7470	7470	37	Self-emp-inc	186359	9	Married-civ-spouse	Sales	Husband	White	Male	7688	0	60	United-States	>50K	True
7479	7479	41	Self-emp-inc	93227	13	Married-civ-spouse	Exec-managerial	Husband	Asian-Pac-Islander	Male	0	1977	60	Taiwan	>50K	True
7557	7557	34	Self-emp-inc	215382	14	Separated	Prof-specialty	Not-in-family	White	Female	4787	0	40	United-States	>50K	True
7566	7566	44	Self-emp-inc	456236	10	Divorced	Sales	Own-child	White	Male	0	0	45	United-States	>50K	True
7587	7587	38	Self-emp-inc	299036	13	Married-civ-spouse	Sales	Husband	White	Male	0	0	55	United-States	>50K	True
7630	7630	59	Self-emp-inc	146477	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	>50K	True

2. occupation

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'occupation')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7f1459247350>

pd.pivot_table(data = df, index = 'occupation', values = 'income_bool', aggfunc = [np.sum,np.mean])

	sum	mean
	income_bool	income_bool
occupation
?	153	0.101459
Adm-clerical	402	0.134764
Armed-Forces	0	0.000000
Craft-repair	738	0.226242
Exec-managerial	1593	0.490758
Farming-fishing	91	0.116071
Handlers-cleaners	71	0.065018
Machine-op-inspct	200	0.126422
Other-service	110	0.041889
Priv-house-serv	1	0.008130
Prof-specialty	1491	0.451271
Protective-serv	167	0.319923
Sales	811	0.270514
Tech-support	224	0.301887
Transport-moving	253	0.199213

pd.pivot_table(data = df_num, index = 'occupation', values = 'income_bool', aggfunc = [np.sum,np.mean])

	sum	mean
	income_bool	income_bool
occupation
0	153	0.101459
1	402	0.134764
2	0	0.000000
3	738	0.226242
4	1593	0.490758
5	91	0.116071
6	71	0.065018
7	200	0.126422
8	110	0.041889
9	1	0.008130
10	1491	0.451271
11	167	0.319923
12	811	0.270514
13	224	0.301887
14	253	0.199213

# 직업이 임원인 분들을 알아봅시다
df_ceo = df[(df['occupation'] == 'Exec-managerial')]
print(df_ceo.shape)
df_ceo.head()

(3246, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
16	16	32	Private	195000	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7298	0	45	United-States	>50K	True
21	21	39	Private	280570	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	3103	0	50	United-States	>50K	True
28	28	46	Private	428405	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	40	United-States	>50K	True
48	48	41	Local-gov	144995	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	55	United-States	<=50K	False
50	50	47	Self-emp-inc	120131	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	Cuba	>50K	True

# 개인 사업 대표면 연 5만 달러 초과 수익일 확률이 높습니다.
sns.countplot(data = df_ceo, x = 'workclass', hue = 'income_bool')

<AxesSubplot:xlabel='workclass', ylabel='count'>

# 직업이 Prof-specialty인 분들을 봅시다. 교수님인 것 같습abs니다.
df_prof = df[(df['occupation'] == 'Prof-specialty')]
print(df_prof.shape)
df_prof.head()

(3304, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
3	3	21	Private	151158	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K	False
23	23	29	Private	204862	12	Divorced	Prof-specialty	Not-in-family	White	Female	0	0	36	United-States	<=50K	False
26	26	50	State-gov	297551	9	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	52	United-States	<=50K	False
39	39	51	Local-gov	123325	15	Widowed	Prof-specialty	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
53	53	64	Self-emp-not-inc	149698	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	>50K	True

# 법인이 있는 개인 사업가인 경우 연 5만 초과일 확률이 높습니다.
sns.countplot(data = df_prof, x = 'workclass', hue = 'income_bool')

<AxesSubplot:xlabel='workclass', ylabel='count'>

3. race

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'race')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7fbc0b43f750>

sns.countplot(data = df, x = 'race', hue = 'income_bool')

<AxesSubplot:xlabel='race', ylabel='count'>

4. native_country

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'native_country')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7fbc0b2d4490>

pd.pivot_table(data = df, index = 'native_country', values = 'income_bool', aggfunc = [np.sum,np.mean])

	sum	mean
	income_bool	income_bool
native_country
?	107	0.234649
Cambodia	6	0.428571
Canada	29	0.315217
China	13	0.228070
Columbia	2	0.038462
Cuba	20	0.263158
Dominican-Republic	2	0.041667
Ecuador	4	0.166667
El-Salvador	7	0.088608
England	23	0.343284
France	10	0.416667
Germany	35	0.346535
Greece	6	0.250000
Guatemala	3	0.057692
Haiti	4	0.114286
Honduras	0	0.000000
Hong	4	0.285714
Hungary	3	0.272727
India	31	0.402597
Iran	17	0.485714
Ireland	4	0.222222
Italy	19	0.380000
Jamaica	7	0.109375
Japan	19	0.404255
Laos	2	0.133333
Mexico	26	0.048689
Nicaragua	2	0.071429
Outlying-US(Guam-USVI-etc)	0	0.000000
Peru	2	0.076923
Philippines	49	0.300613
Poland	10	0.212766
Portugal	2	0.066667
Puerto-Rico	11	0.115789
Scotland	2	0.250000
South	14	0.222222
Taiwan	18	0.461538
Thailand	2	0.153846
Trinadad&Tobago	1	0.071429
United-States	5780	0.247315
Vietnam	4	0.080000
Yugoslavia	5	0.416667

EDA 2차 결론

• EDA 결과를 바탕으로 아래와 같이 PREPROCESSING을 진행하겠습니다.
  1. age: 10개 그룹으로 구간화해보겠습니다.
  2. hours_per_week: 정규화 해보겠습니다.

---

1. relationship: 추가 작업이 필요없습니다.
2. marital_status: 추가 작업이 필요없습니다.
3. education_num: 추가 작업이 필요없습니다.
4. sex: 추가 작업이 필요 없습니다.
5. capital_gain, bool 컬럼을 그대로 사용하겠습니다.
6. workclass: 추가 작업이 필요없습니다.
7. occupation: 추가 작업이 필요없습니다.

EDA 3차

궁금증: 연 5만 달러 이상 버는 사람들의 공통적인 특성은?

print(df.shape)
df.head(150)

(26049, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
0	0	40	Private	168538	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	60	United-States	>50K	True
1	1	17	Private	101626	5	Never-married	Machine-op-inspct	Own-child	White	Male	0	0	20	United-States	<=50K	False
2	2	18	Private	353358	10	Never-married	Other-service	Own-child	White	Male	0	0	16	United-States	<=50K	False
3	3	21	Private	151158	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K	False
4	4	24	Private	122234	10	Never-married	Adm-clerical	Not-in-family	Black	Female	0	0	20	?	<=50K	False
5	5	43	Private	236985	9	Married-civ-spouse	Craft-repair	Husband	Black	Male	0	0	40	United-States	<=50K	False
6	6	43	State-gov	206139	13	Married-civ-spouse	Adm-clerical	Husband	White	Male	0	0	50	United-States	>50K	True
7	7	37	Private	340599	7	Separated	Other-service	Unmarried	Black	Female	0	0	40	United-States	<=50K	False
8	8	47	Private	230136	9	Married-civ-spouse	Other-service	Husband	Black	Male	0	0	60	United-States	>50K	True
9	9	41	Private	153031	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	65	United-States	>50K	True
10	10	34	Private	238376	2	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	Mexico	<=50K	False
11	11	21	?	204226	10	Never-married	?	Unmarried	White	Female	0	0	35	United-States	<=50K	False
12	12	44	Private	157236	10	Married-spouse-absent	Handlers-cleaners	Unmarried	White	Male	0	0	40	Poland	<=50K	False
13	13	18	Private	266681	7	Never-married	Other-service	Own-child	White	Male	0	0	20	United-States	<=50K	False
14	14	50	Private	71898	3	Married-civ-spouse	Machine-op-inspct	Wife	Asian-Pac-Islander	Female	0	0	35	Philippines	<=50K	False
15	15	39	Self-emp-not-inc	188335	9	Married-civ-spouse	Farming-fishing	Husband	White	Male	0	0	40	United-States	<=50K	False
16	16	32	Private	195000	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7298	0	45	United-States	>50K	True
17	17	54	Private	315804	9	Divorced	Craft-repair	Not-in-family	White	Male	0	0	40	United-States	<=50K	False
18	18	50	Private	72351	13	Divorced	Sales	Not-in-family	White	Male	0	0	45	United-States	<=50K	False
19	19	39	Private	138192	13	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	>50K	True
20	20	21	Private	132243	12	Never-married	Other-service	Own-child	White	Female	0	0	5	United-States	<=50K	False
21	21	39	Private	280570	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	3103	0	50	United-States	>50K	True
22	22	26	Self-emp-not-inc	258306	6	Married-civ-spouse	Farming-fishing	Husband	White	Male	0	0	99	United-States	<=50K	False
23	23	29	Private	204862	12	Divorced	Prof-specialty	Not-in-family	White	Female	0	0	36	United-States	<=50K	False
24	24	53	Self-emp-not-inc	240138	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	60	United-States	<=50K	False
25	25	31	Private	117028	9	Married-civ-spouse	Machine-op-inspct	Husband	White	Male	0	0	40	United-States	<=50K	False
26	26	50	State-gov	297551	9	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	52	United-States	<=50K	False
27	27	21	Private	213015	9	Never-married	Handlers-cleaners	Other-relative	Black	Male	2176	0	40	United-States	<=50K	False
28	28	46	Private	428405	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	40	United-States	>50K	True
29	29	23	Private	224424	13	Never-married	Other-service	Own-child	White	Male	0	0	40	United-States	<=50K	False
30	30	20	?	202994	10	Never-married	?	Own-child	White	Female	0	0	16	United-States	<=50K	False
31	31	26	Private	345405	9	Married-civ-spouse	Sales	Husband	White	Male	2885	0	40	United-States	<=50K	False
32	32	26	Private	337940	3	Never-married	Transport-moving	Not-in-family	White	Male	0	0	40	Mexico	<=50K	False
33	33	37	Local-gov	128054	10	Divorced	Adm-clerical	Unmarried	White	Female	0	0	40	United-States	<=50K	False
34	34	31	?	505438	9	Married-civ-spouse	?	Husband	White	Male	0	0	30	Mexico	<=50K	False
35	35	39	Private	299828	3	Separated	Sales	Unmarried	Black	Female	0	0	30	Puerto-Rico	<=50K	False
36	36	41	Self-emp-not-inc	251305	10	Married-civ-spouse	Sales	Husband	White	Male	0	0	40	United-States	<=50K	False
37	37	22	Private	385540	6	Never-married	Other-service	Not-in-family	White	Male	0	0	40	Mexico	<=50K	False
38	38	27	Private	211032	2	Never-married	Craft-repair	Not-in-family	White	Male	0	0	40	Mexico	<=50K	False
39	39	51	Local-gov	123325	15	Widowed	Prof-specialty	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
40	40	18	Private	138917	7	Never-married	Sales	Own-child	Black	Female	0	0	10	United-States	<=50K	False
41	41	57	Local-gov	190747	5	Married-civ-spouse	Other-service	Husband	White	Male	0	0	40	United-States	<=50K	False
42	42	25	Private	139012	13	Never-married	Sales	Own-child	Asian-Pac-Islander	Male	2174	0	40	Vietnam	<=50K	False
43	43	76	Private	70697	4	Widowed	Other-service	Not-in-family	White	Female	0	0	25	United-States	<=50K	False
44	44	38	Federal-gov	248919	9	Married-civ-spouse	Transport-moving	Husband	White	Male	0	2051	40	United-States	<=50K	False
45	45	51	Private	257485	10	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	>50K	True
46	46	25	Private	187653	9	Never-married	Handlers-cleaners	Not-in-family	White	Male	0	0	48	United-States	<=50K	False
47	47	47	Federal-gov	34845	13	Married-civ-spouse	Adm-clerical	Husband	White	Male	0	0	45	Germany	>50K	True
48	48	41	Local-gov	144995	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	55	United-States	<=50K	False
49	49	47	Self-emp-not-inc	249585	10	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	30	United-States	<=50K	False
50	50	47	Self-emp-inc	120131	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	Cuba	>50K	True
51	51	41	Private	149102	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	60	United-States	>50K	True
52	52	66	Federal-gov	38621	11	Widowed	Other-service	Unmarried	Black	Female	3273	0	40	United-States	<=50K	False
53	53	64	Self-emp-not-inc	149698	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	>50K	True
54	54	47	Private	110669	13	Separated	Prof-specialty	Unmarried	White	Female	0	0	50	United-States	<=50K	False
55	55	51	Self-emp-inc	213296	9	Married-civ-spouse	Other-service	Husband	White	Male	0	0	30	United-States	<=50K	False
56	56	50	Self-emp-not-inc	167728	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	60	United-States	>50K	True
57	57	40	Private	206066	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	50	United-States	<=50K	False
58	58	32	Federal-gov	174215	13	Never-married	Exec-managerial	Not-in-family	White	Female	0	0	60	United-States	<=50K	False
59	59	37	Private	315291	13	Never-married	Adm-clerical	Other-relative	Black	Female	0	0	40	United-States	<=50K	False
60	60	51	Private	86332	11	Married-civ-spouse	Other-service	Husband	White	Male	4064	0	55	United-States	<=50K	False
61	61	58	Self-emp-not-inc	164065	14	Divorced	Sales	Not-in-family	White	Male	0	0	18	United-States	<=50K	False
62	62	45	Private	100651	9	Divorced	Other-service	Not-in-family	White	Male	0	1980	40	United-States	<=50K	False
63	63	52	Local-gov	153312	12	Married-civ-spouse	Protective-serv	Husband	White	Male	0	0	40	United-States	>50K	True
64	64	46	Private	241844	5	Married-civ-spouse	Other-service	Husband	White	Male	0	0	40	United-States	<=50K	False
65	65	41	Private	116825	14	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	55	United-States	>50K	True
66	66	67	?	39100	9	Married-civ-spouse	?	Wife	White	Female	0	0	5	United-States	<=50K	False
67	67	65	?	404601	9	Married-civ-spouse	?	Husband	White	Male	2414	0	30	United-States	<=50K	False
68	68	35	Private	172571	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	United-States	<=50K	False
69	69	22	Private	264738	9	Never-married	Exec-managerial	Other-relative	White	Female	0	0	42	Germany	<=50K	False
70	70	35	Private	498216	13	Divorced	Exec-managerial	Unmarried	White	Female	0	0	40	United-States	<=50K	False
71	71	22	Private	279802	10	Never-married	Adm-clerical	Own-child	White	Female	0	0	40	United-States	<=50K	False
72	72	32	Local-gov	29235	10	Married-civ-spouse	Protective-serv	Wife	White	Female	0	0	40	France	>50K	True
73	73	17	Private	413557	7	Never-married	Adm-clerical	Own-child	White	Female	0	0	32	United-States	<=50K	False
74	74	19	?	218471	9	Never-married	?	Own-child	White	Female	0	1602	30	United-States	<=50K	False
75	75	29	Private	91189	13	Married-civ-spouse	Machine-op-inspct	Husband	White	Male	0	0	48	United-States	<=50K	False
76	76	64	Private	166715	10	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	20	United-States	<=50K	False
77	77	50	Federal-gov	176969	9	Divorced	Prof-specialty	Not-in-family	White	Male	0	1590	40	United-States	<=50K	False
78	78	19	Private	42750	10	Never-married	Handlers-cleaners	Not-in-family	White	Male	0	0	55	United-States	<=50K	False
79	79	43	Private	171888	10	Divorced	Adm-clerical	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
80	80	24	Private	107882	9	Never-married	Sales	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
81	81	52	Private	270728	4	Married-civ-spouse	Other-service	Husband	White	Male	0	0	48	Cuba	<=50K	False
82	82	17	Private	186890	6	Married-civ-spouse	Sales	Own-child	White	Female	0	0	30	United-States	<=50K	False
83	83	39	Private	51100	9	Married-civ-spouse	Transport-moving	Husband	White	Male	0	0	40	United-States	>50K	True
84	84	68	Private	104438	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	Ireland	>50K	True
85	85	34	Private	84119	9	Never-married	Craft-repair	Own-child	White	Male	0	0	40	United-States	<=50K	False
86	86	47	Federal-gov	197332	13	Divorced	Prof-specialty	Not-in-family	White	Male	0	0	40	United-States	<=50K	False
87	87	25	Private	175370	10	Divorced	Machine-op-inspct	Own-child	White	Female	0	0	40	United-States	<=50K	False
88	88	32	Local-gov	217296	9	Married-civ-spouse	Transport-moving	Wife	White	Female	4064	0	22	United-States	<=50K	False
89	89	28	Private	389713	9	Divorced	Protective-serv	Not-in-family	White	Male	0	0	40	United-States	<=50K	False
90	90	40	Local-gov	233891	9	Never-married	Adm-clerical	Unmarried	Black	Female	0	0	35	United-States	<=50K	False
91	91	54	Private	77336	9	Married-civ-spouse	Sales	Husband	White	Male	0	0	40	United-States	<=50K	False
92	92	24	Private	653574	9	Never-married	Craft-repair	Own-child	White	Male	0	0	40	El-Salvador	<=50K	False
93	93	32	Private	281437	10	Married-civ-spouse	Transport-moving	Husband	White	Male	0	0	55	United-States	<=50K	False
94	94	33	Private	37232	10	Never-married	Craft-repair	Not-in-family	White	Male	0	0	80	United-States	<=50K	False
95	95	47	Self-emp-not-inc	126500	4	Married-civ-spouse	Sales	Husband	White	Male	0	0	40	Puerto-Rico	<=50K	False
96	96	24	Private	24243	9	Never-married	Craft-repair	Not-in-family	White	Male	0	1590	40	United-States	<=50K	False
97	97	68	Private	284763	7	Divorced	Transport-moving	Not-in-family	White	Male	0	0	70	United-States	<=50K	False
98	98	36	Private	101460	9	Never-married	Other-service	Not-in-family	White	Female	0	0	18	United-States	<=50K	False
99	99	50	Private	163671	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	<=50K	False
100	100	35	Private	181382	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	43	United-States	<=50K	False
101	101	63	Private	268965	8	Widowed	Sales	Unmarried	White	Female	0	0	40	United-States	<=50K	False
102	102	62	Self-emp-not-inc	226546	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	16	United-States	<=50K	False
103	103	34	?	146589	9	Never-married	?	Unmarried	Black	Female	0	0	40	United-States	<=50K	False
104	104	45	Local-gov	192684	10	Divorced	Adm-clerical	Unmarried	Black	Female	0	0	38	United-States	<=50K	False
105	105	42	Private	258589	9	Never-married	Sales	Not-in-family	White	Male	0	0	60	United-States	>50K	True
106	106	42	Federal-gov	294431	14	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	<=50K	False
107	107	39	Private	435638	10	Never-married	Machine-op-inspct	Not-in-family	White	Male	0	0	40	United-States	<=50K	False
108	108	59	Private	160631	13	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	60	United-States	>50K	True
109	109	31	Local-gov	189269	9	Never-married	Protective-serv	Own-child	White	Male	0	0	40	United-States	<=50K	False
110	110	47	Self-emp-not-inc	213668	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	1977	50	United-States	>50K	True
111	111	22	Private	326334	10	Never-married	Craft-repair	Own-child	White	Male	0	0	35	United-States	<=50K	False
112	112	49	Self-emp-not-inc	182752	16	Married-civ-spouse	Prof-specialty	Wife	White	Female	0	0	35	United-States	>50K	True
113	113	28	Private	85812	10	Married-civ-spouse	Sales	Wife	White	Female	0	0	40	United-States	<=50K	False
114	114	30	Private	296453	13	Married-civ-spouse	Adm-clerical	Husband	White	Male	7298	0	40	United-States	>50K	True
115	115	30	Local-gov	44566	13	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	40	United-States	<=50K	False
116	116	19	Private	415354	6	Divorced	Other-service	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
117	117	53	Private	55861	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	>50K	True
118	118	56	Local-gov	160829	9	Divorced	Adm-clerical	Not-in-family	White	Female	0	0	46	United-States	<=50K	False
119	119	20	Private	54012	9	Never-married	Handlers-cleaners	Own-child	White	Male	0	0	40	United-States	<=50K	False
120	120	44	Private	79531	9	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	45	United-States	<=50K	False
121	121	45	Private	247043	7	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	42	United-States	<=50K	False
122	122	27	Private	587310	4	Never-married	Other-service	Other-relative	White	Male	0	0	35	Guatemala	<=50K	False
123	123	30	Private	177216	15	Married-civ-spouse	Prof-specialty	Husband	Black	Male	0	1740	40	Haiti	<=50K	False
124	124	25	Private	144259	9	Never-married	Craft-repair	Own-child	Black	Male	0	0	50	United-States	<=50K	False
125	125	21	?	123983	10	Never-married	?	Other-relative	Asian-Pac-Islander	Male	0	0	10	Vietnam	<=50K	False
126	126	19	Private	136866	9	Never-married	Craft-repair	Own-child	White	Male	0	0	45	United-States	<=50K	False
127	127	35	Private	177102	9	Divorced	Handlers-cleaners	Unmarried	White	Female	0	0	40	United-States	<=50K	False
128	128	35	Private	192626	10	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	United-States	>50K	True
129	129	33	Private	123291	9	Married-civ-spouse	Machine-op-inspct	Husband	White	Male	0	0	84	United-States	>50K	True
130	130	20	?	124242	10	Never-married	?	Own-child	White	Female	0	0	40	United-States	<=50K	False
131	131	24	Private	267945	13	Never-married	Adm-clerical	Own-child	White	Female	0	0	40	United-States	<=50K	False
132	132	33	Private	232475	10	Never-married	Sales	Own-child	White	Male	0	0	45	United-States	<=50K	False
133	133	36	Private	150601	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	50	?	<=50K	False
134	134	48	?	174533	7	Separated	?	Unmarried	White	Male	0	0	40	United-States	<=50K	False
135	135	61	Federal-gov	28291	13	Married-civ-spouse	Exec-managerial	Wife	White	Female	0	0	40	United-States	<=50K	False
136	136	38	Self-emp-not-inc	282461	4	Married-civ-spouse	Sales	Husband	White	Male	0	0	35	United-States	>50K	True
137	137	46	Private	110171	10	Married-civ-spouse	Craft-repair	Husband	White	Male	7688	0	40	United-States	>50K	True
138	138	23	Private	184400	6	Never-married	Transport-moving	Own-child	Asian-Pac-Islander	Male	0	0	30	?	<=50K	False
139	139	29	Self-emp-not-inc	240172	13	Never-married	Exec-managerial	Other-relative	White	Male	0	0	50	United-States	<=50K	False
140	140	25	Private	99126	11	Married-civ-spouse	Prof-specialty	Wife	White	Female	7688	0	40	United-States	>50K	True
141	141	22	Private	243178	13	Never-married	Adm-clerical	Own-child	White	Male	0	0	20	United-States	<=50K	False
142	142	50	Self-emp-not-inc	197054	15	Divorced	Sales	Not-in-family	White	Male	0	0	50	United-States	>50K	True
143	143	43	Private	55395	10	Married-civ-spouse	Craft-repair	Husband	White	Male	0	0	40	United-States	<=50K	False
144	144	43	Private	102180	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	0	0	50	United-States	>50K	True
145	145	25	?	214925	6	Never-married	?	Own-child	Black	Male	0	0	40	United-States	<=50K	False
146	146	30	Private	258170	9	Divorced	Adm-clerical	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
147	147	60	?	106282	5	Widowed	?	Not-in-family	White	Female	0	0	40	United-States	<=50K	False
148	148	27	Private	191129	10	Married-civ-spouse	Machine-op-inspct	Husband	White	Male	0	0	40	United-States	<=50K	False
149	149	45	Private	165232	10	Divorced	Tech-support	Not-in-family	Black	Female	0	0	40	Trinadad&Tobago	<=50K	False

sns.countplot(data = df_num, x = 'income_bool')

<AxesSubplot:xlabel='income_bool', ylabel='count'>

# 연 소득이 5만 달러 이상인 사람들은 24% 정도 입니다.
df_num['income_bool'].value_counts()

False    19744
True      6305
Name: income_bool, dtype: int64

# 남성이 여성보다 많습니다.
sns.countplot(data = df, x = 'sex', hue = 'income_bool')

<AxesSubplot:xlabel='sex', ylabel='count'>

# 기혼자의 수가 압도적입니다.
sns.countplot(data = df, x = 'marital_status', hue = 'income_bool')

<AxesSubplot:xlabel='marital_status', ylabel='count'>

# 14년 이상 공부했을 경우 연 소득이 5만 달러 넘을 비율이 높습니다.
sns.countplot(data = df, x = 'education_num', hue = 'income_bool'  )

<AxesSubplot:xlabel='education_num', ylabel='count'>

# 13년 이상 공부한 사람들은 남성의 비율이 여성보다 높습니다.
sns.countplot(data = df_num, x = 'education_num', hue = 'sex')

<AxesSubplot:xlabel='education_num', ylabel='count'>

# 남성이면서, 기혼자면서, 14년 이상 공부한 사람들이 연 소득 5만 달러 이상인 사람들의 비율은?
df_m_m_14 = df[(df['sex'] == 'Male') & (df['marital_status'] == 'Married-civ-spouse') & (df['education_num'] >= 14)]
print(df_m_m_14.shape)
df_m_m_14.head()

(1235, 21)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	...	capital_loss	hours_per_week	native_country	income	income_bool	age_bool	hours_per_week_bool	capital_gain_bool	Male_married_13y_edu	native_country_bool
48	48	41	Local-gov	144995	14	Married-civ-spouse	Exec-managerial	Husband	White	Male	...	0	55	United-States	<=50K	False	True	True	False	True	True
53	53	64	Self-emp-not-inc	149698	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	...	0	40	United-States	>50K	True	True	True	False	True	True
56	56	50	Self-emp-not-inc	167728	16	Married-civ-spouse	Prof-specialty	Husband	White	Male	...	0	60	United-States	>50K	True	True	True	False	True	True
65	65	41	Private	116825	14	Married-civ-spouse	Prof-specialty	Husband	White	Male	...	0	55	United-States	>50K	True	True	True	False	True	True
102	102	62	Self-emp-not-inc	226546	15	Married-civ-spouse	Prof-specialty	Husband	White	Male	...	0	16	United-States	<=50K	False	True	False	False	True	True

5 rows × 21 columns

# 1,235 명 중 968명이 연 소득 5만 달러 이상입니다.
df_m_m_14['income_bool'].value_counts()

True     968
False    267
Name: income_bool, dtype: int64

sns.countplot(data = df_m_m_14, x = 'income_bool')

<AxesSubplot:xlabel='income_bool', ylabel='count'>

EDA 3차 결론

• EDA 결과를 바탕으로 아래와 같이 PREPROCESSING을 진행하겠습니다.
  1. age: 25세 이하 bool
  2. hours_per_week: 30시간 이하 bool
  3. capital_gain: bool
  4. 남성이면서, 기혼자면서, 14년 이상 공부한 사람들
  5. native_country: 미국인 bool
  6. relationship
  7. education_num
  8. workclass
  9. occupation

EDA 4차

# occupation
df_ceo_prof = df[(df['occupation'] == 'Exec-managerial') | (df['occupation'] == 'Prof-specialty')]
print(df_ceo_prof.shape)
df_ceo_prof.head()

(6550, 16)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	income	income_bool
3	3	21	Private	151158	10	Never-married	Prof-specialty	Own-child	White	Female	0	0	25	United-States	<=50K	False
16	16	32	Private	195000	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	7298	0	45	United-States	>50K	True
21	21	39	Private	280570	13	Married-civ-spouse	Exec-managerial	Husband	White	Male	3103	0	50	United-States	>50K	True
23	23	29	Private	204862	12	Divorced	Prof-specialty	Not-in-family	White	Female	0	0	36	United-States	<=50K	False
26	26	50	State-gov	297551	9	Married-civ-spouse	Prof-specialty	Husband	White	Male	0	0	52	United-States	<=50K	False

df_ceo_prof[df_ceo_prof['marital_status'] == 'Married-civ-spouse']['income_bool'].value_counts()

True     2542
False    1106
Name: income_bool, dtype: int64

# 직업이 임원, 교수이면서 결혼을 했으면 연 소득 5만 달러 이상인 비율이 높다.
pd.pivot_table(data = df_ceo_prof, index = ['workclass', 'marital_status'], values = 'income_bool', aggfunc = [np.sum, np.mean])

		sum	mean
		income_bool	income_bool
workclass	marital_status
Federal-gov	Divorced	16	0.313725
	Married-AF-spouse	1	1.000000
	Married-civ-spouse	118	0.791946
	Married-spouse-absent	2	0.500000
	Never-married	12	0.155844
	Separated	3	0.500000
	Widowed	2	0.181818
Local-gov	Divorced	20	0.151515
	Married-civ-spouse	247	0.682320
	Married-spouse-absent	0	0.000000
	Never-married	24	0.121827
	Separated	3	0.136364
	Widowed	4	0.137931
Private	Divorced	129	0.242481
	Married-AF-spouse	2	1.000000
	Married-civ-spouse	1503	0.707960
	Married-spouse-absent	10	0.250000
	Never-married	166	0.149955
	Separated	22	0.205607
	Widowed	20	0.253165
Self-emp-inc	Divorced	16	0.457143
	Married-civ-spouse	268	0.774566
	Never-married	6	0.200000
	Separated	4	0.363636
	Widowed	2	0.250000
Self-emp-not-inc	Divorced	19	0.243590
	Married-AF-spouse	1	1.000000
	Married-civ-spouse	229	0.549161
	Married-spouse-absent	3	0.333333
	Never-married	23	0.280488
	Separated	0	0.000000
	Widowed	5	0.333333
State-gov	Divorced	12	0.179104
	Married-civ-spouse	177	0.705179
	Married-spouse-absent	2	0.400000
	Never-married	12	0.090226
	Separated	1	0.100000
	Widowed	0	0.000000

# age
pd.pivot_table(data = df, index = 'age', values = 'income_bool', aggfunc = [np.mean, np.sum])

	mean	sum
	income_bool	income_bool
age
17	0.000000	0
18	0.000000	0
19	0.001764	1
20	0.000000	0
21	0.003527	2
22	0.016051	10
23	0.012748	9
24	0.037094	24
25	0.063953	44
26	0.088647	57
27	0.095238	64
28	0.141399	97
29	0.165152	109
30	0.209064	143
31	0.224719	160
32	0.235821	158
33	0.214697	149
34	0.272597	190
35	0.253521	180
36	0.317143	222
37	0.336811	226
38	0.346041	236
39	0.343465	226
40	0.336449	216
41	0.348297	225
42	0.351047	218
43	0.365574	223
44	0.378049	217
45	0.392982	224
46	0.389916	232
47	0.409660	229
48	0.399093	176
49	0.369658	173
50	0.424431	205
51	0.414938	200
52	0.388889	147
53	0.409605	145
54	0.400000	132
55	0.353293	118
56	0.323129	95
57	0.379699	101
58	0.348993	104
59	0.367273	101
60	0.326613	81
61	0.316667	76
62	0.252336	54
63	0.254054	47
64	0.238636	42
65	0.248227	35
66	0.219512	27
67	0.241935	30
68	0.230769	21
69	0.176471	15
70	0.176471	12
71	0.245283	13
72	0.152542	9
73	0.156863	8
74	0.244444	11
75	0.138889	5
76	0.081081	3
77	0.130435	3
78	0.238095	5
79	0.388889	7
80	0.100000	2
81	0.125000	2
82	0.000000	0
83	0.400000	2
84	0.111111	1
85	0.000000	0
86	0.000000	0
87	0.000000	0
88	0.000000	0
90	0.166667	6

EDA 4차 결론

• EDA 결과를 바탕으로 아래와 같이 PREPROCESSING을 진행하겠습니다.
  1. age: 15개 그룹으로 바인딩 / 나이에 따라 연봉이 달라지는 경향이 있습니다.
  2. hours_per_week: 정규화
  3. 남성이면서, 기혼자면서, 14년 이상 공부한 사람들
  4. 직업이 임원, 교수이면서 결혼을 한 사람들
  5. education_num
  6. sex
  7. race

PREPROCESSING 5차

# fnlwgt
df['fnlwgt_log'] = np.log(df['fnlwgt'] + 1)

figure, (ax1, ax2) = plt.subplots(nrows=1, ncols=2)
figure.set_size_inches(18, 4)


sns.distplot(df["fnlwgt"], ax=ax1)
sns.distplot(df["fnlwgt_log"], ax=ax2)

/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)
/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)

<AxesSubplot:xlabel='fnlwgt_log', ylabel='Density'>

df_t['fnlwgt_log'] = np.log(df_t['fnlwgt'] + 1)

figure, (ax1, ax2) = plt.subplots(nrows=1, ncols=2)
figure.set_size_inches(18, 4)

sns.distplot(df_t["fnlwgt"], ax=ax1)
sns.distplot(df_t["fnlwgt_log"], ax=ax2)

/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)
/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)

<AxesSubplot:xlabel='fnlwgt_log', ylabel='Density'>

PREPROCESSING 4차

# 1 age
# 나이를 구간화(Binning) 합니다.
df['age_bin'] = pd.qcut(df['age'], 10, labels = False)
df['age_log'] = np.log(df['age'] + 1)

print(df.shape)
df[['age', 'age_bin']]

(26049, 24)

	age	age_bin
0	40	5
1	17	0
2	18	0
3	21	0
4	24	1
...	...	...
26044	57	8
26045	23	1
26046	78	9
26047	26	1
26048	20	0

26049 rows × 2 columns

# test
df_t['age_bin'] = pd.qcut(df_t['age'], 10, labels = False)
df_t['age_log'] = np.log(df_t['age'] + 1)
print(df_t.shape)
df_t[['age', 'age_bin']]

(6512, 22)

	age	age_bin
0	28	2
1	40	5
2	20	0
3	40	5
4	37	4
...	...	...
6507	35	4
6508	41	5
6509	39	5
6510	35	4
6511	28	2

6512 rows × 2 columns

# 2. hours_per_week:
# 정규화
df['hours_per_week_log'] = np.log(df['hours_per_week'] + 1)

# test
df_t['hours_per_week_log'] = np.log(df_t['hours_per_week'] + 1)

figure, (ax1, ax2) = plt.subplots(nrows=1, ncols=2)
figure.set_size_inches(18, 4)


sns.distplot(df["hours_per_week"], ax=ax1)
sns.distplot(df["hours_per_week_log"], ax=ax2)

<AxesSubplot:xlabel='hours_per_week_log', ylabel='Density'>

# 3. 남성이면서, 기혼자면서, 14년 이상 공부한 사람들
df['Male_married_14y_edu'] =  (df['sex'] == 'Male') & (df['marital_status'] == 'Married-civ-spouse') & (df['education_num'] >= 14)
print(df.shape)
df[['sex', 'marital_status','education_num','Male_married_14y_edu']].head()

(26049, 24)

	sex	marital_status	education_num	Male_married_14y_edu
0	Male	Married-civ-spouse	9	False
1	Male	Never-married	5	False
2	Male	Never-married	10	False
3	Female	Never-married	10	False
4	Female	Never-married	10	False

# test
df_t['Male_married_14y_edu'] =  (df_t['sex'] == 'Male') & (df_t['marital_status'] == 'Married-civ-spouse') & (df_t['education_num'] >= 14)
print(df.shape)
df_t[['sex', 'marital_status','education_num','Male_married_14y_edu']].head()

(26049, 24)

	sex	marital_status	education_num	Male_married_14y_edu
0	Female	Never-married	10	False
1	Male	Married-civ-spouse	9	False
2	Male	Never-married	10	False
3	Male	Married-civ-spouse	11	False
4	Male	Married-civ-spouse	16	True

# 4. 직업이 임원, 교수이면서 결혼을 한 사람들
df['ceo_prof_m'] = ((df['occupation'] == 'Exec-managerial') | (df['occupation'] == 'Prof-specialty')) & (df['marital_status'] == 'Married-civ-spouse')
print(df.shape)
df[['occupation', 'marital_status', 'ceo_prof_m']].head()

(26049, 24)

	occupation	marital_status	ceo_prof_m
0	Sales	Married-civ-spouse	False
1	Machine-op-inspct	Never-married	False
2	Other-service	Never-married	False
3	Prof-specialty	Never-married	False
4	Adm-clerical	Never-married	False

# 4. 직업이 임원, 교수이면서 결혼을 한 사람들
df_t['ceo_prof_m'] = ((df_t['occupation'] == 'Exec-managerial') | (df_t['occupation'] == 'Prof-specialty')) & (df_t['marital_status'] == 'Married-civ-spouse')
print(df_t.shape)
df_t[['occupation', 'marital_status', 'ceo_prof_m']].head()

(6512, 22)

	occupation	marital_status	ceo_prof_m
0	Adm-clerical	Never-married	False
1	Exec-managerial	Married-civ-spouse	True
2	Handlers-cleaners	Never-married	False
3	Exec-managerial	Married-civ-spouse	True
4	Prof-specialty	Married-civ-spouse	True

# 5. capital_gain: bool
df['capital_gain_bool'] = df['capital_gain'] > 0
print(df.shape)
df[['capital_gain','capital_gain_bool']].head()

(26049, 24)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

# test
df_t['capital_gain_bool'] = df_t['capital_gain'] > 0
print(df_t.shape)
df_t[['capital_gain','capital_gain_bool']].head()

(6512, 22)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

from sklearn.ensemble import RandomForestRegressor
from sklearn.preprocessing import LabelEncoder
# one hot 인코딩

dtypes = df.dtypes
encoders = {}
for column in df.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df[column])
        encoders[column] = encoder
df_num = df.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num[column] = encoder.transform(df[column])
    
print(df_num.shape)
df_num.tail(10)

(26049, 24)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	...	income	income_bool	age_log	age_log1	fnlwgt_log	age_bin	hours_per_week_log	Male_married_14y_edu	ceo_prof_m	capital_gain_bool
26039	26039	52	1	129177	9	0	1	1	4	0	...	0	False	3.970292	3.970292	11.768947	8	3.713572	False	False	False
26040	26040	39	4	30269	11	0	12	4	4	0	...	0	False	3.688879	3.688879	10.317912	5	3.713572	False	False	False
26041	26041	44	4	103233	13	4	1	4	2	0	...	0	False	3.806662	3.806662	11.544754	6	3.713572	False	False	False
26042	26042	48	6	191389	10	5	12	4	4	0	...	0	False	3.891820	3.891820	12.162069	7	3.931826	False	False	False
26043	26043	34	6	234960	13	2	10	0	2	1	...	1	True	3.555348	3.555348	12.367175	4	3.891820	False	True	False
26044	26044	57	4	250201	7	2	8	0	4	1	...	0	False	4.060443	4.060443	12.430024	8	3.970292	False	False	False
26045	26045	23	4	238092	13	4	10	3	4	1	...	0	False	3.178054	3.178054	12.380417	1	3.713572	False	False	False
26046	26046	78	0	165694	14	6	0	1	4	0	...	0	False	4.369448	4.369448	12.017904	9	2.772589	False	False	False
26047	26047	26	6	151626	9	4	10	3	2	0	...	0	False	3.295837	3.295837	11.929179	1	3.713572	False	False	False
26048	26048	20	0	99891	10	4	0	3	4	0	...	0	False	3.044522	3.044522	11.511845	0	3.433987	False	False	False

10 rows × 24 columns

# test one hot 인코딩

dtypes = df_t.dtypes
encoders = {}
for column in df_t.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df_t[column])
        encoders[column] = encoder
df_num_t = df_t.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num_t[column] = encoder.transform(df_t[column])
    
print(df_num_t.shape)
df_num_t.tail(10)

(6512, 22)

	id	age	workclass	fnlwgt	education	education_num	marital_status	occupation	relationship	race	...	capital_loss	hours_per_week	native_country	fnlwgt_log	age_bin	age_log	hours_per_week_log	Male_married_14y_edu	ceo_prof_m	capital_gain_bool
6502	6502	25	4	198587	15	10	4	13	1	2	...	0	50	39	12.198988	1	3.258097	3.931826	False	False	True
6503	6503	70	6	124449	12	14	2	4	0	4	...	2246	8	39	11.731659	9	4.262680	2.197225	True	True	False
6504	6504	41	4	163322	1	7	0	4	4	4	...	0	36	39	12.003485	5	3.737670	3.610918	False	False	False
6505	6505	55	4	171015	15	10	4	1	3	4	...	0	36	39	12.049512	8	4.025352	3.610918	False	False	False
6506	6506	56	4	112840	11	9	2	4	0	4	...	0	55	39	11.633735	8	4.043051	4.025352	False	True	False
6507	6507	35	4	61343	9	13	2	12	0	4	...	0	40	39	11.024253	4	3.583519	3.713572	False	False	False
6508	6508	41	5	32185	9	13	2	13	0	4	...	0	40	39	10.379287	5	3.737670	3.713572	False	False	False
6509	6509	39	4	409189	4	3	2	8	0	4	...	0	40	26	12.921935	5	3.688879	3.713572	False	False	False
6510	6510	35	4	180342	11	9	2	3	0	4	...	0	40	39	12.102616	4	3.583519	3.713572	False	False	False
6511	6511	28	4	156819	11	9	0	6	4	4	...	0	36	39	11.962854	2	3.367296	3.610918	False	False	False

10 rows × 22 columns

PREPROCESSING 2차

# 1. age: 25세 이하 bool
df['age_bool'] = df['age'] >= 25
print(df.shape)
df[['age', 'age_bool']].head()

(26049, 17)

	age	age_bool
0	40	True
1	17	False
2	18	False
3	21	False
4	24	False

# test
df_t['age_bool'] = df_t['age'] >= 25
print(df_t.shape)
df_t[['age', 'age_bool']].head()

(6512, 16)

	age	age_bool
0	28	True
1	40	True
2	20	False
3	40	True
4	37	True

# 2. hours_per_week: 30시간 이하 bool
df['hours_per_week_bool'] = df['hours_per_week'] >= 30
print(df.shape)
df[['hours_per_week','hours_per_week_bool']].head()

(26049, 18)

	hours_per_week	hours_per_week_bool
0	60	True
1	20	False
2	16	False
3	25	False
4	20	False

# test
df_t['hours_per_week_bool'] = df_t['hours_per_week'] >= 30
print(df_t.shape)
df_t[['hours_per_week','hours_per_week_bool']].head()

(6512, 17)

	hours_per_week	hours_per_week_bool
0	40	True
1	50	True
2	25	False
3	50	True
4	99	True

# 3. capital_gain: bool
df['capital_gain_bool'] = df['capital_gain'] > 0
print(df.shape)
df[['capital_gain','capital_gain_bool']].head()

(26049, 24)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

# test
df_t['capital_gain_bool'] = df_t['capital_gain'] > 0
print(df_t.shape)
df_t[['capital_gain','capital_gain_bool']].head()

(6512, 22)

	capital_gain	capital_gain_bool
0	0	False
1	0	False
2	0	False
3	0	False
4	0	False

# 4. 남성이면서, 기혼자면서, 14년 이상 공부한 사람들
df['Male_married_14y_edu'] =  (df['sex'] == 'Male') & (df['marital_status'] == 'Married-civ-spouse') & (df['education_num'] >= 14)
print(df.shape)
df[['sex', 'marital_status','education_num','Male_married_14y_edu']].head()

(26049, 20)

	sex	marital_status	education_num	Male_married_13y_edu
0	Male	Married-civ-spouse	9	False
1	Male	Never-married	5	False
2	Male	Never-married	10	False
3	Female	Never-married	10	False
4	Female	Never-married	10	False

# test
df_t['Male_married_13y_edu'] =  (df_t['sex'] == 'Male') & (df_t['marital_status'] == 'Married-civ-spouse') & (df_t['education_num'] >= 13)
print(df_t.shape)
df_t[['sex', 'marital_status','education_num','Male_married_13y_edu']].head()

(6512, 19)

	sex	marital_status	education_num	Male_married_13y_edu
0	Female	Never-married	10	False
1	Male	Married-civ-spouse	9	False
2	Male	Never-married	10	False
3	Male	Married-civ-spouse	11	False
4	Male	Married-civ-spouse	16	True

# 5. native_country: 미국인 bool
df['native_country_bool'] = df['native_country'] == 'United-States'
print(df.shape)
df[['native_country','native_country_bool']].head()

(26049, 21)

	native_country	native_country_bool
0	United-States	True
1	United-States	True
2	United-States	True
3	United-States	True
4	?	False

# test
df_t['native_country_bool'] = df_t['native_country'] == 'United-States'
print(df_t.shape)
df_t[['native_country','native_country_bool']].head()

(6512, 20)

	native_country	native_country_bool
0	United-States	True
1	United-States	True
2	United-States	True
3	United-States	True
4	France	False

from sklearn.ensemble import RandomForestRegressor
from sklearn.preprocessing import LabelEncoder
# one hot 인코딩

dtypes = df.dtypes
encoders = {}
for column in df.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df[column])
        encoders[column] = encoder
df_num = df.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num[column] = encoder.transform(df[column])
    
print(df_num.shape)
df_num.head(10)

(26049, 21)

	id	age	workclass	fnlwgt	education_num	marital_status	occupation	relationship	race	sex	...	capital_loss	hours_per_week	native_country	income	income_bool	age_bool	hours_per_week_bool	capital_gain_bool	Male_married_13y_edu	native_country_bool
0	0	40	4	168538	9	2	12	0	4	1	...	0	60	38	1	True	True	True	False	False	True
1	1	17	4	101626	5	4	7	3	4	1	...	0	20	38	0	False	False	False	False	False	True
2	2	18	4	353358	10	4	8	3	4	1	...	0	16	38	0	False	False	False	False	False	True
3	3	21	4	151158	10	4	10	3	4	0	...	0	25	38	0	False	False	False	False	False	True
4	4	24	4	122234	10	4	1	1	2	0	...	0	20	0	0	False	False	False	False	False	False
5	5	43	4	236985	9	2	3	0	2	1	...	0	40	38	0	False	True	True	False	False	True
6	6	43	7	206139	13	2	1	0	4	1	...	0	50	38	1	True	True	True	False	True	True
7	7	37	4	340599	7	5	8	4	2	0	...	0	40	38	0	False	True	True	False	False	True
8	8	47	4	230136	9	2	8	0	2	1	...	0	60	38	1	True	True	True	False	False	True
9	9	41	4	153031	10	2	12	0	4	1	...	0	65	38	1	True	True	True	False	False	True

10 rows × 21 columns

# test
from sklearn.ensemble import RandomForestRegressor
from sklearn.preprocessing import LabelEncoder
# one hot 인코딩

dtypes = df_t.dtypes
encoders = {}
for column in df_t.columns:
    if str(dtypes[column]) == 'object':
        encoder = LabelEncoder()
        encoder.fit(df_t[column])
        encoders[column] = encoder
df_num_t = df_t.copy()

for column in encoders.keys():
    encoder = encoders[column]
    df_num_t[column] = encoder.transform(df_t[column])
    
print(df_num_t.shape)
df_num_t.head(10)

(6512, 20)

	id	age	workclass	fnlwgt	education	education_num	marital_status	occupation	relationship	race	sex	capital_gain	capital_loss	hours_per_week	native_country	age_bool	hours_per_week_bool	capital_gain_bool	Male_married_13y_edu	native_country_bool
0	0	28	4	67661	15	10	4	1	2	4	0	0	0	40	39	True	True	False	False	True
1	1	40	5	37869	11	9	2	4	0	4	1	0	0	50	39	True	True	False	False	True
2	2	20	4	109952	15	10	4	6	3	4	1	0	0	25	39	False	False	False	False	True
3	3	40	4	114537	8	11	2	4	0	4	1	0	0	50	39	True	True	False	False	True
4	4	37	4	51264	10	16	2	10	0	4	1	0	0	99	10	True	True	False	True	False
5	5	36	4	279615	9	13	0	12	3	4	0	0	0	40	39	True	True	False	False	True
6	6	49	4	87928	11	9	2	1	0	4	1	0	0	40	39	True	True	False	False	True
7	7	26	4	130620	7	12	3	3	2	1	0	0	0	40	0	True	True	False	False	False
8	8	45	4	28119	11	9	2	1	0	4	1	0	0	7	39	True	False	False	False	True
9	9	39	4	236136	8	11	0	1	4	2	0	0	0	40	39	True	True	False	False	True

PREPROCESSING 1차

1. age

# 나이를 구간화(Binning) 합니다.
df_num['age_bin'] = pd.qcut(df_num['age'], 10, labels = False)
print(df_num.shape)
df_num[['age', 'age_bin']]

(26049, 21)

	age	age_bin
0	40	5
1	17	0
2	18	0
3	21	0
4	24	1
...	...	...
26044	57	8
26045	23	1
26046	78	9
26047	26	1
26048	20	0

26049 rows × 2 columns

figure, (ax1, ax2) = plt.subplots(nrows=1, ncols=2)
figure.set_size_inches(18, 4)


sns.distplot(df_num["age"], ax=ax1)
sns.distplot(df_num["age_bin"], ax=ax2)

/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)
/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)

<AxesSubplot:xlabel='age_bin', ylabel='Density'>

sns.countplot(data = df_num, x = 'age_bin', hue = 'income_bool')

<AxesSubplot:xlabel='age_bin', ylabel='count'>

# test data
df_num_t['age_bin'] = pd.qcut(df_num_t['age'], 10, labels = False)
print(df_num_t.shape)
df_num_t[['age', 'age_bin']]

(6512, 18)

	age	age_bin
0	28	2
1	40	5
2	20	0
3	40	5
4	37	4
...	...	...
6507	35	4
6508	41	5
6509	39	5
6510	35	4
6511	28	2

6512 rows × 2 columns

# test data
df_num_t['relationship_bool'] = (df_num_t['relationship'] == 0) | (df_num_t['relationship'] == 5)
print(df_num_t.shape)
df_num_t[['relationship', 'relationship_bool']].head()

(6512, 20)

	relationship	relationship_bool
0	2	False
1	0	True
2	3	False
3	0	True
4	0	True

2. hours_per_week

pd.pivot_table(data = df_num, index = 'hours_per_week', values = 'income_bool', aggfunc = np.mean)

	income_bool
hours_per_week
1	0.062500
2	0.280000
3	0.029412
4	0.052632
5	0.137255
6	0.130435
7	0.166667
8	0.050420
9	0.000000
10	0.065502
11	0.000000
12	0.071429
13	0.086957
14	0.086957
15	0.027778
16	0.056604
17	0.041667
18	0.098361
19	0.000000
20	0.066667
21	0.000000
22	0.108108
23	0.000000
24	0.099502
25	0.051948
26	0.181818
27	0.040000
28	0.058824
29	0.166667
30	0.067329
31	0.000000
32	0.105023
33	0.107143
34	0.086957
35	0.145873
36	0.198830
37	0.142857
38	0.174026
39	0.120000
40	0.213592
41	0.250000
42	0.347305
43	0.283333
44	0.321637
45	0.384088
46	0.366667
47	0.305556
48	0.285036
49	0.200000
50	0.456353
51	0.200000
52	0.376238
53	0.222222
54	0.379310
55	0.465364
56	0.402597
57	0.500000
58	0.320000
59	0.400000
60	0.432990
61	1.000000
62	0.230769
63	0.428571
64	0.454545
65	0.420000
66	0.133333
67	0.750000
68	0.454545
70	0.388186
72	0.377358
73	0.500000
74	0.000000
75	0.297872
76	0.666667
77	0.000000
78	0.285714
80	0.426087
81	0.000000
82	0.000000
84	0.444444
85	0.333333
86	0.000000
88	0.000000
89	0.000000
90	0.320000
91	0.000000
92	0.000000
94	0.000000
95	0.000000
96	0.200000
97	0.000000
98	0.333333
99	0.307692

df_num['hours_per_week_log'] = np.log(df_num['hours_per_week'] + 1)

#test data
df_num_t['hours_per_week_log'] = np.log(df_num_t['hours_per_week'] + 1)

figure, (ax1, ax2) = plt.subplots(nrows=1, ncols=2)
figure.set_size_inches(18, 4)


sns.distplot(df_num["hours_per_week"], ax=ax1)
sns.distplot(df_num["hours_per_week_log"], ax=ax2)

/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)
/home/theo/anaconda3/lib/python3.7/site-packages/seaborn/distributions.py:2551: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `histplot` (an axes-level function for histograms).
  warnings.warn(msg, FutureWarning)

<AxesSubplot:xlabel='hours_per_week_log', ylabel='Density'>

fa = sns.FacetGrid(df_num, hue = 'income_bool', aspect = 3)
fa.map(sns.kdeplot, 'hours_per_week_log')
fa.add_legend()

<seaborn.axisgrid.FacetGrid at 0x7f896eae5d90>

3. Occupation

df_num['work_ceo_prof'] = (df_num['occupation'] == 4) | (df_num['occupation'] == 10) & (df_num['workclass'] == 5)
print(df_num.shape)
df_num[['occupation','workclass','work_ceo_prof']].head()

(26049, 23)

	occupation	workclass	work_ceo_prof
0	12	4	False
1	7	4	False
2	8	4	False
3	10	4	False
4	1	4	False

# test
df_num_t['work_ceo_prof'] = (df_num_t['occupation'] == 4) | (df_num_t['occupation'] == 10) & (df_num_t['workclass'] == 5)
print(df_num_t.shape)
df_num_t[['occupation','workclass','work_ceo_prof']].head()

(6512, 20)

	occupation	workclass	work_ceo_prof
0	1	4	False
1	4	5	True
2	6	4	False
3	4	4	True
4	10	4	False

Feature Engineering

from sklearn.model_selection import train_test_split

df.columns

Index(['id', 'age', 'workclass', 'fnlwgt', 'education_num', 'marital_status',
       'occupation', 'relationship', 'race', 'sex', 'capital_gain',
       'capital_loss', 'hours_per_week', 'native_country', 'income',
       'income_bool', 'age_log', 'age_log1', 'fnlwgt_log', 'age_bin',
       'hours_per_week_log', 'Male_married_14y_edu', 'ceo_prof_m',
       'capital_gain_bool'],
      dtype='object')

to_encode = ['workclass', 'marital_status',
             'occupation', 'relationship', 'race', 'sex', 'native_country']

encoded = pd.get_dummies(df[to_encode])
encoded_t = pd.get_dummies(df_t[to_encode])
encoded['native_country_Holand-Netherlands'] = 0

len(encoded.columns)

86

len(encoded_t.columns)

86

b = set(encoded.columns)
c = set(encoded_t.columns)

print(c-b)

set()

# features = ['education_num', 'marital_status', 'capital_gain_bool', 'capital_loss_bool', 
#            'major_age', 'married_bool', 'relationship_bool', 'hours_per_week_log'] eda 1차
# features = ['workclass', 'education_num', 'marital_status', 'occupation', 'capital_gain_bool', 'age_bin', 
#            'hours_per_week_log', 'sex', 'relationship'] # eda 2차
# features = ['education_num', 'capital_gain_bool', 'capital_loss_bool', 'sex', 'relationship' ] # eda 2.5차
# features = ['age_bool', 'hours_per_week_bool', 'Male_married_13y_edu', 'native_country_bool',
#            'education_num', 'capital_gain_bool','workclass','occupation', 'relationship', 'race', 'sex'] # eda 3차

# features = ['age_bin', 'hours_per_week_log', 'Male_married_14y_edu','ceo_prof_m',
#             'education_num','relationship', 'workclass', 'occupation', 'capital_gain_bool', 'sex', 'race'] # eda 4차

features = ['fnlwgt_log', 'age_bin','hours_per_week_log', 'Male_married_14y_edu', 
            'ceo_prof_m','capital_gain_bool','education_num']

target = 'income_bool'

preprocessed = df[features]
preprocessed_t = df_t[features]

print(preprocessed.shape)
print(preprocessed_t.shape)

(26049, 7)
(6512, 7)

X = pd.concat([preprocessed, encoded], axis=1)
print(X.shape)
X.head()

(26049, 93)

	fnlwgt_log	age_bin	hours_per_week_log	Male_married_14y_edu	ceo_prof_m	capital_gain_bool	education_num	workclass_?	workclass_Federal-gov	workclass_Local-gov	...	native_country_Puerto-Rico	native_country_Scotland	native_country_South	native_country_Taiwan	native_country_Thailand	native_country_Trinadad&Tobago	native_country_United-States	native_country_Vietnam	native_country_Yugoslavia	native_country_Holand-Netherlands
0	12.034922	5	4.110874	False	False	False	9	0	0	0	...	0	0	0	0	0	0	1	0	0	0
1	11.529065	0	3.044522	False	False	False	5	0	0	0	...	0	0	0	0	0	0	1	0	0	0
2	12.775240	0	2.833213	False	False	False	10	0	0	0	...	0	0	0	0	0	0	1	0	0	0
3	11.926088	0	3.258097	False	False	False	10	0	0	0	...	0	0	0	0	0	0	1	0	0	0
4	11.713701	1	3.044522	False	False	False	10	0	0	0	...	0	0	0	0	0	0	0	0	0	0

5 rows × 93 columns

X_test = pd.concat([preprocessed_t, encoded_t], axis=1)
print(X_test.shape)
X_test.head()

(6512, 93)

	fnlwgt_log	age_bin	hours_per_week_log	Male_married_14y_edu	ceo_prof_m	capital_gain_bool	education_num	workclass_?	workclass_Federal-gov	workclass_Local-gov	...	native_country_Portugal	native_country_Puerto-Rico	native_country_Scotland	native_country_South	native_country_Taiwan	native_country_Thailand	native_country_Trinadad&Tobago	native_country_United-States	native_country_Vietnam	native_country_Yugoslavia
0	11.122280	2	3.713572	False	False	False	10	0	0	0	...	0	0	0	0	0	0	0	1	0	0
1	10.541915	5	3.931826	False	True	False	9	0	0	0	...	0	0	0	0	0	0	0	1	0	0
2	11.607808	0	3.258097	False	False	False	10	0	0	0	...	0	0	0	0	0	0	0	1	0	0
3	11.648662	5	3.931826	False	True	False	11	0	0	0	...	0	0	0	0	0	0	0	1	0	0
4	10.844764	4	4.605170	True	True	False	16	0	0	0	...	0	0	0	0	0	0	0	0	0	0

5 rows × 93 columns

y = df[target]
print(y.shape)
y.head()

(26049,)

0     True
1    False
2    False
3    False
4    False
Name: income_bool, dtype: bool

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=15)

print(X_train.shape, y_train.shape)
print(X_test.shape, y_test.shape)

(20839, 93) (20839,)
(5210, 93) (5210,)

Model Tuning & Evaluation

# 모듈 import
from sklearn.metrics import classification_report
from sklearn.metrics import accuracy_score
from sklearn.metrics import f1_score
from sklearn.metrics import confusion_matrix


# 0. 쓰고싶은 모델을 Import 한다.
from sklearn.tree import DecisionTreeClassifier
from sklearn.ensemble import RandomForestClassifier
from sklearn import svm
from sklearn.linear_model import SGDClassifier
from sklearn.linear_model import LogisticRegression

# 1. 모델들과 결과들의 Dictionary를 만들어준다.
models_list = {'DecisionTreeClassifier': DecisionTreeClassifier(),
              'RandomForestClassifier': RandomForestClassifier(),
              'svm':svm.SVC(),
              'SGDClassifier':SGDClassifier(),
              'LogisticRegression':LogisticRegression()}



# 2. 함수로 만들어 보기
def run():

    for model_name, model in models_list.items():
        model.fit(X_train, y_train)
        y_pred = model.predict(X_test)
        print(model_name)
        print(accuracy_score(y_test, y_pred))
        print(classification_report(y_test, y_pred))
        print(confusion_matrix(y_test, y_pred))
        print('------------------------------'*2)

run()

DecisionTreeClassifier
0.7911708253358926
              precision    recall  f1-score   support

       False       0.87      0.86      0.86      3978
        True       0.56      0.58      0.57      1232

    accuracy                           0.79      5210
   macro avg       0.71      0.72      0.72      5210
weighted avg       0.80      0.79      0.79      5210

[[3402  576]
 [ 512  720]]
------------------------------------------------------------
RandomForestClassifier
0.8332053742802303
              precision    recall  f1-score   support

       False       0.88      0.90      0.89      3978
        True       0.66      0.60      0.63      1232

    accuracy                           0.83      5210
   macro avg       0.77      0.75      0.76      5210
weighted avg       0.83      0.83      0.83      5210

[[3598  380]
 [ 489  743]]
------------------------------------------------------------
svm
0.8497120921305182
              precision    recall  f1-score   support

       False       0.87      0.94      0.91      3978
        True       0.74      0.57      0.64      1232

    accuracy                           0.85      5210
   macro avg       0.81      0.75      0.77      5210
weighted avg       0.84      0.85      0.84      5210

[[3730  248]
 [ 535  697]]
------------------------------------------------------------
SGDClassifier
0.8122840690978886
              precision    recall  f1-score   support

       False       0.94      0.81      0.87      3978
        True       0.57      0.82      0.68      1232

    accuracy                           0.81      5210
   macro avg       0.75      0.82      0.77      5210
weighted avg       0.85      0.81      0.82      5210

[[3216  762]
 [ 216 1016]]
------------------------------------------------------------
LogisticRegression
0.8477927063339731
              precision    recall  f1-score   support

       False       0.89      0.92      0.90      3978
        True       0.70      0.62      0.66      1232

    accuracy                           0.85      5210
   macro avg       0.79      0.77      0.78      5210
weighted avg       0.84      0.85      0.84      5210

[[3656  322]
 [ 471  761]]
------------------------------------------------------------

from sklearn.model_selection import KFold, GridSearchCV
from lightgbm import LGBMClassifier
from sklearn.metrics import roc_curve, roc_auc_score
lgbm = LGBMClassifier(n_estimators=200)

params = {'max_depth': [10, 15, 20],
          'min_child_samples': [20, 40, 60],
          'subsample': [0.8, 1]}

grid = GridSearchCV(lgbm, param_grid = params)
grid.fit(X_train, y_train, early_stopping_rounds = 100,
        eval_metric = 'auc',
        eval_set = [(X_train, y_train), (X_test, y_test)])
print('최적 파라미터: ', grid.best_params_)
lgbm_roc_score = roc_auc_score(y_test, grid.predict_proba(X_test)[:, 1], average='macro')
print("ROC AUC: {0:.4f}".format(lgbm_roc_score))

[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893661	valid_0's binary_logloss: 0.487821	valid_1's auc: 0.89789	valid_1's binary_logloss: 0.479031
[3]	valid_0's auc: 0.895358	valid_0's binary_logloss: 0.46475	valid_1's auc: 0.900518	valid_1's binary_logloss: 0.455502
[4]	valid_0's auc: 0.897521	valid_0's binary_logloss: 0.445439	valid_1's auc: 0.901053	valid_1's binary_logloss: 0.436218
[5]	valid_0's auc: 0.898548	valid_0's binary_logloss: 0.429505	valid_1's auc: 0.902382	valid_1's binary_logloss: 0.42009
[6]	valid_0's auc: 0.900136	valid_0's binary_logloss: 0.415702	valid_1's auc: 0.903689	valid_1's binary_logloss: 0.406213
[7]	valid_0's auc: 0.901043	valid_0's binary_logloss: 0.403937	valid_1's auc: 0.904063	valid_1's binary_logloss: 0.394669
[8]	valid_0's auc: 0.901915	valid_0's binary_logloss: 0.3937	valid_1's auc: 0.904593	valid_1's binary_logloss: 0.384593
[9]	valid_0's auc: 0.902614	valid_0's binary_logloss: 0.384979	valid_1's auc: 0.905035	valid_1's binary_logloss: 0.376022
[10]	valid_0's auc: 0.903685	valid_0's binary_logloss: 0.377086	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.368898
[11]	valid_0's auc: 0.904382	valid_0's binary_logloss: 0.370239	valid_1's auc: 0.90596	valid_1's binary_logloss: 0.362513
[12]	valid_0's auc: 0.904928	valid_0's binary_logloss: 0.364202	valid_1's auc: 0.905891	valid_1's binary_logloss: 0.357052
[13]	valid_0's auc: 0.905978	valid_0's binary_logloss: 0.358812	valid_1's auc: 0.906362	valid_1's binary_logloss: 0.352116
[14]	valid_0's auc: 0.906802	valid_0's binary_logloss: 0.354021	valid_1's auc: 0.906936	valid_1's binary_logloss: 0.347742
[15]	valid_0's auc: 0.907538	valid_0's binary_logloss: 0.349681	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.343932
[16]	valid_0's auc: 0.908292	valid_0's binary_logloss: 0.345783	valid_1's auc: 0.907608	valid_1's binary_logloss: 0.340528
[17]	valid_0's auc: 0.908863	valid_0's binary_logloss: 0.342282	valid_1's auc: 0.907757	valid_1's binary_logloss: 0.337605
[18]	valid_0's auc: 0.909461	valid_0's binary_logloss: 0.339098	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.335112
[19]	valid_0's auc: 0.910237	valid_0's binary_logloss: 0.336034	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.332672
[20]	valid_0's auc: 0.910715	valid_0's binary_logloss: 0.333413	valid_1's auc: 0.908313	valid_1's binary_logloss: 0.330645
[21]	valid_0's auc: 0.911366	valid_0's binary_logloss: 0.330845	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.328627
[22]	valid_0's auc: 0.912021	valid_0's binary_logloss: 0.328523	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.327038
[23]	valid_0's auc: 0.912646	valid_0's binary_logloss: 0.326292	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.325831
[24]	valid_0's auc: 0.913278	valid_0's binary_logloss: 0.324304	valid_1's auc: 0.908781	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.913843	valid_0's binary_logloss: 0.322426	valid_1's auc: 0.908812	valid_1's binary_logloss: 0.323652
[26]	valid_0's auc: 0.914506	valid_0's binary_logloss: 0.320639	valid_1's auc: 0.90896	valid_1's binary_logloss: 0.322552
[27]	valid_0's auc: 0.915052	valid_0's binary_logloss: 0.31885	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.321599
[28]	valid_0's auc: 0.915538	valid_0's binary_logloss: 0.317377	valid_1's auc: 0.909137	valid_1's binary_logloss: 0.320806
[29]	valid_0's auc: 0.915968	valid_0's binary_logloss: 0.316008	valid_1's auc: 0.909082	valid_1's binary_logloss: 0.320286
[30]	valid_0's auc: 0.916492	valid_0's binary_logloss: 0.31461	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.319621
[31]	valid_0's auc: 0.917075	valid_0's binary_logloss: 0.313159	valid_1's auc: 0.909275	valid_1's binary_logloss: 0.318918
[32]	valid_0's auc: 0.917512	valid_0's binary_logloss: 0.311901	valid_1's auc: 0.909333	valid_1's binary_logloss: 0.318398
[33]	valid_0's auc: 0.918	valid_0's binary_logloss: 0.310673	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.317966
[34]	valid_0's auc: 0.918528	valid_0's binary_logloss: 0.309477	valid_1's auc: 0.909237	valid_1's binary_logloss: 0.317786
[35]	valid_0's auc: 0.919055	valid_0's binary_logloss: 0.308316	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.317654
[36]	valid_0's auc: 0.919365	valid_0's binary_logloss: 0.307448	valid_1's auc: 0.909155	valid_1's binary_logloss: 0.317281
[37]	valid_0's auc: 0.919825	valid_0's binary_logloss: 0.306478	valid_1's auc: 0.909343	valid_1's binary_logloss: 0.316821
[38]	valid_0's auc: 0.920271	valid_0's binary_logloss: 0.305526	valid_1's auc: 0.909437	valid_1's binary_logloss: 0.316513
[39]	valid_0's auc: 0.920677	valid_0's binary_logloss: 0.304586	valid_1's auc: 0.909464	valid_1's binary_logloss: 0.316293
[40]	valid_0's auc: 0.921068	valid_0's binary_logloss: 0.30375	valid_1's auc: 0.909526	valid_1's binary_logloss: 0.315996
[41]	valid_0's auc: 0.921527	valid_0's binary_logloss: 0.302745	valid_1's auc: 0.90966	valid_1's binary_logloss: 0.315655
[42]	valid_0's auc: 0.921932	valid_0's binary_logloss: 0.301937	valid_1's auc: 0.909644	valid_1's binary_logloss: 0.315528
[43]	valid_0's auc: 0.922366	valid_0's binary_logloss: 0.3011	valid_1's auc: 0.909709	valid_1's binary_logloss: 0.315324
[44]	valid_0's auc: 0.922755	valid_0's binary_logloss: 0.300342	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.315453
[45]	valid_0's auc: 0.923242	valid_0's binary_logloss: 0.299449	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.315285
[46]	valid_0's auc: 0.923544	valid_0's binary_logloss: 0.298756	valid_1's auc: 0.909539	valid_1's binary_logloss: 0.315197
[47]	valid_0's auc: 0.923919	valid_0's binary_logloss: 0.297998	valid_1's auc: 0.909628	valid_1's binary_logloss: 0.31498
[48]	valid_0's auc: 0.924262	valid_0's binary_logloss: 0.297262	valid_1's auc: 0.909663	valid_1's binary_logloss: 0.314807
[49]	valid_0's auc: 0.924661	valid_0's binary_logloss: 0.296542	valid_1's auc: 0.909755	valid_1's binary_logloss: 0.314616
[50]	valid_0's auc: 0.925017	valid_0's binary_logloss: 0.295874	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314639
[51]	valid_0's auc: 0.925359	valid_0's binary_logloss: 0.295233	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.314825
[52]	valid_0's auc: 0.925719	valid_0's binary_logloss: 0.294628	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.314867
[53]	valid_0's auc: 0.926122	valid_0's binary_logloss: 0.293895	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.314754
[54]	valid_0's auc: 0.926447	valid_0's binary_logloss: 0.293304	valid_1's auc: 0.909561	valid_1's binary_logloss: 0.314512
[55]	valid_0's auc: 0.926659	valid_0's binary_logloss: 0.292857	valid_1's auc: 0.909517	valid_1's binary_logloss: 0.314527
[56]	valid_0's auc: 0.926941	valid_0's binary_logloss: 0.292226	valid_1's auc: 0.909348	valid_1's binary_logloss: 0.314773
[57]	valid_0's auc: 0.927147	valid_0's binary_logloss: 0.291777	valid_1's auc: 0.909267	valid_1's binary_logloss: 0.314803
[58]	valid_0's auc: 0.927447	valid_0's binary_logloss: 0.291196	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.314841
[59]	valid_0's auc: 0.927863	valid_0's binary_logloss: 0.290525	valid_1's auc: 0.909232	valid_1's binary_logloss: 0.314834
[60]	valid_0's auc: 0.928118	valid_0's binary_logloss: 0.290052	valid_1's auc: 0.909116	valid_1's binary_logloss: 0.315028
[61]	valid_0's auc: 0.928339	valid_0's binary_logloss: 0.289638	valid_1's auc: 0.909179	valid_1's binary_logloss: 0.314917
[62]	valid_0's auc: 0.928593	valid_0's binary_logloss: 0.289166	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.314986
[63]	valid_0's auc: 0.928901	valid_0's binary_logloss: 0.288682	valid_1's auc: 0.908944	valid_1's binary_logloss: 0.315209
[64]	valid_0's auc: 0.929245	valid_0's binary_logloss: 0.28806	valid_1's auc: 0.908773	valid_1's binary_logloss: 0.315468
[65]	valid_0's auc: 0.92953	valid_0's binary_logloss: 0.28757	valid_1's auc: 0.908723	valid_1's binary_logloss: 0.315524
[66]	valid_0's auc: 0.929836	valid_0's binary_logloss: 0.287042	valid_1's auc: 0.908763	valid_1's binary_logloss: 0.315509
[67]	valid_0's auc: 0.930135	valid_0's binary_logloss: 0.286531	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.315624
[68]	valid_0's auc: 0.930481	valid_0's binary_logloss: 0.285923	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.315659
[69]	valid_0's auc: 0.930765	valid_0's binary_logloss: 0.285448	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.31564
[70]	valid_0's auc: 0.931065	valid_0's binary_logloss: 0.284912	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.315784
[71]	valid_0's auc: 0.931291	valid_0's binary_logloss: 0.284481	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.315807
[72]	valid_0's auc: 0.931484	valid_0's binary_logloss: 0.284159	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.315887
[73]	valid_0's auc: 0.931726	valid_0's binary_logloss: 0.283669	valid_1's auc: 0.90851	valid_1's binary_logloss: 0.315903
[74]	valid_0's auc: 0.932125	valid_0's binary_logloss: 0.282974	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.315905
[75]	valid_0's auc: 0.932428	valid_0's binary_logloss: 0.282409	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.31589
[76]	valid_0's auc: 0.932714	valid_0's binary_logloss: 0.281881	valid_1's auc: 0.90841	valid_1's binary_logloss: 0.316028
[77]	valid_0's auc: 0.932943	valid_0's binary_logloss: 0.281395	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.316051
[78]	valid_0's auc: 0.933236	valid_0's binary_logloss: 0.280842	valid_1's auc: 0.908358	valid_1's binary_logloss: 0.316065
[79]	valid_0's auc: 0.933504	valid_0's binary_logloss: 0.280386	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.316032
[80]	valid_0's auc: 0.933789	valid_0's binary_logloss: 0.279887	valid_1's auc: 0.908329	valid_1's binary_logloss: 0.31616
[81]	valid_0's auc: 0.934074	valid_0's binary_logloss: 0.279392	valid_1's auc: 0.90824	valid_1's binary_logloss: 0.316318
[82]	valid_0's auc: 0.934475	valid_0's binary_logloss: 0.278776	valid_1's auc: 0.907988	valid_1's binary_logloss: 0.316662
[83]	valid_0's auc: 0.934643	valid_0's binary_logloss: 0.278377	valid_1's auc: 0.907947	valid_1's binary_logloss: 0.316766
[84]	valid_0's auc: 0.935033	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.316834
[85]	valid_0's auc: 0.935339	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.316819
[86]	valid_0's auc: 0.935647	valid_0's binary_logloss: 0.276578	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.316874
[87]	valid_0's auc: 0.935948	valid_0's binary_logloss: 0.276046	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.316769
[88]	valid_0's auc: 0.936226	valid_0's binary_logloss: 0.275577	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.316912
[89]	valid_0's auc: 0.936536	valid_0's binary_logloss: 0.27507	valid_1's auc: 0.907904	valid_1's binary_logloss: 0.316884
[90]	valid_0's auc: 0.936798	valid_0's binary_logloss: 0.274596	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317093
[91]	valid_0's auc: 0.937008	valid_0's binary_logloss: 0.274182	valid_1's auc: 0.907779	valid_1's binary_logloss: 0.317153
[92]	valid_0's auc: 0.937247	valid_0's binary_logloss: 0.273779	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.317298
[93]	valid_0's auc: 0.93754	valid_0's binary_logloss: 0.273258	valid_1's auc: 0.907675	valid_1's binary_logloss: 0.317343
[94]	valid_0's auc: 0.937791	valid_0's binary_logloss: 0.272782	valid_1's auc: 0.907733	valid_1's binary_logloss: 0.317316
[95]	valid_0's auc: 0.938034	valid_0's binary_logloss: 0.272319	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.317292
[96]	valid_0's auc: 0.938271	valid_0's binary_logloss: 0.271854	valid_1's auc: 0.90773	valid_1's binary_logloss: 0.317378
[97]	valid_0's auc: 0.938571	valid_0's binary_logloss: 0.271365	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.317329
[98]	valid_0's auc: 0.938902	valid_0's binary_logloss: 0.270772	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.317015
[99]	valid_0's auc: 0.939057	valid_0's binary_logloss: 0.270461	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.317001
[100]	valid_0's auc: 0.939282	valid_0's binary_logloss: 0.270065	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.317056
[101]	valid_0's auc: 0.939464	valid_0's binary_logloss: 0.26966	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.317329
[102]	valid_0's auc: 0.939653	valid_0's binary_logloss: 0.269343	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.317496
[103]	valid_0's auc: 0.939842	valid_0's binary_logloss: 0.269011	valid_1's auc: 0.907626	valid_1's binary_logloss: 0.317627
[104]	valid_0's auc: 0.94004	valid_0's binary_logloss: 0.268624	valid_1's auc: 0.907666	valid_1's binary_logloss: 0.317601
[105]	valid_0's auc: 0.940256	valid_0's binary_logloss: 0.268225	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.317696
[106]	valid_0's auc: 0.940548	valid_0's binary_logloss: 0.267708	valid_1's auc: 0.907647	valid_1's binary_logloss: 0.317633
[107]	valid_0's auc: 0.940765	valid_0's binary_logloss: 0.267305	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.317608
[108]	valid_0's auc: 0.940982	valid_0's binary_logloss: 0.266889	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317756
[109]	valid_0's auc: 0.94119	valid_0's binary_logloss: 0.266491	valid_1's auc: 0.907583	valid_1's binary_logloss: 0.317823
[110]	valid_0's auc: 0.941413	valid_0's binary_logloss: 0.266082	valid_1's auc: 0.90756	valid_1's binary_logloss: 0.317867
[111]	valid_0's auc: 0.941553	valid_0's binary_logloss: 0.265822	valid_1's auc: 0.90756	valid_1's binary_logloss: 0.317877
[112]	valid_0's auc: 0.941791	valid_0's binary_logloss: 0.265416	valid_1's auc: 0.907567	valid_1's binary_logloss: 0.317896
[113]	valid_0's auc: 0.941943	valid_0's binary_logloss: 0.265093	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317969
[114]	valid_0's auc: 0.942174	valid_0's binary_logloss: 0.264669	valid_1's auc: 0.90751	valid_1's binary_logloss: 0.318083
[115]	valid_0's auc: 0.942316	valid_0's binary_logloss: 0.264399	valid_1's auc: 0.907497	valid_1's binary_logloss: 0.318134
[116]	valid_0's auc: 0.942492	valid_0's binary_logloss: 0.264052	valid_1's auc: 0.907444	valid_1's binary_logloss: 0.318205
[117]	valid_0's auc: 0.942663	valid_0's binary_logloss: 0.2637	valid_1's auc: 0.90745	valid_1's binary_logloss: 0.318214
[118]	valid_0's auc: 0.942891	valid_0's binary_logloss: 0.263308	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.3183
[119]	valid_0's auc: 0.943086	valid_0's binary_logloss: 0.262949	valid_1's auc: 0.907409	valid_1's binary_logloss: 0.318284
[120]	valid_0's auc: 0.943308	valid_0's binary_logloss: 0.262541	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.318262
[121]	valid_0's auc: 0.943457	valid_0's binary_logloss: 0.262217	valid_1's auc: 0.907396	valid_1's binary_logloss: 0.318417
[122]	valid_0's auc: 0.943611	valid_0's binary_logloss: 0.261921	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.31846
[123]	valid_0's auc: 0.943818	valid_0's binary_logloss: 0.261558	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318468
[124]	valid_0's auc: 0.944111	valid_0's binary_logloss: 0.261062	valid_1's auc: 0.907386	valid_1's binary_logloss: 0.318455
[125]	valid_0's auc: 0.944236	valid_0's binary_logloss: 0.26077	valid_1's auc: 0.907281	valid_1's binary_logloss: 0.318719
[126]	valid_0's auc: 0.944379	valid_0's binary_logloss: 0.260453	valid_1's auc: 0.907227	valid_1's binary_logloss: 0.318839
[127]	valid_0's auc: 0.944544	valid_0's binary_logloss: 0.260075	valid_1's auc: 0.90716	valid_1's binary_logloss: 0.318955
[128]	valid_0's auc: 0.944774	valid_0's binary_logloss: 0.25963	valid_1's auc: 0.907052	valid_1's binary_logloss: 0.319164
[129]	valid_0's auc: 0.944911	valid_0's binary_logloss: 0.259355	valid_1's auc: 0.906971	valid_1's binary_logloss: 0.319325
[130]	valid_0's auc: 0.945108	valid_0's binary_logloss: 0.258953	valid_1's auc: 0.906841	valid_1's binary_logloss: 0.319601
[131]	valid_0's auc: 0.945258	valid_0's binary_logloss: 0.25867	valid_1's auc: 0.906801	valid_1's binary_logloss: 0.319688
[132]	valid_0's auc: 0.945446	valid_0's binary_logloss: 0.258318	valid_1's auc: 0.906762	valid_1's binary_logloss: 0.319781
[133]	valid_0's auc: 0.945699	valid_0's binary_logloss: 0.257864	valid_1's auc: 0.906818	valid_1's binary_logloss: 0.319698
[134]	valid_0's auc: 0.945975	valid_0's binary_logloss: 0.257359	valid_1's auc: 0.906692	valid_1's binary_logloss: 0.319899
[135]	valid_0's auc: 0.946145	valid_0's binary_logloss: 0.257045	valid_1's auc: 0.9067	valid_1's binary_logloss: 0.319919
[136]	valid_0's auc: 0.94628	valid_0's binary_logloss: 0.256771	valid_1's auc: 0.906535	valid_1's binary_logloss: 0.320198
[137]	valid_0's auc: 0.94641	valid_0's binary_logloss: 0.256444	valid_1's auc: 0.906571	valid_1's binary_logloss: 0.320166
[138]	valid_0's auc: 0.946543	valid_0's binary_logloss: 0.256174	valid_1's auc: 0.906514	valid_1's binary_logloss: 0.320288
[139]	valid_0's auc: 0.946642	valid_0's binary_logloss: 0.25599	valid_1's auc: 0.906455	valid_1's binary_logloss: 0.320412
[140]	valid_0's auc: 0.946828	valid_0's binary_logloss: 0.255669	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320413
[141]	valid_0's auc: 0.946928	valid_0's binary_logloss: 0.255444	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.3205
[142]	valid_0's auc: 0.947042	valid_0's binary_logloss: 0.255206	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.320529
[143]	valid_0's auc: 0.947164	valid_0's binary_logloss: 0.254923	valid_1's auc: 0.906416	valid_1's binary_logloss: 0.320549
[144]	valid_0's auc: 0.947268	valid_0's binary_logloss: 0.254669	valid_1's auc: 0.906445	valid_1's binary_logloss: 0.320565
[145]	valid_0's auc: 0.947509	valid_0's binary_logloss: 0.254222	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.320627
[146]	valid_0's auc: 0.947605	valid_0's binary_logloss: 0.254007	valid_1's auc: 0.906355	valid_1's binary_logloss: 0.320733
[147]	valid_0's auc: 0.94773	valid_0's binary_logloss: 0.25373	valid_1's auc: 0.90634	valid_1's binary_logloss: 0.320766
[148]	valid_0's auc: 0.947901	valid_0's binary_logloss: 0.253409	valid_1's auc: 0.90626	valid_1's binary_logloss: 0.320963
[149]	valid_0's auc: 0.948078	valid_0's binary_logloss: 0.253064	valid_1's auc: 0.906183	valid_1's binary_logloss: 0.321127
Early stopping, best iteration is:
[49]	valid_0's auc: 0.924661	valid_0's binary_logloss: 0.296542	valid_1's auc: 0.909755	valid_1's binary_logloss: 0.314616
[1]	valid_0's auc: 0.888162	valid_0's binary_logloss: 0.517463	valid_1's auc: 0.894517	valid_1's binary_logloss: 0.508366
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891775	valid_0's binary_logloss: 0.488624	valid_1's auc: 0.896817	valid_1's binary_logloss: 0.47901
[3]	valid_0's auc: 0.89565	valid_0's binary_logloss: 0.465045	valid_1's auc: 0.899721	valid_1's binary_logloss: 0.4552
[4]	valid_0's auc: 0.896702	valid_0's binary_logloss: 0.445723	valid_1's auc: 0.900399	valid_1's binary_logloss: 0.436017
[5]	valid_0's auc: 0.898238	valid_0's binary_logloss: 0.429424	valid_1's auc: 0.901062	valid_1's binary_logloss: 0.419756
[6]	valid_0's auc: 0.899111	valid_0's binary_logloss: 0.415791	valid_1's auc: 0.901759	valid_1's binary_logloss: 0.406127
[7]	valid_0's auc: 0.899871	valid_0's binary_logloss: 0.404216	valid_1's auc: 0.90188	valid_1's binary_logloss: 0.394702
[8]	valid_0's auc: 0.900845	valid_0's binary_logloss: 0.39409	valid_1's auc: 0.90346	valid_1's binary_logloss: 0.384765
[9]	valid_0's auc: 0.901696	valid_0's binary_logloss: 0.385334	valid_1's auc: 0.903827	valid_1's binary_logloss: 0.376385
[10]	valid_0's auc: 0.902434	valid_0's binary_logloss: 0.37758	valid_1's auc: 0.903959	valid_1's binary_logloss: 0.369052
[11]	valid_0's auc: 0.902902	valid_0's binary_logloss: 0.370971	valid_1's auc: 0.903836	valid_1's binary_logloss: 0.362978
[12]	valid_0's auc: 0.903909	valid_0's binary_logloss: 0.36487	valid_1's auc: 0.904482	valid_1's binary_logloss: 0.357409
[13]	valid_0's auc: 0.904882	valid_0's binary_logloss: 0.359514	valid_1's auc: 0.905256	valid_1's binary_logloss: 0.352658
[14]	valid_0's auc: 0.90553	valid_0's binary_logloss: 0.354805	valid_1's auc: 0.905299	valid_1's binary_logloss: 0.348578
[15]	valid_0's auc: 0.906178	valid_0's binary_logloss: 0.35052	valid_1's auc: 0.905473	valid_1's binary_logloss: 0.344935
[16]	valid_0's auc: 0.906821	valid_0's binary_logloss: 0.346738	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.341641
[17]	valid_0's auc: 0.907218	valid_0's binary_logloss: 0.343324	valid_1's auc: 0.905981	valid_1's binary_logloss: 0.338602
[18]	valid_0's auc: 0.907824	valid_0's binary_logloss: 0.340224	valid_1's auc: 0.906424	valid_1's binary_logloss: 0.335775
[19]	valid_0's auc: 0.908712	valid_0's binary_logloss: 0.337156	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.333646
[20]	valid_0's auc: 0.909527	valid_0's binary_logloss: 0.334344	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.3317
[21]	valid_0's auc: 0.910443	valid_0's binary_logloss: 0.331731	valid_1's auc: 0.906939	valid_1's binary_logloss: 0.330161
[22]	valid_0's auc: 0.910947	valid_0's binary_logloss: 0.329448	valid_1's auc: 0.907265	valid_1's binary_logloss: 0.328201
[23]	valid_0's auc: 0.911697	valid_0's binary_logloss: 0.327086	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.326356
[24]	valid_0's auc: 0.912328	valid_0's binary_logloss: 0.32508	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.325342
[25]	valid_0's auc: 0.912926	valid_0's binary_logloss: 0.323227	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.324101
[26]	valid_0's auc: 0.913607	valid_0's binary_logloss: 0.321347	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.322949
[27]	valid_0's auc: 0.91415	valid_0's binary_logloss: 0.31972	valid_1's auc: 0.908277	valid_1's binary_logloss: 0.321966
[28]	valid_0's auc: 0.914784	valid_0's binary_logloss: 0.318077	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.32121
[29]	valid_0's auc: 0.915309	valid_0's binary_logloss: 0.31659	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.32068
[30]	valid_0's auc: 0.915713	valid_0's binary_logloss: 0.315286	valid_1's auc: 0.908241	valid_1's binary_logloss: 0.320096
[31]	valid_0's auc: 0.916226	valid_0's binary_logloss: 0.313975	valid_1's auc: 0.908428	valid_1's binary_logloss: 0.319403
[32]	valid_0's auc: 0.916673	valid_0's binary_logloss: 0.312816	valid_1's auc: 0.908384	valid_1's binary_logloss: 0.318979
[33]	valid_0's auc: 0.917163	valid_0's binary_logloss: 0.311675	valid_1's auc: 0.908571	valid_1's binary_logloss: 0.318438
[34]	valid_0's auc: 0.917665	valid_0's binary_logloss: 0.310498	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.317976
[35]	valid_0's auc: 0.918171	valid_0's binary_logloss: 0.309348	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.31745
[36]	valid_0's auc: 0.91863	valid_0's binary_logloss: 0.308417	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.317311
[37]	valid_0's auc: 0.919111	valid_0's binary_logloss: 0.307321	valid_1's auc: 0.908748	valid_1's binary_logloss: 0.317071
[38]	valid_0's auc: 0.91946	valid_0's binary_logloss: 0.306449	valid_1's auc: 0.908845	valid_1's binary_logloss: 0.316672
[39]	valid_0's auc: 0.919842	valid_0's binary_logloss: 0.305636	valid_1's auc: 0.908983	valid_1's binary_logloss: 0.316353
[40]	valid_0's auc: 0.920294	valid_0's binary_logloss: 0.304729	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31599
[41]	valid_0's auc: 0.920811	valid_0's binary_logloss: 0.303773	valid_1's auc: 0.90906	valid_1's binary_logloss: 0.315911
[42]	valid_0's auc: 0.921343	valid_0's binary_logloss: 0.302763	valid_1's auc: 0.90908	valid_1's binary_logloss: 0.315786
[43]	valid_0's auc: 0.921758	valid_0's binary_logloss: 0.301888	valid_1's auc: 0.909049	valid_1's binary_logloss: 0.315709
[44]	valid_0's auc: 0.92204	valid_0's binary_logloss: 0.301183	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315745
[45]	valid_0's auc: 0.922419	valid_0's binary_logloss: 0.300435	valid_1's auc: 0.908877	valid_1's binary_logloss: 0.315749
[46]	valid_0's auc: 0.922865	valid_0's binary_logloss: 0.29962	valid_1's auc: 0.908874	valid_1's binary_logloss: 0.31561
[47]	valid_0's auc: 0.923193	valid_0's binary_logloss: 0.298963	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.315383
[48]	valid_0's auc: 0.923597	valid_0's binary_logloss: 0.298199	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315339
[49]	valid_0's auc: 0.923913	valid_0's binary_logloss: 0.297567	valid_1's auc: 0.908893	valid_1's binary_logloss: 0.31527
[50]	valid_0's auc: 0.924356	valid_0's binary_logloss: 0.2968	valid_1's auc: 0.9089	valid_1's binary_logloss: 0.315207
[51]	valid_0's auc: 0.924734	valid_0's binary_logloss: 0.296127	valid_1's auc: 0.908953	valid_1's binary_logloss: 0.315072
[52]	valid_0's auc: 0.925154	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.908955	valid_1's binary_logloss: 0.31503
[53]	valid_0's auc: 0.925516	valid_0's binary_logloss: 0.294784	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.315061
[54]	valid_0's auc: 0.92585	valid_0's binary_logloss: 0.294194	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315076
[55]	valid_0's auc: 0.926177	valid_0's binary_logloss: 0.293527	valid_1's auc: 0.908784	valid_1's binary_logloss: 0.315121
[56]	valid_0's auc: 0.926598	valid_0's binary_logloss: 0.292814	valid_1's auc: 0.908609	valid_1's binary_logloss: 0.315329
[57]	valid_0's auc: 0.926908	valid_0's binary_logloss: 0.292244	valid_1's auc: 0.908552	valid_1's binary_logloss: 0.315385
[58]	valid_0's auc: 0.92718	valid_0's binary_logloss: 0.29169	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.315558
[59]	valid_0's auc: 0.9275	valid_0's binary_logloss: 0.291146	valid_1's auc: 0.908317	valid_1's binary_logloss: 0.315749
[60]	valid_0's auc: 0.927861	valid_0's binary_logloss: 0.290496	valid_1's auc: 0.908327	valid_1's binary_logloss: 0.315769
[61]	valid_0's auc: 0.928184	valid_0's binary_logloss: 0.289871	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.315546
[62]	valid_0's auc: 0.928472	valid_0's binary_logloss: 0.289368	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.315713
[63]	valid_0's auc: 0.928792	valid_0's binary_logloss: 0.288778	valid_1's auc: 0.908433	valid_1's binary_logloss: 0.315492
[64]	valid_0's auc: 0.92907	valid_0's binary_logloss: 0.288238	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.315636
[65]	valid_0's auc: 0.929315	valid_0's binary_logloss: 0.287762	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.315684
[66]	valid_0's auc: 0.929495	valid_0's binary_logloss: 0.287413	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.315607
[67]	valid_0's auc: 0.929788	valid_0's binary_logloss: 0.286874	valid_1's auc: 0.90837	valid_1's binary_logloss: 0.315623
[68]	valid_0's auc: 0.929989	valid_0's binary_logloss: 0.28647	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.315785
[69]	valid_0's auc: 0.930058	valid_0's binary_logloss: 0.286302	valid_1's auc: 0.908199	valid_1's binary_logloss: 0.315851
[70]	valid_0's auc: 0.930309	valid_0's binary_logloss: 0.285833	valid_1's auc: 0.908131	valid_1's binary_logloss: 0.315997
[71]	valid_0's auc: 0.930538	valid_0's binary_logloss: 0.285429	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.315946
[72]	valid_0's auc: 0.930969	valid_0's binary_logloss: 0.284737	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.316218
[73]	valid_0's auc: 0.931303	valid_0's binary_logloss: 0.284157	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.316337
[74]	valid_0's auc: 0.931561	valid_0's binary_logloss: 0.283726	valid_1's auc: 0.90766	valid_1's binary_logloss: 0.31665
[75]	valid_0's auc: 0.931854	valid_0's binary_logloss: 0.283125	valid_1's auc: 0.907645	valid_1's binary_logloss: 0.316665
[76]	valid_0's auc: 0.93219	valid_0's binary_logloss: 0.28254	valid_1's auc: 0.907645	valid_1's binary_logloss: 0.316688
[77]	valid_0's auc: 0.932539	valid_0's binary_logloss: 0.281959	valid_1's auc: 0.907628	valid_1's binary_logloss: 0.316669
[78]	valid_0's auc: 0.932688	valid_0's binary_logloss: 0.281681	valid_1's auc: 0.907598	valid_1's binary_logloss: 0.316786
[79]	valid_0's auc: 0.932987	valid_0's binary_logloss: 0.281165	valid_1's auc: 0.907392	valid_1's binary_logloss: 0.317074
[80]	valid_0's auc: 0.933283	valid_0's binary_logloss: 0.280667	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.317125
[81]	valid_0's auc: 0.93356	valid_0's binary_logloss: 0.280124	valid_1's auc: 0.907407	valid_1's binary_logloss: 0.317118
[82]	valid_0's auc: 0.933729	valid_0's binary_logloss: 0.27981	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.317157
[83]	valid_0's auc: 0.933951	valid_0's binary_logloss: 0.279427	valid_1's auc: 0.907249	valid_1's binary_logloss: 0.317349
[84]	valid_0's auc: 0.93428	valid_0's binary_logloss: 0.278817	valid_1's auc: 0.907211	valid_1's binary_logloss: 0.317478
[85]	valid_0's auc: 0.934535	valid_0's binary_logloss: 0.278351	valid_1's auc: 0.907194	valid_1's binary_logloss: 0.317518
[86]	valid_0's auc: 0.934766	valid_0's binary_logloss: 0.277917	valid_1's auc: 0.907124	valid_1's binary_logloss: 0.317617
[87]	valid_0's auc: 0.934904	valid_0's binary_logloss: 0.277594	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.317597
[88]	valid_0's auc: 0.935191	valid_0's binary_logloss: 0.277146	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.317702
[89]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.276714	valid_1's auc: 0.907046	valid_1's binary_logloss: 0.31778
[90]	valid_0's auc: 0.935691	valid_0's binary_logloss: 0.276288	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.317811
[91]	valid_0's auc: 0.935993	valid_0's binary_logloss: 0.275785	valid_1's auc: 0.906841	valid_1's binary_logloss: 0.318086
[92]	valid_0's auc: 0.93631	valid_0's binary_logloss: 0.275191	valid_1's auc: 0.906823	valid_1's binary_logloss: 0.318185
[93]	valid_0's auc: 0.936559	valid_0's binary_logloss: 0.27475	valid_1's auc: 0.906683	valid_1's binary_logloss: 0.318432
[94]	valid_0's auc: 0.9368	valid_0's binary_logloss: 0.274249	valid_1's auc: 0.906465	valid_1's binary_logloss: 0.318792
[95]	valid_0's auc: 0.937079	valid_0's binary_logloss: 0.273763	valid_1's auc: 0.906326	valid_1's binary_logloss: 0.319
[96]	valid_0's auc: 0.937303	valid_0's binary_logloss: 0.273353	valid_1's auc: 0.906221	valid_1's binary_logloss: 0.319194
[97]	valid_0's auc: 0.937559	valid_0's binary_logloss: 0.27293	valid_1's auc: 0.906232	valid_1's binary_logloss: 0.319209
[98]	valid_0's auc: 0.937754	valid_0's binary_logloss: 0.272493	valid_1's auc: 0.906164	valid_1's binary_logloss: 0.319334
[99]	valid_0's auc: 0.93791	valid_0's binary_logloss: 0.2722	valid_1's auc: 0.90605	valid_1's binary_logloss: 0.319501
[100]	valid_0's auc: 0.938159	valid_0's binary_logloss: 0.271784	valid_1's auc: 0.905986	valid_1's binary_logloss: 0.319579
[101]	valid_0's auc: 0.93834	valid_0's binary_logloss: 0.271467	valid_1's auc: 0.905871	valid_1's binary_logloss: 0.319773
[102]	valid_0's auc: 0.938551	valid_0's binary_logloss: 0.271091	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.319711
[103]	valid_0's auc: 0.938745	valid_0's binary_logloss: 0.270727	valid_1's auc: 0.905752	valid_1's binary_logloss: 0.319973
[104]	valid_0's auc: 0.938965	valid_0's binary_logloss: 0.270314	valid_1's auc: 0.905744	valid_1's binary_logloss: 0.320034
[105]	valid_0's auc: 0.939123	valid_0's binary_logloss: 0.269968	valid_1's auc: 0.905603	valid_1's binary_logloss: 0.320261
[106]	valid_0's auc: 0.939273	valid_0's binary_logloss: 0.269706	valid_1's auc: 0.905568	valid_1's binary_logloss: 0.320337
[107]	valid_0's auc: 0.939492	valid_0's binary_logloss: 0.269319	valid_1's auc: 0.905518	valid_1's binary_logloss: 0.320434
[108]	valid_0's auc: 0.939671	valid_0's binary_logloss: 0.269021	valid_1's auc: 0.905511	valid_1's binary_logloss: 0.320428
[109]	valid_0's auc: 0.939813	valid_0's binary_logloss: 0.268694	valid_1's auc: 0.905424	valid_1's binary_logloss: 0.320587
[110]	valid_0's auc: 0.940145	valid_0's binary_logloss: 0.268135	valid_1's auc: 0.905397	valid_1's binary_logloss: 0.320657
[111]	valid_0's auc: 0.940341	valid_0's binary_logloss: 0.26777	valid_1's auc: 0.905378	valid_1's binary_logloss: 0.320705
[112]	valid_0's auc: 0.940525	valid_0's binary_logloss: 0.267399	valid_1's auc: 0.905252	valid_1's binary_logloss: 0.320937
[113]	valid_0's auc: 0.940659	valid_0's binary_logloss: 0.267129	valid_1's auc: 0.905158	valid_1's binary_logloss: 0.321088
[114]	valid_0's auc: 0.940891	valid_0's binary_logloss: 0.266714	valid_1's auc: 0.905079	valid_1's binary_logloss: 0.321191
[115]	valid_0's auc: 0.941086	valid_0's binary_logloss: 0.266363	valid_1's auc: 0.90508	valid_1's binary_logloss: 0.321189
[116]	valid_0's auc: 0.941246	valid_0's binary_logloss: 0.266046	valid_1's auc: 0.904924	valid_1's binary_logloss: 0.321468
[117]	valid_0's auc: 0.941569	valid_0's binary_logloss: 0.265525	valid_1's auc: 0.90486	valid_1's binary_logloss: 0.321575
[118]	valid_0's auc: 0.941695	valid_0's binary_logloss: 0.265262	valid_1's auc: 0.904891	valid_1's binary_logloss: 0.321602
[119]	valid_0's auc: 0.941889	valid_0's binary_logloss: 0.264936	valid_1's auc: 0.904803	valid_1's binary_logloss: 0.321722
[120]	valid_0's auc: 0.942127	valid_0's binary_logloss: 0.264532	valid_1's auc: 0.904714	valid_1's binary_logloss: 0.321947
[121]	valid_0's auc: 0.942304	valid_0's binary_logloss: 0.264224	valid_1's auc: 0.904662	valid_1's binary_logloss: 0.322021
[122]	valid_0's auc: 0.942435	valid_0's binary_logloss: 0.26397	valid_1's auc: 0.904669	valid_1's binary_logloss: 0.322066
[123]	valid_0's auc: 0.942591	valid_0's binary_logloss: 0.26366	valid_1's auc: 0.9046	valid_1's binary_logloss: 0.322223
[124]	valid_0's auc: 0.942812	valid_0's binary_logloss: 0.263272	valid_1's auc: 0.90453	valid_1's binary_logloss: 0.32237
[125]	valid_0's auc: 0.943025	valid_0's binary_logloss: 0.26288	valid_1's auc: 0.904411	valid_1's binary_logloss: 0.322594
[126]	valid_0's auc: 0.943194	valid_0's binary_logloss: 0.262559	valid_1's auc: 0.904302	valid_1's binary_logloss: 0.322759
[127]	valid_0's auc: 0.943377	valid_0's binary_logloss: 0.262223	valid_1's auc: 0.904272	valid_1's binary_logloss: 0.322846
[128]	valid_0's auc: 0.943747	valid_0's binary_logloss: 0.261606	valid_1's auc: 0.904199	valid_1's binary_logloss: 0.322905
[129]	valid_0's auc: 0.943913	valid_0's binary_logloss: 0.261221	valid_1's auc: 0.90421	valid_1's binary_logloss: 0.323003
[130]	valid_0's auc: 0.944064	valid_0's binary_logloss: 0.260922	valid_1's auc: 0.904146	valid_1's binary_logloss: 0.323093
[131]	valid_0's auc: 0.944343	valid_0's binary_logloss: 0.260427	valid_1's auc: 0.904101	valid_1's binary_logloss: 0.323208
[132]	valid_0's auc: 0.944496	valid_0's binary_logloss: 0.26012	valid_1's auc: 0.903994	valid_1's binary_logloss: 0.323423
[133]	valid_0's auc: 0.944643	valid_0's binary_logloss: 0.25981	valid_1's auc: 0.903951	valid_1's binary_logloss: 0.323561
[134]	valid_0's auc: 0.944837	valid_0's binary_logloss: 0.259465	valid_1's auc: 0.903836	valid_1's binary_logloss: 0.323733
[135]	valid_0's auc: 0.945052	valid_0's binary_logloss: 0.259053	valid_1's auc: 0.903808	valid_1's binary_logloss: 0.323841
[136]	valid_0's auc: 0.945228	valid_0's binary_logloss: 0.258684	valid_1's auc: 0.903737	valid_1's binary_logloss: 0.324009
[137]	valid_0's auc: 0.945447	valid_0's binary_logloss: 0.258263	valid_1's auc: 0.903763	valid_1's binary_logloss: 0.324027
[138]	valid_0's auc: 0.945594	valid_0's binary_logloss: 0.25797	valid_1's auc: 0.903762	valid_1's binary_logloss: 0.324043
[139]	valid_0's auc: 0.945758	valid_0's binary_logloss: 0.257637	valid_1's auc: 0.903648	valid_1's binary_logloss: 0.324276
[140]	valid_0's auc: 0.946053	valid_0's binary_logloss: 0.257145	valid_1's auc: 0.90363	valid_1's binary_logloss: 0.324344
Early stopping, best iteration is:
[40]	valid_0's auc: 0.920294	valid_0's binary_logloss: 0.304729	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31599
[1]	valid_0's auc: 0.88811	valid_0's binary_logloss: 0.516701	valid_1's auc: 0.895814	valid_1's binary_logloss: 0.507528
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891491	valid_0's binary_logloss: 0.487539	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.477417
[3]	valid_0's auc: 0.893109	valid_0's binary_logloss: 0.464326	valid_1's auc: 0.901507	valid_1's binary_logloss: 0.453478
[4]	valid_0's auc: 0.894791	valid_0's binary_logloss: 0.444982	valid_1's auc: 0.901224	valid_1's binary_logloss: 0.434583
[5]	valid_0's auc: 0.895624	valid_0's binary_logloss: 0.428966	valid_1's auc: 0.901056	valid_1's binary_logloss: 0.418654
[6]	valid_0's auc: 0.896944	valid_0's binary_logloss: 0.415161	valid_1's auc: 0.902052	valid_1's binary_logloss: 0.405135
[7]	valid_0's auc: 0.89758	valid_0's binary_logloss: 0.403513	valid_1's auc: 0.901691	valid_1's binary_logloss: 0.394009
[8]	valid_0's auc: 0.90015	valid_0's binary_logloss: 0.393394	valid_1's auc: 0.903784	valid_1's binary_logloss: 0.383993
[9]	valid_0's auc: 0.901255	valid_0's binary_logloss: 0.384675	valid_1's auc: 0.904091	valid_1's binary_logloss: 0.375696
[10]	valid_0's auc: 0.902629	valid_0's binary_logloss: 0.376904	valid_1's auc: 0.904387	valid_1's binary_logloss: 0.368673
[11]	valid_0's auc: 0.903701	valid_0's binary_logloss: 0.369943	valid_1's auc: 0.904709	valid_1's binary_logloss: 0.36236
[12]	valid_0's auc: 0.904339	valid_0's binary_logloss: 0.363963	valid_1's auc: 0.904816	valid_1's binary_logloss: 0.357033
[13]	valid_0's auc: 0.905081	valid_0's binary_logloss: 0.35849	valid_1's auc: 0.905014	valid_1's binary_logloss: 0.352166
[14]	valid_0's auc: 0.905811	valid_0's binary_logloss: 0.353858	valid_1's auc: 0.905424	valid_1's binary_logloss: 0.347997
[15]	valid_0's auc: 0.906466	valid_0's binary_logloss: 0.349608	valid_1's auc: 0.905498	valid_1's binary_logloss: 0.344373
[16]	valid_0's auc: 0.907398	valid_0's binary_logloss: 0.345736	valid_1's auc: 0.905873	valid_1's binary_logloss: 0.341236
[17]	valid_0's auc: 0.908186	valid_0's binary_logloss: 0.342228	valid_1's auc: 0.906329	valid_1's binary_logloss: 0.338301
[18]	valid_0's auc: 0.90925	valid_0's binary_logloss: 0.338743	valid_1's auc: 0.906826	valid_1's binary_logloss: 0.335503
[19]	valid_0's auc: 0.9102	valid_0's binary_logloss: 0.335607	valid_1's auc: 0.907031	valid_1's binary_logloss: 0.333281
[20]	valid_0's auc: 0.910757	valid_0's binary_logloss: 0.332976	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.331059
[21]	valid_0's auc: 0.911478	valid_0's binary_logloss: 0.330345	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.329002
[22]	valid_0's auc: 0.912097	valid_0's binary_logloss: 0.328103	valid_1's auc: 0.907709	valid_1's binary_logloss: 0.327752
[23]	valid_0's auc: 0.912771	valid_0's binary_logloss: 0.325821	valid_1's auc: 0.907903	valid_1's binary_logloss: 0.326202
[24]	valid_0's auc: 0.913361	valid_0's binary_logloss: 0.323845	valid_1's auc: 0.908218	valid_1's binary_logloss: 0.324854
[25]	valid_0's auc: 0.913946	valid_0's binary_logloss: 0.321961	valid_1's auc: 0.90831	valid_1's binary_logloss: 0.323874
[26]	valid_0's auc: 0.91455	valid_0's binary_logloss: 0.320134	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.323006
[27]	valid_0's auc: 0.915219	valid_0's binary_logloss: 0.31836	valid_1's auc: 0.908516	valid_1's binary_logloss: 0.32199
[28]	valid_0's auc: 0.915726	valid_0's binary_logloss: 0.316889	valid_1's auc: 0.908564	valid_1's binary_logloss: 0.321327
[29]	valid_0's auc: 0.91619	valid_0's binary_logloss: 0.315516	valid_1's auc: 0.90867	valid_1's binary_logloss: 0.320607
[30]	valid_0's auc: 0.916569	valid_0's binary_logloss: 0.314309	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.320117
[31]	valid_0's auc: 0.917126	valid_0's binary_logloss: 0.312888	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.319493
[32]	valid_0's auc: 0.91757	valid_0's binary_logloss: 0.311679	valid_1's auc: 0.908779	valid_1's binary_logloss: 0.318951
[33]	valid_0's auc: 0.917964	valid_0's binary_logloss: 0.310557	valid_1's auc: 0.908819	valid_1's binary_logloss: 0.318463
[34]	valid_0's auc: 0.918382	valid_0's binary_logloss: 0.309535	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.318127
[35]	valid_0's auc: 0.918733	valid_0's binary_logloss: 0.308551	valid_1's auc: 0.908792	valid_1's binary_logloss: 0.317897
[36]	valid_0's auc: 0.919112	valid_0's binary_logloss: 0.307602	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.317699
[37]	valid_0's auc: 0.919463	valid_0's binary_logloss: 0.306776	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.317513
[38]	valid_0's auc: 0.919828	valid_0's binary_logloss: 0.305866	valid_1's auc: 0.908665	valid_1's binary_logloss: 0.317308
[39]	valid_0's auc: 0.920308	valid_0's binary_logloss: 0.304893	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.317152
[40]	valid_0's auc: 0.920795	valid_0's binary_logloss: 0.303863	valid_1's auc: 0.908721	valid_1's binary_logloss: 0.316854
[41]	valid_0's auc: 0.921115	valid_0's binary_logloss: 0.303161	valid_1's auc: 0.908923	valid_1's binary_logloss: 0.316414
[42]	valid_0's auc: 0.921626	valid_0's binary_logloss: 0.30218	valid_1's auc: 0.909034	valid_1's binary_logloss: 0.316124
[43]	valid_0's auc: 0.921967	valid_0's binary_logloss: 0.301384	valid_1's auc: 0.90906	valid_1's binary_logloss: 0.315972
[44]	valid_0's auc: 0.922381	valid_0's binary_logloss: 0.300544	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.315775
[45]	valid_0's auc: 0.922724	valid_0's binary_logloss: 0.299847	valid_1's auc: 0.909255	valid_1's binary_logloss: 0.31551
[46]	valid_0's auc: 0.923109	valid_0's binary_logloss: 0.299055	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.315314
[47]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.298118	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314961
[48]	valid_0's auc: 0.923891	valid_0's binary_logloss: 0.297555	valid_1's auc: 0.909524	valid_1's binary_logloss: 0.3149
[49]	valid_0's auc: 0.924244	valid_0's binary_logloss: 0.296844	valid_1's auc: 0.909481	valid_1's binary_logloss: 0.314913
[50]	valid_0's auc: 0.924564	valid_0's binary_logloss: 0.296173	valid_1's auc: 0.909383	valid_1's binary_logloss: 0.315025
[51]	valid_0's auc: 0.924961	valid_0's binary_logloss: 0.295467	valid_1's auc: 0.909383	valid_1's binary_logloss: 0.314976
[52]	valid_0's auc: 0.925195	valid_0's binary_logloss: 0.294975	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.314991
[53]	valid_0's auc: 0.925647	valid_0's binary_logloss: 0.294161	valid_1's auc: 0.90934	valid_1's binary_logloss: 0.314888
[54]	valid_0's auc: 0.925997	valid_0's binary_logloss: 0.2935	valid_1's auc: 0.909236	valid_1's binary_logloss: 0.315024
[55]	valid_0's auc: 0.926277	valid_0's binary_logloss: 0.2929	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.314992
[56]	valid_0's auc: 0.926582	valid_0's binary_logloss: 0.292287	valid_1's auc: 0.909223	valid_1's binary_logloss: 0.315062
[57]	valid_0's auc: 0.92688	valid_0's binary_logloss: 0.29172	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.315032
[58]	valid_0's auc: 0.927334	valid_0's binary_logloss: 0.291011	valid_1's auc: 0.909121	valid_1's binary_logloss: 0.315143
[59]	valid_0's auc: 0.927683	valid_0's binary_logloss: 0.290395	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.315113
[60]	valid_0's auc: 0.928065	valid_0's binary_logloss: 0.289762	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.315009
[61]	valid_0's auc: 0.928429	valid_0's binary_logloss: 0.289104	valid_1's auc: 0.909258	valid_1's binary_logloss: 0.314842
[62]	valid_0's auc: 0.92862	valid_0's binary_logloss: 0.288702	valid_1's auc: 0.909183	valid_1's binary_logloss: 0.314959
[63]	valid_0's auc: 0.928868	valid_0's binary_logloss: 0.288211	valid_1's auc: 0.909076	valid_1's binary_logloss: 0.315194
[64]	valid_0's auc: 0.929161	valid_0's binary_logloss: 0.287692	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.315242
[65]	valid_0's auc: 0.929563	valid_0's binary_logloss: 0.287013	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.315388
[66]	valid_0's auc: 0.929823	valid_0's binary_logloss: 0.286561	valid_1's auc: 0.908968	valid_1's binary_logloss: 0.315378
[67]	valid_0's auc: 0.930093	valid_0's binary_logloss: 0.286061	valid_1's auc: 0.909037	valid_1's binary_logloss: 0.315321
[68]	valid_0's auc: 0.93035	valid_0's binary_logloss: 0.285546	valid_1's auc: 0.908945	valid_1's binary_logloss: 0.31545
[69]	valid_0's auc: 0.930726	valid_0's binary_logloss: 0.284913	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.315504
[70]	valid_0's auc: 0.930968	valid_0's binary_logloss: 0.28453	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315647
[71]	valid_0's auc: 0.93134	valid_0's binary_logloss: 0.283869	valid_1's auc: 0.908706	valid_1's binary_logloss: 0.315753
[72]	valid_0's auc: 0.93172	valid_0's binary_logloss: 0.283214	valid_1's auc: 0.908642	valid_1's binary_logloss: 0.315869
[73]	valid_0's auc: 0.932009	valid_0's binary_logloss: 0.282652	valid_1's auc: 0.908566	valid_1's binary_logloss: 0.315999
[74]	valid_0's auc: 0.932201	valid_0's binary_logloss: 0.282262	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.31589
[75]	valid_0's auc: 0.932428	valid_0's binary_logloss: 0.281839	valid_1's auc: 0.908487	valid_1's binary_logloss: 0.31607
[76]	valid_0's auc: 0.932791	valid_0's binary_logloss: 0.281226	valid_1's auc: 0.908356	valid_1's binary_logloss: 0.316221
[77]	valid_0's auc: 0.933059	valid_0's binary_logloss: 0.2807	valid_1's auc: 0.908286	valid_1's binary_logloss: 0.316308
[78]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.280385	valid_1's auc: 0.908333	valid_1's binary_logloss: 0.316177
[79]	valid_0's auc: 0.933516	valid_0's binary_logloss: 0.279893	valid_1's auc: 0.908365	valid_1's binary_logloss: 0.316135
[80]	valid_0's auc: 0.933729	valid_0's binary_logloss: 0.27946	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.315971
[81]	valid_0's auc: 0.933952	valid_0's binary_logloss: 0.279028	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.316027
[82]	valid_0's auc: 0.934221	valid_0's binary_logloss: 0.278529	valid_1's auc: 0.908367	valid_1's binary_logloss: 0.316183
[83]	valid_0's auc: 0.934457	valid_0's binary_logloss: 0.278106	valid_1's auc: 0.908348	valid_1's binary_logloss: 0.316245
[84]	valid_0's auc: 0.934695	valid_0's binary_logloss: 0.277675	valid_1's auc: 0.908334	valid_1's binary_logloss: 0.316322
[85]	valid_0's auc: 0.934988	valid_0's binary_logloss: 0.277153	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.31623
[86]	valid_0's auc: 0.935259	valid_0's binary_logloss: 0.276612	valid_1's auc: 0.908249	valid_1's binary_logloss: 0.316403
[87]	valid_0's auc: 0.935495	valid_0's binary_logloss: 0.276187	valid_1's auc: 0.908153	valid_1's binary_logloss: 0.316596
[88]	valid_0's auc: 0.9357	valid_0's binary_logloss: 0.275835	valid_1's auc: 0.908143	valid_1's binary_logloss: 0.316609
[89]	valid_0's auc: 0.935983	valid_0's binary_logloss: 0.27537	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.316608
[90]	valid_0's auc: 0.936187	valid_0's binary_logloss: 0.275004	valid_1's auc: 0.908099	valid_1's binary_logloss: 0.316766
[91]	valid_0's auc: 0.936418	valid_0's binary_logloss: 0.274592	valid_1's auc: 0.908081	valid_1's binary_logloss: 0.31684
[92]	valid_0's auc: 0.936681	valid_0's binary_logloss: 0.274166	valid_1's auc: 0.908078	valid_1's binary_logloss: 0.316839
[93]	valid_0's auc: 0.936846	valid_0's binary_logloss: 0.27383	valid_1's auc: 0.908067	valid_1's binary_logloss: 0.316875
[94]	valid_0's auc: 0.937079	valid_0's binary_logloss: 0.273405	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.316867
[95]	valid_0's auc: 0.937314	valid_0's binary_logloss: 0.273007	valid_1's auc: 0.908061	valid_1's binary_logloss: 0.316877
[96]	valid_0's auc: 0.937517	valid_0's binary_logloss: 0.272584	valid_1's auc: 0.908022	valid_1's binary_logloss: 0.316916
[97]	valid_0's auc: 0.937702	valid_0's binary_logloss: 0.272251	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.317073
[98]	valid_0's auc: 0.937961	valid_0's binary_logloss: 0.271826	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317144
[99]	valid_0's auc: 0.938178	valid_0's binary_logloss: 0.271404	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317241
[100]	valid_0's auc: 0.938427	valid_0's binary_logloss: 0.270949	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.317206
[101]	valid_0's auc: 0.938591	valid_0's binary_logloss: 0.270614	valid_1's auc: 0.907846	valid_1's binary_logloss: 0.31732
[102]	valid_0's auc: 0.938838	valid_0's binary_logloss: 0.270184	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317444
[103]	valid_0's auc: 0.938987	valid_0's binary_logloss: 0.269885	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.31752
[104]	valid_0's auc: 0.939178	valid_0's binary_logloss: 0.269525	valid_1's auc: 0.907699	valid_1's binary_logloss: 0.317614
[105]	valid_0's auc: 0.939406	valid_0's binary_logloss: 0.269026	valid_1's auc: 0.907646	valid_1's binary_logloss: 0.317768
[106]	valid_0's auc: 0.939667	valid_0's binary_logloss: 0.268561	valid_1's auc: 0.907539	valid_1's binary_logloss: 0.318006
[107]	valid_0's auc: 0.939889	valid_0's binary_logloss: 0.268161	valid_1's auc: 0.907603	valid_1's binary_logloss: 0.317868
[108]	valid_0's auc: 0.940077	valid_0's binary_logloss: 0.267819	valid_1's auc: 0.907488	valid_1's binary_logloss: 0.31808
[109]	valid_0's auc: 0.940431	valid_0's binary_logloss: 0.267208	valid_1's auc: 0.907364	valid_1's binary_logloss: 0.318348
[110]	valid_0's auc: 0.940604	valid_0's binary_logloss: 0.266871	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318394
[111]	valid_0's auc: 0.940869	valid_0's binary_logloss: 0.266387	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.318384
[112]	valid_0's auc: 0.941066	valid_0's binary_logloss: 0.266009	valid_1's auc: 0.907229	valid_1's binary_logloss: 0.318669
[113]	valid_0's auc: 0.941253	valid_0's binary_logloss: 0.265676	valid_1's auc: 0.907266	valid_1's binary_logloss: 0.318566
[114]	valid_0's auc: 0.941558	valid_0's binary_logloss: 0.265141	valid_1's auc: 0.907168	valid_1's binary_logloss: 0.318755
[115]	valid_0's auc: 0.941744	valid_0's binary_logloss: 0.264763	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.31875
[116]	valid_0's auc: 0.941938	valid_0's binary_logloss: 0.264427	valid_1's auc: 0.907147	valid_1's binary_logloss: 0.318857
[117]	valid_0's auc: 0.942219	valid_0's binary_logloss: 0.263954	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.31905
[118]	valid_0's auc: 0.942452	valid_0's binary_logloss: 0.263544	valid_1's auc: 0.907074	valid_1's binary_logloss: 0.319091
[119]	valid_0's auc: 0.942624	valid_0's binary_logloss: 0.26321	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.319072
[120]	valid_0's auc: 0.942816	valid_0's binary_logloss: 0.262845	valid_1's auc: 0.907134	valid_1's binary_logloss: 0.318947
[121]	valid_0's auc: 0.943014	valid_0's binary_logloss: 0.26249	valid_1's auc: 0.907025	valid_1's binary_logloss: 0.319165
[122]	valid_0's auc: 0.943171	valid_0's binary_logloss: 0.262168	valid_1's auc: 0.906988	valid_1's binary_logloss: 0.319254
[123]	valid_0's auc: 0.943442	valid_0's binary_logloss: 0.261681	valid_1's auc: 0.90697	valid_1's binary_logloss: 0.319257
[124]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261195	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.319146
[125]	valid_0's auc: 0.943889	valid_0's binary_logloss: 0.260818	valid_1's auc: 0.90698	valid_1's binary_logloss: 0.319304
[126]	valid_0's auc: 0.944043	valid_0's binary_logloss: 0.260521	valid_1's auc: 0.906853	valid_1's binary_logloss: 0.319539
[127]	valid_0's auc: 0.944193	valid_0's binary_logloss: 0.260216	valid_1's auc: 0.906814	valid_1's binary_logloss: 0.319673
[128]	valid_0's auc: 0.944309	valid_0's binary_logloss: 0.259954	valid_1's auc: 0.906718	valid_1's binary_logloss: 0.319883
[129]	valid_0's auc: 0.94455	valid_0's binary_logloss: 0.259526	valid_1's auc: 0.906642	valid_1's binary_logloss: 0.320084
[130]	valid_0's auc: 0.944753	valid_0's binary_logloss: 0.259168	valid_1's auc: 0.906523	valid_1's binary_logloss: 0.320297
[131]	valid_0's auc: 0.944973	valid_0's binary_logloss: 0.258766	valid_1's auc: 0.906307	valid_1's binary_logloss: 0.320604
[132]	valid_0's auc: 0.945145	valid_0's binary_logloss: 0.258424	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.320798
[133]	valid_0's auc: 0.945318	valid_0's binary_logloss: 0.258071	valid_1's auc: 0.9061	valid_1's binary_logloss: 0.320996
[134]	valid_0's auc: 0.945451	valid_0's binary_logloss: 0.257783	valid_1's auc: 0.906152	valid_1's binary_logloss: 0.320968
[135]	valid_0's auc: 0.945733	valid_0's binary_logloss: 0.257292	valid_1's auc: 0.90607	valid_1's binary_logloss: 0.321139
[136]	valid_0's auc: 0.945855	valid_0's binary_logloss: 0.257031	valid_1's auc: 0.906069	valid_1's binary_logloss: 0.321141
[137]	valid_0's auc: 0.946126	valid_0's binary_logloss: 0.256557	valid_1's auc: 0.906074	valid_1's binary_logloss: 0.321185
[138]	valid_0's auc: 0.946246	valid_0's binary_logloss: 0.256295	valid_1's auc: 0.906142	valid_1's binary_logloss: 0.321141
[139]	valid_0's auc: 0.946394	valid_0's binary_logloss: 0.256023	valid_1's auc: 0.906082	valid_1's binary_logloss: 0.321251
[140]	valid_0's auc: 0.946547	valid_0's binary_logloss: 0.255736	valid_1's auc: 0.905991	valid_1's binary_logloss: 0.321412
[141]	valid_0's auc: 0.946643	valid_0's binary_logloss: 0.255552	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321492
[142]	valid_0's auc: 0.946765	valid_0's binary_logloss: 0.255317	valid_1's auc: 0.905916	valid_1's binary_logloss: 0.321635
[143]	valid_0's auc: 0.946949	valid_0's binary_logloss: 0.254972	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.321442
[144]	valid_0's auc: 0.947192	valid_0's binary_logloss: 0.254554	valid_1's auc: 0.905936	valid_1's binary_logloss: 0.321675
[145]	valid_0's auc: 0.947377	valid_0's binary_logloss: 0.254218	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.321929
[146]	valid_0's auc: 0.947597	valid_0's binary_logloss: 0.253808	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.321868
[147]	valid_0's auc: 0.947805	valid_0's binary_logloss: 0.253426	valid_1's auc: 0.905835	valid_1's binary_logloss: 0.321933
Early stopping, best iteration is:
[47]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.298118	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314961
[1]	valid_0's auc: 0.887844	valid_0's binary_logloss: 0.516909	valid_1's auc: 0.893598	valid_1's binary_logloss: 0.508126
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890776	valid_0's binary_logloss: 0.487736	valid_1's auc: 0.897625	valid_1's binary_logloss: 0.478463
[3]	valid_0's auc: 0.892243	valid_0's binary_logloss: 0.46442	valid_1's auc: 0.8988	valid_1's binary_logloss: 0.454774
[4]	valid_0's auc: 0.894428	valid_0's binary_logloss: 0.444999	valid_1's auc: 0.899598	valid_1's binary_logloss: 0.435309
[5]	valid_0's auc: 0.895593	valid_0's binary_logloss: 0.428839	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419556
[6]	valid_0's auc: 0.899007	valid_0's binary_logloss: 0.415152	valid_1's auc: 0.902729	valid_1's binary_logloss: 0.40594
[7]	valid_0's auc: 0.900436	valid_0's binary_logloss: 0.403446	valid_1's auc: 0.903024	valid_1's binary_logloss: 0.394665
[8]	valid_0's auc: 0.901051	valid_0's binary_logloss: 0.393489	valid_1's auc: 0.902967	valid_1's binary_logloss: 0.384948
[9]	valid_0's auc: 0.901858	valid_0's binary_logloss: 0.384773	valid_1's auc: 0.903102	valid_1's binary_logloss: 0.376834
[10]	valid_0's auc: 0.903132	valid_0's binary_logloss: 0.376975	valid_1's auc: 0.903628	valid_1's binary_logloss: 0.369655
[11]	valid_0's auc: 0.904	valid_0's binary_logloss: 0.370072	valid_1's auc: 0.903765	valid_1's binary_logloss: 0.363506
[12]	valid_0's auc: 0.905057	valid_0's binary_logloss: 0.364037	valid_1's auc: 0.904378	valid_1's binary_logloss: 0.358122
[13]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.35866	valid_1's auc: 0.904218	valid_1's binary_logloss: 0.353501
[14]	valid_0's auc: 0.906631	valid_0's binary_logloss: 0.353842	valid_1's auc: 0.904667	valid_1's binary_logloss: 0.349238
[15]	valid_0's auc: 0.907502	valid_0's binary_logloss: 0.349434	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.345342
[16]	valid_0's auc: 0.90815	valid_0's binary_logloss: 0.345598	valid_1's auc: 0.905737	valid_1's binary_logloss: 0.342243
[17]	valid_0's auc: 0.908763	valid_0's binary_logloss: 0.342075	valid_1's auc: 0.906229	valid_1's binary_logloss: 0.338999
[18]	valid_0's auc: 0.909472	valid_0's binary_logloss: 0.33895	valid_1's auc: 0.906632	valid_1's binary_logloss: 0.3364
[19]	valid_0's auc: 0.910184	valid_0's binary_logloss: 0.33601	valid_1's auc: 0.90668	valid_1's binary_logloss: 0.334514
[20]	valid_0's auc: 0.910866	valid_0's binary_logloss: 0.333221	valid_1's auc: 0.906811	valid_1's binary_logloss: 0.332442
[21]	valid_0's auc: 0.911311	valid_0's binary_logloss: 0.330891	valid_1's auc: 0.906728	valid_1's binary_logloss: 0.330824
[22]	valid_0's auc: 0.912013	valid_0's binary_logloss: 0.328569	valid_1's auc: 0.906759	valid_1's binary_logloss: 0.32944
[23]	valid_0's auc: 0.912723	valid_0's binary_logloss: 0.326299	valid_1's auc: 0.907021	valid_1's binary_logloss: 0.328001
[24]	valid_0's auc: 0.913276	valid_0's binary_logloss: 0.324362	valid_1's auc: 0.907054	valid_1's binary_logloss: 0.326907
[25]	valid_0's auc: 0.913833	valid_0's binary_logloss: 0.322553	valid_1's auc: 0.907087	valid_1's binary_logloss: 0.325903
[26]	valid_0's auc: 0.914514	valid_0's binary_logloss: 0.320627	valid_1's auc: 0.907221	valid_1's binary_logloss: 0.324823
[27]	valid_0's auc: 0.915013	valid_0's binary_logloss: 0.318967	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.324008
[28]	valid_0's auc: 0.915582	valid_0's binary_logloss: 0.317412	valid_1's auc: 0.907248	valid_1's binary_logloss: 0.323309
[29]	valid_0's auc: 0.916129	valid_0's binary_logloss: 0.315921	valid_1's auc: 0.907335	valid_1's binary_logloss: 0.322681
[30]	valid_0's auc: 0.916649	valid_0's binary_logloss: 0.314505	valid_1's auc: 0.907438	valid_1's binary_logloss: 0.321974
[31]	valid_0's auc: 0.917204	valid_0's binary_logloss: 0.313113	valid_1's auc: 0.907455	valid_1's binary_logloss: 0.321466
[32]	valid_0's auc: 0.917806	valid_0's binary_logloss: 0.311733	valid_1's auc: 0.907527	valid_1's binary_logloss: 0.320952
[33]	valid_0's auc: 0.918199	valid_0's binary_logloss: 0.310677	valid_1's auc: 0.90752	valid_1's binary_logloss: 0.320625
[34]	valid_0's auc: 0.918605	valid_0's binary_logloss: 0.309584	valid_1's auc: 0.907562	valid_1's binary_logloss: 0.320235
[35]	valid_0's auc: 0.919112	valid_0's binary_logloss: 0.308438	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.319694
[36]	valid_0's auc: 0.919618	valid_0's binary_logloss: 0.307289	valid_1's auc: 0.907846	valid_1's binary_logloss: 0.319321
[37]	valid_0's auc: 0.920128	valid_0's binary_logloss: 0.306185	valid_1's auc: 0.907789	valid_1's binary_logloss: 0.31915
[38]	valid_0's auc: 0.920495	valid_0's binary_logloss: 0.305296	valid_1's auc: 0.907682	valid_1's binary_logloss: 0.319109
[39]	valid_0's auc: 0.920946	valid_0's binary_logloss: 0.304239	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.318808
[40]	valid_0's auc: 0.921364	valid_0's binary_logloss: 0.303311	valid_1's auc: 0.907691	valid_1's binary_logloss: 0.318693
[41]	valid_0's auc: 0.921773	valid_0's binary_logloss: 0.302446	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.318445
[42]	valid_0's auc: 0.922186	valid_0's binary_logloss: 0.301579	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.318465
[43]	valid_0's auc: 0.922503	valid_0's binary_logloss: 0.300906	valid_1's auc: 0.907673	valid_1's binary_logloss: 0.318345
[44]	valid_0's auc: 0.922926	valid_0's binary_logloss: 0.300042	valid_1's auc: 0.907635	valid_1's binary_logloss: 0.318257
[45]	valid_0's auc: 0.923263	valid_0's binary_logloss: 0.299331	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.318079
[46]	valid_0's auc: 0.923617	valid_0's binary_logloss: 0.298539	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317876
[47]	valid_0's auc: 0.924114	valid_0's binary_logloss: 0.297662	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317968
[48]	valid_0's auc: 0.924503	valid_0's binary_logloss: 0.296954	valid_1's auc: 0.907788	valid_1's binary_logloss: 0.317785
[49]	valid_0's auc: 0.92476	valid_0's binary_logloss: 0.296343	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.317598
[50]	valid_0's auc: 0.925129	valid_0's binary_logloss: 0.295661	valid_1's auc: 0.907782	valid_1's binary_logloss: 0.31771
[51]	valid_0's auc: 0.925509	valid_0's binary_logloss: 0.294896	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.317825
[52]	valid_0's auc: 0.925952	valid_0's binary_logloss: 0.294104	valid_1's auc: 0.907701	valid_1's binary_logloss: 0.317753
[53]	valid_0's auc: 0.926345	valid_0's binary_logloss: 0.293368	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.317706
[54]	valid_0's auc: 0.926601	valid_0's binary_logloss: 0.292847	valid_1's auc: 0.907553	valid_1's binary_logloss: 0.317872
[55]	valid_0's auc: 0.926831	valid_0's binary_logloss: 0.292356	valid_1's auc: 0.907538	valid_1's binary_logloss: 0.317816
[56]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.291782	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.317695
[57]	valid_0's auc: 0.927485	valid_0's binary_logloss: 0.291119	valid_1's auc: 0.907529	valid_1's binary_logloss: 0.317839
[58]	valid_0's auc: 0.927817	valid_0's binary_logloss: 0.290466	valid_1's auc: 0.907475	valid_1's binary_logloss: 0.317907
[59]	valid_0's auc: 0.928079	valid_0's binary_logloss: 0.289918	valid_1's auc: 0.907395	valid_1's binary_logloss: 0.317979
[60]	valid_0's auc: 0.928363	valid_0's binary_logloss: 0.289377	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.318084
[61]	valid_0's auc: 0.928694	valid_0's binary_logloss: 0.288835	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318084
[62]	valid_0's auc: 0.928954	valid_0's binary_logloss: 0.28835	valid_1's auc: 0.907237	valid_1's binary_logloss: 0.318221
[63]	valid_0's auc: 0.929319	valid_0's binary_logloss: 0.28774	valid_1's auc: 0.907257	valid_1's binary_logloss: 0.3182
[64]	valid_0's auc: 0.929634	valid_0's binary_logloss: 0.287191	valid_1's auc: 0.907167	valid_1's binary_logloss: 0.318289
[65]	valid_0's auc: 0.929985	valid_0's binary_logloss: 0.286569	valid_1's auc: 0.90696	valid_1's binary_logloss: 0.318675
[66]	valid_0's auc: 0.930249	valid_0's binary_logloss: 0.286086	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318632
[67]	valid_0's auc: 0.930512	valid_0's binary_logloss: 0.285546	valid_1's auc: 0.906977	valid_1's binary_logloss: 0.318746
[68]	valid_0's auc: 0.931011	valid_0's binary_logloss: 0.284738	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.318823
[69]	valid_0's auc: 0.931402	valid_0's binary_logloss: 0.284061	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.318922
[70]	valid_0's auc: 0.931641	valid_0's binary_logloss: 0.283641	valid_1's auc: 0.906847	valid_1's binary_logloss: 0.319008
[71]	valid_0's auc: 0.931905	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318965
[72]	valid_0's auc: 0.932175	valid_0's binary_logloss: 0.282667	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.319064
[73]	valid_0's auc: 0.932404	valid_0's binary_logloss: 0.282207	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.319023
[74]	valid_0's auc: 0.932665	valid_0's binary_logloss: 0.281711	valid_1's auc: 0.906668	valid_1's binary_logloss: 0.319203
[75]	valid_0's auc: 0.932941	valid_0's binary_logloss: 0.281234	valid_1's auc: 0.906611	valid_1's binary_logloss: 0.319329
[76]	valid_0's auc: 0.933306	valid_0's binary_logloss: 0.280605	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.319485
[77]	valid_0's auc: 0.933602	valid_0's binary_logloss: 0.280037	valid_1's auc: 0.906549	valid_1's binary_logloss: 0.319398
[78]	valid_0's auc: 0.933963	valid_0's binary_logloss: 0.27942	valid_1's auc: 0.906464	valid_1's binary_logloss: 0.319541
[79]	valid_0's auc: 0.934249	valid_0's binary_logloss: 0.278885	valid_1's auc: 0.906414	valid_1's binary_logloss: 0.319641
[80]	valid_0's auc: 0.93456	valid_0's binary_logloss: 0.278314	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319676
[81]	valid_0's auc: 0.934874	valid_0's binary_logloss: 0.277757	valid_1's auc: 0.90656	valid_1's binary_logloss: 0.319506
[82]	valid_0's auc: 0.935088	valid_0's binary_logloss: 0.277344	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.319624
[83]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.276902	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.319607
[84]	valid_0's auc: 0.935552	valid_0's binary_logloss: 0.27647	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.31965
[85]	valid_0's auc: 0.93587	valid_0's binary_logloss: 0.275926	valid_1's auc: 0.906437	valid_1's binary_logloss: 0.319734
[86]	valid_0's auc: 0.9361	valid_0's binary_logloss: 0.275494	valid_1's auc: 0.90638	valid_1's binary_logloss: 0.319875
[87]	valid_0's auc: 0.93626	valid_0's binary_logloss: 0.27522	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.319903
[88]	valid_0's auc: 0.936677	valid_0's binary_logloss: 0.274518	valid_1's auc: 0.90637	valid_1's binary_logloss: 0.319925
[89]	valid_0's auc: 0.936916	valid_0's binary_logloss: 0.274088	valid_1's auc: 0.906279	valid_1's binary_logloss: 0.320108
[90]	valid_0's auc: 0.937196	valid_0's binary_logloss: 0.273554	valid_1's auc: 0.906132	valid_1's binary_logloss: 0.320352
[91]	valid_0's auc: 0.937367	valid_0's binary_logloss: 0.273251	valid_1's auc: 0.905999	valid_1's binary_logloss: 0.320638
[92]	valid_0's auc: 0.937682	valid_0's binary_logloss: 0.272694	valid_1's auc: 0.905844	valid_1's binary_logloss: 0.320942
[93]	valid_0's auc: 0.937867	valid_0's binary_logloss: 0.272389	valid_1's auc: 0.905784	valid_1's binary_logloss: 0.321063
[94]	valid_0's auc: 0.938098	valid_0's binary_logloss: 0.271963	valid_1's auc: 0.905736	valid_1's binary_logloss: 0.321136
[95]	valid_0's auc: 0.938341	valid_0's binary_logloss: 0.271481	valid_1's auc: 0.905709	valid_1's binary_logloss: 0.321295
[96]	valid_0's auc: 0.938606	valid_0's binary_logloss: 0.271001	valid_1's auc: 0.90563	valid_1's binary_logloss: 0.321473
[97]	valid_0's auc: 0.938826	valid_0's binary_logloss: 0.270594	valid_1's auc: 0.905659	valid_1's binary_logloss: 0.321457
[98]	valid_0's auc: 0.939042	valid_0's binary_logloss: 0.270193	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.32139
[99]	valid_0's auc: 0.939189	valid_0's binary_logloss: 0.269888	valid_1's auc: 0.905687	valid_1's binary_logloss: 0.321413
[100]	valid_0's auc: 0.939459	valid_0's binary_logloss: 0.269416	valid_1's auc: 0.9058	valid_1's binary_logloss: 0.32127
[101]	valid_0's auc: 0.939642	valid_0's binary_logloss: 0.26904	valid_1's auc: 0.905716	valid_1's binary_logloss: 0.321461
[102]	valid_0's auc: 0.939886	valid_0's binary_logloss: 0.268564	valid_1's auc: 0.905656	valid_1's binary_logloss: 0.321566
[103]	valid_0's auc: 0.940158	valid_0's binary_logloss: 0.268089	valid_1's auc: 0.905678	valid_1's binary_logloss: 0.321517
[104]	valid_0's auc: 0.940334	valid_0's binary_logloss: 0.267732	valid_1's auc: 0.905603	valid_1's binary_logloss: 0.321692
[105]	valid_0's auc: 0.940561	valid_0's binary_logloss: 0.267334	valid_1's auc: 0.90566	valid_1's binary_logloss: 0.321626
[106]	valid_0's auc: 0.940828	valid_0's binary_logloss: 0.266814	valid_1's auc: 0.90567	valid_1's binary_logloss: 0.321619
[107]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.266463	valid_1's auc: 0.905513	valid_1's binary_logloss: 0.321846
[108]	valid_0's auc: 0.941143	valid_0's binary_logloss: 0.266153	valid_1's auc: 0.905256	valid_1's binary_logloss: 0.322338
[109]	valid_0's auc: 0.94127	valid_0's binary_logloss: 0.265891	valid_1's auc: 0.905153	valid_1's binary_logloss: 0.322576
[110]	valid_0's auc: 0.941435	valid_0's binary_logloss: 0.265585	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.322452
[111]	valid_0's auc: 0.941601	valid_0's binary_logloss: 0.265193	valid_1's auc: 0.905164	valid_1's binary_logloss: 0.322605
[112]	valid_0's auc: 0.941779	valid_0's binary_logloss: 0.26484	valid_1's auc: 0.905029	valid_1's binary_logloss: 0.32288
[113]	valid_0's auc: 0.94198	valid_0's binary_logloss: 0.264483	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.322937
[114]	valid_0's auc: 0.942281	valid_0's binary_logloss: 0.263955	valid_1's auc: 0.905008	valid_1's binary_logloss: 0.322958
[115]	valid_0's auc: 0.942433	valid_0's binary_logloss: 0.263622	valid_1's auc: 0.905023	valid_1's binary_logloss: 0.323001
[116]	valid_0's auc: 0.942632	valid_0's binary_logloss: 0.263257	valid_1's auc: 0.905004	valid_1's binary_logloss: 0.323077
[117]	valid_0's auc: 0.942825	valid_0's binary_logloss: 0.262855	valid_1's auc: 0.904993	valid_1's binary_logloss: 0.32315
[118]	valid_0's auc: 0.943037	valid_0's binary_logloss: 0.26246	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.323358
[119]	valid_0's auc: 0.943208	valid_0's binary_logloss: 0.262132	valid_1's auc: 0.904813	valid_1's binary_logloss: 0.323498
[120]	valid_0's auc: 0.943496	valid_0's binary_logloss: 0.261607	valid_1's auc: 0.904807	valid_1's binary_logloss: 0.323481
[121]	valid_0's auc: 0.943662	valid_0's binary_logloss: 0.261226	valid_1's auc: 0.904762	valid_1's binary_logloss: 0.323639
[122]	valid_0's auc: 0.943751	valid_0's binary_logloss: 0.26106	valid_1's auc: 0.904718	valid_1's binary_logloss: 0.323736
[123]	valid_0's auc: 0.943916	valid_0's binary_logloss: 0.260766	valid_1's auc: 0.904588	valid_1's binary_logloss: 0.323936
[124]	valid_0's auc: 0.944155	valid_0's binary_logloss: 0.260319	valid_1's auc: 0.904505	valid_1's binary_logloss: 0.324082
[125]	valid_0's auc: 0.944335	valid_0's binary_logloss: 0.259945	valid_1's auc: 0.904535	valid_1's binary_logloss: 0.324092
[126]	valid_0's auc: 0.944549	valid_0's binary_logloss: 0.259565	valid_1's auc: 0.90448	valid_1's binary_logloss: 0.324222
[127]	valid_0's auc: 0.944763	valid_0's binary_logloss: 0.259165	valid_1's auc: 0.904411	valid_1's binary_logloss: 0.324372
[128]	valid_0's auc: 0.944934	valid_0's binary_logloss: 0.258837	valid_1's auc: 0.90435	valid_1's binary_logloss: 0.32452
[129]	valid_0's auc: 0.945078	valid_0's binary_logloss: 0.258524	valid_1's auc: 0.904248	valid_1's binary_logloss: 0.324813
[130]	valid_0's auc: 0.945396	valid_0's binary_logloss: 0.257954	valid_1's auc: 0.9041	valid_1's binary_logloss: 0.325105
[131]	valid_0's auc: 0.945566	valid_0's binary_logloss: 0.257624	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.325193
[132]	valid_0's auc: 0.945728	valid_0's binary_logloss: 0.257317	valid_1's auc: 0.903912	valid_1's binary_logloss: 0.325447
[133]	valid_0's auc: 0.94593	valid_0's binary_logloss: 0.256915	valid_1's auc: 0.903953	valid_1's binary_logloss: 0.325429
[134]	valid_0's auc: 0.946124	valid_0's binary_logloss: 0.256548	valid_1's auc: 0.903922	valid_1's binary_logloss: 0.325547
[135]	valid_0's auc: 0.946272	valid_0's binary_logloss: 0.256207	valid_1's auc: 0.903917	valid_1's binary_logloss: 0.325616
[136]	valid_0's auc: 0.946445	valid_0's binary_logloss: 0.25588	valid_1's auc: 0.903982	valid_1's binary_logloss: 0.325544
[137]	valid_0's auc: 0.94666	valid_0's binary_logloss: 0.255467	valid_1's auc: 0.903978	valid_1's binary_logloss: 0.325586
[138]	valid_0's auc: 0.946805	valid_0's binary_logloss: 0.25516	valid_1's auc: 0.904015	valid_1's binary_logloss: 0.325594
[139]	valid_0's auc: 0.946965	valid_0's binary_logloss: 0.254797	valid_1's auc: 0.90404	valid_1's binary_logloss: 0.325611
[140]	valid_0's auc: 0.947155	valid_0's binary_logloss: 0.254442	valid_1's auc: 0.904027	valid_1's binary_logloss: 0.325582
[141]	valid_0's auc: 0.947297	valid_0's binary_logloss: 0.254153	valid_1's auc: 0.904033	valid_1's binary_logloss: 0.325561
[142]	valid_0's auc: 0.947408	valid_0's binary_logloss: 0.253916	valid_1's auc: 0.904004	valid_1's binary_logloss: 0.325657
[143]	valid_0's auc: 0.947562	valid_0's binary_logloss: 0.253625	valid_1's auc: 0.903785	valid_1's binary_logloss: 0.326068
[144]	valid_0's auc: 0.94773	valid_0's binary_logloss: 0.25331	valid_1's auc: 0.903871	valid_1's binary_logloss: 0.325958
[145]	valid_0's auc: 0.947867	valid_0's binary_logloss: 0.253029	valid_1's auc: 0.903845	valid_1's binary_logloss: 0.325999
[146]	valid_0's auc: 0.948114	valid_0's binary_logloss: 0.252568	valid_1's auc: 0.90366	valid_1's binary_logloss: 0.326302
[147]	valid_0's auc: 0.948248	valid_0's binary_logloss: 0.252289	valid_1's auc: 0.903538	valid_1's binary_logloss: 0.326518
[148]	valid_0's auc: 0.948389	valid_0's binary_logloss: 0.251996	valid_1's auc: 0.903572	valid_1's binary_logloss: 0.326488
[149]	valid_0's auc: 0.94867	valid_0's binary_logloss: 0.251478	valid_1's auc: 0.903554	valid_1's binary_logloss: 0.326562
Early stopping, best iteration is:
[49]	valid_0's auc: 0.92476	valid_0's binary_logloss: 0.296343	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.317598
[1]	valid_0's auc: 0.888393	valid_0's binary_logloss: 0.516795	valid_1's auc: 0.894288	valid_1's binary_logloss: 0.508216
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891394	valid_0's binary_logloss: 0.487867	valid_1's auc: 0.896915	valid_1's binary_logloss: 0.478643
[3]	valid_0's auc: 0.89265	valid_0's binary_logloss: 0.464849	valid_1's auc: 0.89812	valid_1's binary_logloss: 0.455163
[4]	valid_0's auc: 0.894437	valid_0's binary_logloss: 0.445621	valid_1's auc: 0.899483	valid_1's binary_logloss: 0.436039
[5]	valid_0's auc: 0.896955	valid_0's binary_logloss: 0.429571	valid_1's auc: 0.901051	valid_1's binary_logloss: 0.420482
[6]	valid_0's auc: 0.898332	valid_0's binary_logloss: 0.415928	valid_1's auc: 0.901613	valid_1's binary_logloss: 0.406859
[7]	valid_0's auc: 0.899861	valid_0's binary_logloss: 0.404206	valid_1's auc: 0.902556	valid_1's binary_logloss: 0.395336
[8]	valid_0's auc: 0.900488	valid_0's binary_logloss: 0.394139	valid_1's auc: 0.90247	valid_1's binary_logloss: 0.385733
[9]	valid_0's auc: 0.901452	valid_0's binary_logloss: 0.385418	valid_1's auc: 0.903433	valid_1's binary_logloss: 0.377078
[10]	valid_0's auc: 0.902105	valid_0's binary_logloss: 0.377963	valid_1's auc: 0.903624	valid_1's binary_logloss: 0.370046
[11]	valid_0's auc: 0.902945	valid_0's binary_logloss: 0.371098	valid_1's auc: 0.904239	valid_1's binary_logloss: 0.363529
[12]	valid_0's auc: 0.903515	valid_0's binary_logloss: 0.365223	valid_1's auc: 0.904537	valid_1's binary_logloss: 0.358078
[13]	valid_0's auc: 0.904605	valid_0's binary_logloss: 0.35982	valid_1's auc: 0.904887	valid_1's binary_logloss: 0.353394
[14]	valid_0's auc: 0.905644	valid_0's binary_logloss: 0.354895	valid_1's auc: 0.90514	valid_1's binary_logloss: 0.349229
[15]	valid_0's auc: 0.906416	valid_0's binary_logloss: 0.35056	valid_1's auc: 0.905629	valid_1's binary_logloss: 0.345341
[16]	valid_0's auc: 0.906936	valid_0's binary_logloss: 0.346773	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.341963
[17]	valid_0's auc: 0.907718	valid_0's binary_logloss: 0.343116	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.338764
[18]	valid_0's auc: 0.908265	valid_0's binary_logloss: 0.33999	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.336028
[19]	valid_0's auc: 0.909204	valid_0's binary_logloss: 0.336866	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.333716
[20]	valid_0's auc: 0.909879	valid_0's binary_logloss: 0.334199	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.331886
[21]	valid_0's auc: 0.91049	valid_0's binary_logloss: 0.331733	valid_1's auc: 0.906944	valid_1's binary_logloss: 0.330278
[22]	valid_0's auc: 0.911221	valid_0's binary_logloss: 0.329417	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.328685
[23]	valid_0's auc: 0.91199	valid_0's binary_logloss: 0.327145	valid_1's auc: 0.907289	valid_1's binary_logloss: 0.32728
[24]	valid_0's auc: 0.912599	valid_0's binary_logloss: 0.325046	valid_1's auc: 0.907322	valid_1's binary_logloss: 0.326084
[25]	valid_0's auc: 0.913126	valid_0's binary_logloss: 0.323271	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.325168
[26]	valid_0's auc: 0.913635	valid_0's binary_logloss: 0.321568	valid_1's auc: 0.907363	valid_1's binary_logloss: 0.324235
[27]	valid_0's auc: 0.914109	valid_0's binary_logloss: 0.319968	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.323425
[28]	valid_0's auc: 0.914755	valid_0's binary_logloss: 0.318217	valid_1's auc: 0.907439	valid_1's binary_logloss: 0.322682
[29]	valid_0's auc: 0.91531	valid_0's binary_logloss: 0.316651	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.322161
[30]	valid_0's auc: 0.915799	valid_0's binary_logloss: 0.315432	valid_1's auc: 0.907579	valid_1's binary_logloss: 0.32147
[31]	valid_0's auc: 0.916265	valid_0's binary_logloss: 0.314172	valid_1's auc: 0.907614	valid_1's binary_logloss: 0.321033
[32]	valid_0's auc: 0.916621	valid_0's binary_logloss: 0.313109	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.320231
[33]	valid_0's auc: 0.917134	valid_0's binary_logloss: 0.311835	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.319894
[34]	valid_0's auc: 0.917421	valid_0's binary_logloss: 0.310915	valid_1's auc: 0.90805	valid_1's binary_logloss: 0.319356
[35]	valid_0's auc: 0.917912	valid_0's binary_logloss: 0.309739	valid_1's auc: 0.907945	valid_1's binary_logloss: 0.319148
[36]	valid_0's auc: 0.918368	valid_0's binary_logloss: 0.308658	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.318764
[37]	valid_0's auc: 0.918869	valid_0's binary_logloss: 0.307508	valid_1's auc: 0.908228	valid_1's binary_logloss: 0.318273
[38]	valid_0's auc: 0.919281	valid_0's binary_logloss: 0.306443	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.317879
[39]	valid_0's auc: 0.919868	valid_0's binary_logloss: 0.305344	valid_1's auc: 0.90828	valid_1's binary_logloss: 0.317828
[40]	valid_0's auc: 0.920222	valid_0's binary_logloss: 0.30452	valid_1's auc: 0.908383	valid_1's binary_logloss: 0.317532
[41]	valid_0's auc: 0.92061	valid_0's binary_logloss: 0.303651	valid_1's auc: 0.908374	valid_1's binary_logloss: 0.317365
[42]	valid_0's auc: 0.920924	valid_0's binary_logloss: 0.302944	valid_1's auc: 0.908391	valid_1's binary_logloss: 0.317127
[43]	valid_0's auc: 0.921362	valid_0's binary_logloss: 0.302061	valid_1's auc: 0.908455	valid_1's binary_logloss: 0.316929
[44]	valid_0's auc: 0.921796	valid_0's binary_logloss: 0.301145	valid_1's auc: 0.908605	valid_1's binary_logloss: 0.316586
[45]	valid_0's auc: 0.922275	valid_0's binary_logloss: 0.300213	valid_1's auc: 0.90866	valid_1's binary_logloss: 0.316503
[46]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.299581	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.316401
[47]	valid_0's auc: 0.923	valid_0's binary_logloss: 0.298806	valid_1's auc: 0.908634	valid_1's binary_logloss: 0.316502
[48]	valid_0's auc: 0.923402	valid_0's binary_logloss: 0.298057	valid_1's auc: 0.908615	valid_1's binary_logloss: 0.316498
[49]	valid_0's auc: 0.923728	valid_0's binary_logloss: 0.297433	valid_1's auc: 0.908437	valid_1's binary_logloss: 0.316696
[50]	valid_0's auc: 0.924155	valid_0's binary_logloss: 0.296703	valid_1's auc: 0.908504	valid_1's binary_logloss: 0.316532
[51]	valid_0's auc: 0.924552	valid_0's binary_logloss: 0.295918	valid_1's auc: 0.9085	valid_1's binary_logloss: 0.316456
[52]	valid_0's auc: 0.92501	valid_0's binary_logloss: 0.295165	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.316549
[53]	valid_0's auc: 0.925514	valid_0's binary_logloss: 0.294276	valid_1's auc: 0.908323	valid_1's binary_logloss: 0.316731
[54]	valid_0's auc: 0.92582	valid_0's binary_logloss: 0.293742	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316571
[55]	valid_0's auc: 0.926104	valid_0's binary_logloss: 0.29319	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.316514
[56]	valid_0's auc: 0.926502	valid_0's binary_logloss: 0.292466	valid_1's auc: 0.90838	valid_1's binary_logloss: 0.316596
[57]	valid_0's auc: 0.926723	valid_0's binary_logloss: 0.292045	valid_1's auc: 0.908338	valid_1's binary_logloss: 0.316655
[58]	valid_0's auc: 0.927048	valid_0's binary_logloss: 0.291402	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316719
[59]	valid_0's auc: 0.927413	valid_0's binary_logloss: 0.290762	valid_1's auc: 0.908226	valid_1's binary_logloss: 0.316828
[60]	valid_0's auc: 0.927752	valid_0's binary_logloss: 0.290182	valid_1's auc: 0.9083	valid_1's binary_logloss: 0.316679
[61]	valid_0's auc: 0.927996	valid_0's binary_logloss: 0.289754	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.316671
[62]	valid_0's auc: 0.928274	valid_0's binary_logloss: 0.28928	valid_1's auc: 0.908147	valid_1's binary_logloss: 0.316879
[63]	valid_0's auc: 0.928585	valid_0's binary_logloss: 0.288738	valid_1's auc: 0.908083	valid_1's binary_logloss: 0.317009
[64]	valid_0's auc: 0.928981	valid_0's binary_logloss: 0.28808	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.317155
[65]	valid_0's auc: 0.929281	valid_0's binary_logloss: 0.287522	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.317222
[66]	valid_0's auc: 0.92959	valid_0's binary_logloss: 0.286971	valid_1's auc: 0.907884	valid_1's binary_logloss: 0.317358
[67]	valid_0's auc: 0.929809	valid_0's binary_logloss: 0.286564	valid_1's auc: 0.907889	valid_1's binary_logloss: 0.317357
[68]	valid_0's auc: 0.930079	valid_0's binary_logloss: 0.286062	valid_1's auc: 0.907909	valid_1's binary_logloss: 0.31736
[69]	valid_0's auc: 0.930368	valid_0's binary_logloss: 0.28555	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317541
[70]	valid_0's auc: 0.930619	valid_0's binary_logloss: 0.285058	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317716
[71]	valid_0's auc: 0.930926	valid_0's binary_logloss: 0.284522	valid_1's auc: 0.907659	valid_1's binary_logloss: 0.317847
[72]	valid_0's auc: 0.931329	valid_0's binary_logloss: 0.283894	valid_1's auc: 0.907585	valid_1's binary_logloss: 0.317922
[73]	valid_0's auc: 0.931737	valid_0's binary_logloss: 0.283213	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.318054
[74]	valid_0's auc: 0.931865	valid_0's binary_logloss: 0.282959	valid_1's auc: 0.907416	valid_1's binary_logloss: 0.318242
[75]	valid_0's auc: 0.932046	valid_0's binary_logloss: 0.282589	valid_1's auc: 0.907288	valid_1's binary_logloss: 0.318441
[76]	valid_0's auc: 0.93233	valid_0's binary_logloss: 0.282117	valid_1's auc: 0.907243	valid_1's binary_logloss: 0.3185
[77]	valid_0's auc: 0.932649	valid_0's binary_logloss: 0.28155	valid_1's auc: 0.907118	valid_1's binary_logloss: 0.318655
[78]	valid_0's auc: 0.93293	valid_0's binary_logloss: 0.281041	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.318661
[79]	valid_0's auc: 0.93325	valid_0's binary_logloss: 0.280472	valid_1's auc: 0.907075	valid_1's binary_logloss: 0.318711
[80]	valid_0's auc: 0.933532	valid_0's binary_logloss: 0.280004	valid_1's auc: 0.90702	valid_1's binary_logloss: 0.318809
[81]	valid_0's auc: 0.933806	valid_0's binary_logloss: 0.279547	valid_1's auc: 0.90701	valid_1's binary_logloss: 0.318773
[82]	valid_0's auc: 0.934014	valid_0's binary_logloss: 0.279207	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318856
[83]	valid_0's auc: 0.934285	valid_0's binary_logloss: 0.278727	valid_1's auc: 0.9069	valid_1's binary_logloss: 0.319037
[84]	valid_0's auc: 0.934518	valid_0's binary_logloss: 0.278255	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.319305
[85]	valid_0's auc: 0.934673	valid_0's binary_logloss: 0.277969	valid_1's auc: 0.906769	valid_1's binary_logloss: 0.319276
[86]	valid_0's auc: 0.934888	valid_0's binary_logloss: 0.277615	valid_1's auc: 0.906717	valid_1's binary_logloss: 0.319368
[87]	valid_0's auc: 0.93509	valid_0's binary_logloss: 0.277233	valid_1's auc: 0.906617	valid_1's binary_logloss: 0.31952
[88]	valid_0's auc: 0.935378	valid_0's binary_logloss: 0.276709	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.319544
[89]	valid_0's auc: 0.935603	valid_0's binary_logloss: 0.276289	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319654
[90]	valid_0's auc: 0.935846	valid_0's binary_logloss: 0.275848	valid_1's auc: 0.906561	valid_1's binary_logloss: 0.319663
[91]	valid_0's auc: 0.936049	valid_0's binary_logloss: 0.275501	valid_1's auc: 0.906564	valid_1's binary_logloss: 0.319692
[92]	valid_0's auc: 0.936214	valid_0's binary_logloss: 0.275136	valid_1's auc: 0.906474	valid_1's binary_logloss: 0.319905
[93]	valid_0's auc: 0.936466	valid_0's binary_logloss: 0.274675	valid_1's auc: 0.906375	valid_1's binary_logloss: 0.320121
[94]	valid_0's auc: 0.936738	valid_0's binary_logloss: 0.274212	valid_1's auc: 0.906126	valid_1's binary_logloss: 0.320521
[95]	valid_0's auc: 0.936944	valid_0's binary_logloss: 0.273795	valid_1's auc: 0.906076	valid_1's binary_logloss: 0.320623
[96]	valid_0's auc: 0.93718	valid_0's binary_logloss: 0.27342	valid_1's auc: 0.90608	valid_1's binary_logloss: 0.320639
[97]	valid_0's auc: 0.937323	valid_0's binary_logloss: 0.273127	valid_1's auc: 0.905945	valid_1's binary_logloss: 0.320824
[98]	valid_0's auc: 0.937497	valid_0's binary_logloss: 0.272818	valid_1's auc: 0.905826	valid_1's binary_logloss: 0.321023
[99]	valid_0's auc: 0.937737	valid_0's binary_logloss: 0.272366	valid_1's auc: 0.905725	valid_1's binary_logloss: 0.321271
[100]	valid_0's auc: 0.937973	valid_0's binary_logloss: 0.27195	valid_1's auc: 0.905683	valid_1's binary_logloss: 0.321386
[101]	valid_0's auc: 0.938215	valid_0's binary_logloss: 0.271548	valid_1's auc: 0.905702	valid_1's binary_logloss: 0.321408
[102]	valid_0's auc: 0.938352	valid_0's binary_logloss: 0.271275	valid_1's auc: 0.905756	valid_1's binary_logloss: 0.321341
[103]	valid_0's auc: 0.938645	valid_0's binary_logloss: 0.270795	valid_1's auc: 0.905616	valid_1's binary_logloss: 0.32156
[104]	valid_0's auc: 0.938829	valid_0's binary_logloss: 0.270479	valid_1's auc: 0.905538	valid_1's binary_logloss: 0.321701
[105]	valid_0's auc: 0.939028	valid_0's binary_logloss: 0.27014	valid_1's auc: 0.905469	valid_1's binary_logloss: 0.321868
[106]	valid_0's auc: 0.939251	valid_0's binary_logloss: 0.269737	valid_1's auc: 0.905436	valid_1's binary_logloss: 0.3219
[107]	valid_0's auc: 0.939482	valid_0's binary_logloss: 0.269284	valid_1's auc: 0.905301	valid_1's binary_logloss: 0.322221
[108]	valid_0's auc: 0.939672	valid_0's binary_logloss: 0.268912	valid_1's auc: 0.905222	valid_1's binary_logloss: 0.322372
[109]	valid_0's auc: 0.939943	valid_0's binary_logloss: 0.26847	valid_1's auc: 0.905232	valid_1's binary_logloss: 0.322354
[110]	valid_0's auc: 0.940057	valid_0's binary_logloss: 0.268254	valid_1's auc: 0.905155	valid_1's binary_logloss: 0.322521
[111]	valid_0's auc: 0.940309	valid_0's binary_logloss: 0.267818	valid_1's auc: 0.905126	valid_1's binary_logloss: 0.322585
[112]	valid_0's auc: 0.940462	valid_0's binary_logloss: 0.267507	valid_1's auc: 0.905073	valid_1's binary_logloss: 0.322692
[113]	valid_0's auc: 0.940621	valid_0's binary_logloss: 0.267199	valid_1's auc: 0.905075	valid_1's binary_logloss: 0.322724
[114]	valid_0's auc: 0.940827	valid_0's binary_logloss: 0.266824	valid_1's auc: 0.9049	valid_1's binary_logloss: 0.323049
[115]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.266479	valid_1's auc: 0.904785	valid_1's binary_logloss: 0.323288
[116]	valid_0's auc: 0.941247	valid_0's binary_logloss: 0.266054	valid_1's auc: 0.904662	valid_1's binary_logloss: 0.323534
[117]	valid_0's auc: 0.941417	valid_0's binary_logloss: 0.265695	valid_1's auc: 0.904448	valid_1's binary_logloss: 0.323923
[118]	valid_0's auc: 0.941681	valid_0's binary_logloss: 0.265224	valid_1's auc: 0.904401	valid_1's binary_logloss: 0.324009
[119]	valid_0's auc: 0.941866	valid_0's binary_logloss: 0.264872	valid_1's auc: 0.904384	valid_1's binary_logloss: 0.324105
[120]	valid_0's auc: 0.942011	valid_0's binary_logloss: 0.264578	valid_1's auc: 0.904362	valid_1's binary_logloss: 0.324212
[121]	valid_0's auc: 0.942191	valid_0's binary_logloss: 0.264226	valid_1's auc: 0.904354	valid_1's binary_logloss: 0.324273
[122]	valid_0's auc: 0.942529	valid_0's binary_logloss: 0.263664	valid_1's auc: 0.90424	valid_1's binary_logloss: 0.324454
[123]	valid_0's auc: 0.942667	valid_0's binary_logloss: 0.263382	valid_1's auc: 0.904179	valid_1's binary_logloss: 0.324619
[124]	valid_0's auc: 0.94286	valid_0's binary_logloss: 0.263052	valid_1's auc: 0.904146	valid_1's binary_logloss: 0.324692
[125]	valid_0's auc: 0.943083	valid_0's binary_logloss: 0.262653	valid_1's auc: 0.904196	valid_1's binary_logloss: 0.324582
[126]	valid_0's auc: 0.94319	valid_0's binary_logloss: 0.262477	valid_1's auc: 0.90414	valid_1's binary_logloss: 0.324681
[127]	valid_0's auc: 0.943387	valid_0's binary_logloss: 0.262085	valid_1's auc: 0.904047	valid_1's binary_logloss: 0.324842
[128]	valid_0's auc: 0.943577	valid_0's binary_logloss: 0.26172	valid_1's auc: 0.904025	valid_1's binary_logloss: 0.324896
[129]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261483	valid_1's auc: 0.903993	valid_1's binary_logloss: 0.324942
[130]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.261181	valid_1's auc: 0.903899	valid_1's binary_logloss: 0.325094
[131]	valid_0's auc: 0.944001	valid_0's binary_logloss: 0.26092	valid_1's auc: 0.903794	valid_1's binary_logloss: 0.325264
[132]	valid_0's auc: 0.944233	valid_0's binary_logloss: 0.26052	valid_1's auc: 0.903736	valid_1's binary_logloss: 0.325389
[133]	valid_0's auc: 0.944525	valid_0's binary_logloss: 0.260002	valid_1's auc: 0.903746	valid_1's binary_logloss: 0.325349
[134]	valid_0's auc: 0.944657	valid_0's binary_logloss: 0.259747	valid_1's auc: 0.903668	valid_1's binary_logloss: 0.325479
[135]	valid_0's auc: 0.944825	valid_0's binary_logloss: 0.259415	valid_1's auc: 0.903623	valid_1's binary_logloss: 0.325581
[136]	valid_0's auc: 0.944982	valid_0's binary_logloss: 0.259107	valid_1's auc: 0.903617	valid_1's binary_logloss: 0.325642
[137]	valid_0's auc: 0.945181	valid_0's binary_logloss: 0.258722	valid_1's auc: 0.903588	valid_1's binary_logloss: 0.325731
[138]	valid_0's auc: 0.945318	valid_0's binary_logloss: 0.258468	valid_1's auc: 0.903541	valid_1's binary_logloss: 0.325838
[139]	valid_0's auc: 0.94554	valid_0's binary_logloss: 0.258071	valid_1's auc: 0.903461	valid_1's binary_logloss: 0.326
[140]	valid_0's auc: 0.945801	valid_0's binary_logloss: 0.257622	valid_1's auc: 0.90339	valid_1's binary_logloss: 0.326143
[141]	valid_0's auc: 0.945919	valid_0's binary_logloss: 0.257342	valid_1's auc: 0.903299	valid_1's binary_logloss: 0.326343
[142]	valid_0's auc: 0.946103	valid_0's binary_logloss: 0.257002	valid_1's auc: 0.903188	valid_1's binary_logloss: 0.326585
[143]	valid_0's auc: 0.946229	valid_0's binary_logloss: 0.256722	valid_1's auc: 0.903163	valid_1's binary_logloss: 0.326697
[144]	valid_0's auc: 0.946383	valid_0's binary_logloss: 0.256387	valid_1's auc: 0.903184	valid_1's binary_logloss: 0.326725
[145]	valid_0's auc: 0.946697	valid_0's binary_logloss: 0.255872	valid_1's auc: 0.90321	valid_1's binary_logloss: 0.326683
[146]	valid_0's auc: 0.946846	valid_0's binary_logloss: 0.255551	valid_1's auc: 0.903128	valid_1's binary_logloss: 0.326941
Early stopping, best iteration is:
[46]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.299581	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.316401
[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893661	valid_0's binary_logloss: 0.487821	valid_1's auc: 0.89789	valid_1's binary_logloss: 0.479031
[3]	valid_0's auc: 0.895358	valid_0's binary_logloss: 0.46475	valid_1's auc: 0.900518	valid_1's binary_logloss: 0.455502
[4]	valid_0's auc: 0.897521	valid_0's binary_logloss: 0.445439	valid_1's auc: 0.901053	valid_1's binary_logloss: 0.436218
[5]	valid_0's auc: 0.898548	valid_0's binary_logloss: 0.429505	valid_1's auc: 0.902382	valid_1's binary_logloss: 0.42009
[6]	valid_0's auc: 0.900136	valid_0's binary_logloss: 0.415702	valid_1's auc: 0.903689	valid_1's binary_logloss: 0.406213
[7]	valid_0's auc: 0.901043	valid_0's binary_logloss: 0.403937	valid_1's auc: 0.904063	valid_1's binary_logloss: 0.394669
[8]	valid_0's auc: 0.901915	valid_0's binary_logloss: 0.3937	valid_1's auc: 0.904593	valid_1's binary_logloss: 0.384593
[9]	valid_0's auc: 0.902614	valid_0's binary_logloss: 0.384979	valid_1's auc: 0.905035	valid_1's binary_logloss: 0.376022
[10]	valid_0's auc: 0.903685	valid_0's binary_logloss: 0.377086	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.368898
[11]	valid_0's auc: 0.904382	valid_0's binary_logloss: 0.370239	valid_1's auc: 0.90596	valid_1's binary_logloss: 0.362513
[12]	valid_0's auc: 0.904928	valid_0's binary_logloss: 0.364202	valid_1's auc: 0.905891	valid_1's binary_logloss: 0.357052
[13]	valid_0's auc: 0.905978	valid_0's binary_logloss: 0.358812	valid_1's auc: 0.906362	valid_1's binary_logloss: 0.352116
[14]	valid_0's auc: 0.906802	valid_0's binary_logloss: 0.354021	valid_1's auc: 0.906936	valid_1's binary_logloss: 0.347742
[15]	valid_0's auc: 0.907538	valid_0's binary_logloss: 0.349681	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.343932
[16]	valid_0's auc: 0.908292	valid_0's binary_logloss: 0.345783	valid_1's auc: 0.907608	valid_1's binary_logloss: 0.340528
[17]	valid_0's auc: 0.908863	valid_0's binary_logloss: 0.342282	valid_1's auc: 0.907757	valid_1's binary_logloss: 0.337605
[18]	valid_0's auc: 0.909461	valid_0's binary_logloss: 0.339098	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.335112
[19]	valid_0's auc: 0.910237	valid_0's binary_logloss: 0.336034	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.332672
[20]	valid_0's auc: 0.910715	valid_0's binary_logloss: 0.333413	valid_1's auc: 0.908313	valid_1's binary_logloss: 0.330645
[21]	valid_0's auc: 0.911366	valid_0's binary_logloss: 0.330845	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.328627
[22]	valid_0's auc: 0.912021	valid_0's binary_logloss: 0.328523	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.327038
[23]	valid_0's auc: 0.912646	valid_0's binary_logloss: 0.326292	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.325831
[24]	valid_0's auc: 0.913278	valid_0's binary_logloss: 0.324304	valid_1's auc: 0.908781	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.913843	valid_0's binary_logloss: 0.322426	valid_1's auc: 0.908812	valid_1's binary_logloss: 0.323652
[26]	valid_0's auc: 0.914506	valid_0's binary_logloss: 0.320639	valid_1's auc: 0.90896	valid_1's binary_logloss: 0.322552
[27]	valid_0's auc: 0.915052	valid_0's binary_logloss: 0.31885	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.321599
[28]	valid_0's auc: 0.915538	valid_0's binary_logloss: 0.317377	valid_1's auc: 0.909137	valid_1's binary_logloss: 0.320806
[29]	valid_0's auc: 0.915968	valid_0's binary_logloss: 0.316008	valid_1's auc: 0.909082	valid_1's binary_logloss: 0.320286
[30]	valid_0's auc: 0.916492	valid_0's binary_logloss: 0.31461	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.319621
[31]	valid_0's auc: 0.917075	valid_0's binary_logloss: 0.313159	valid_1's auc: 0.909275	valid_1's binary_logloss: 0.318918
[32]	valid_0's auc: 0.917512	valid_0's binary_logloss: 0.311901	valid_1's auc: 0.909333	valid_1's binary_logloss: 0.318398
[33]	valid_0's auc: 0.918	valid_0's binary_logloss: 0.310673	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.317966
[34]	valid_0's auc: 0.918528	valid_0's binary_logloss: 0.309477	valid_1's auc: 0.909237	valid_1's binary_logloss: 0.317786
[35]	valid_0's auc: 0.919055	valid_0's binary_logloss: 0.308316	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.317654
[36]	valid_0's auc: 0.919365	valid_0's binary_logloss: 0.307448	valid_1's auc: 0.909155	valid_1's binary_logloss: 0.317281
[37]	valid_0's auc: 0.919825	valid_0's binary_logloss: 0.306478	valid_1's auc: 0.909343	valid_1's binary_logloss: 0.316821
[38]	valid_0's auc: 0.920271	valid_0's binary_logloss: 0.305526	valid_1's auc: 0.909437	valid_1's binary_logloss: 0.316513
[39]	valid_0's auc: 0.920677	valid_0's binary_logloss: 0.304586	valid_1's auc: 0.909464	valid_1's binary_logloss: 0.316293
[40]	valid_0's auc: 0.921068	valid_0's binary_logloss: 0.30375	valid_1's auc: 0.909526	valid_1's binary_logloss: 0.315996
[41]	valid_0's auc: 0.921527	valid_0's binary_logloss: 0.302745	valid_1's auc: 0.90966	valid_1's binary_logloss: 0.315655
[42]	valid_0's auc: 0.921932	valid_0's binary_logloss: 0.301937	valid_1's auc: 0.909644	valid_1's binary_logloss: 0.315528
[43]	valid_0's auc: 0.922366	valid_0's binary_logloss: 0.3011	valid_1's auc: 0.909709	valid_1's binary_logloss: 0.315324
[44]	valid_0's auc: 0.922755	valid_0's binary_logloss: 0.300342	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.315453
[45]	valid_0's auc: 0.923242	valid_0's binary_logloss: 0.299449	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.315285
[46]	valid_0's auc: 0.923544	valid_0's binary_logloss: 0.298756	valid_1's auc: 0.909539	valid_1's binary_logloss: 0.315197
[47]	valid_0's auc: 0.923919	valid_0's binary_logloss: 0.297998	valid_1's auc: 0.909628	valid_1's binary_logloss: 0.31498
[48]	valid_0's auc: 0.924262	valid_0's binary_logloss: 0.297262	valid_1's auc: 0.909663	valid_1's binary_logloss: 0.314807
[49]	valid_0's auc: 0.924661	valid_0's binary_logloss: 0.296542	valid_1's auc: 0.909755	valid_1's binary_logloss: 0.314616
[50]	valid_0's auc: 0.925017	valid_0's binary_logloss: 0.295874	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314639
[51]	valid_0's auc: 0.925359	valid_0's binary_logloss: 0.295233	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.314825
[52]	valid_0's auc: 0.925719	valid_0's binary_logloss: 0.294628	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.314867
[53]	valid_0's auc: 0.926122	valid_0's binary_logloss: 0.293895	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.314754
[54]	valid_0's auc: 0.926447	valid_0's binary_logloss: 0.293304	valid_1's auc: 0.909561	valid_1's binary_logloss: 0.314512
[55]	valid_0's auc: 0.926659	valid_0's binary_logloss: 0.292857	valid_1's auc: 0.909517	valid_1's binary_logloss: 0.314527
[56]	valid_0's auc: 0.926941	valid_0's binary_logloss: 0.292226	valid_1's auc: 0.909348	valid_1's binary_logloss: 0.314773
[57]	valid_0's auc: 0.927147	valid_0's binary_logloss: 0.291777	valid_1's auc: 0.909267	valid_1's binary_logloss: 0.314803
[58]	valid_0's auc: 0.927447	valid_0's binary_logloss: 0.291196	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.314841
[59]	valid_0's auc: 0.927863	valid_0's binary_logloss: 0.290525	valid_1's auc: 0.909232	valid_1's binary_logloss: 0.314834
[60]	valid_0's auc: 0.928118	valid_0's binary_logloss: 0.290052	valid_1's auc: 0.909116	valid_1's binary_logloss: 0.315028
[61]	valid_0's auc: 0.928339	valid_0's binary_logloss: 0.289638	valid_1's auc: 0.909179	valid_1's binary_logloss: 0.314917
[62]	valid_0's auc: 0.928593	valid_0's binary_logloss: 0.289166	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.314986
[63]	valid_0's auc: 0.928901	valid_0's binary_logloss: 0.288682	valid_1's auc: 0.908944	valid_1's binary_logloss: 0.315209
[64]	valid_0's auc: 0.929245	valid_0's binary_logloss: 0.28806	valid_1's auc: 0.908773	valid_1's binary_logloss: 0.315468
[65]	valid_0's auc: 0.92953	valid_0's binary_logloss: 0.28757	valid_1's auc: 0.908723	valid_1's binary_logloss: 0.315524
[66]	valid_0's auc: 0.929836	valid_0's binary_logloss: 0.287042	valid_1's auc: 0.908763	valid_1's binary_logloss: 0.315509
[67]	valid_0's auc: 0.930135	valid_0's binary_logloss: 0.286531	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.315624
[68]	valid_0's auc: 0.930481	valid_0's binary_logloss: 0.285923	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.315659
[69]	valid_0's auc: 0.930765	valid_0's binary_logloss: 0.285448	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.31564
[70]	valid_0's auc: 0.931065	valid_0's binary_logloss: 0.284912	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.315784
[71]	valid_0's auc: 0.931291	valid_0's binary_logloss: 0.284481	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.315807
[72]	valid_0's auc: 0.931484	valid_0's binary_logloss: 0.284159	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.315887
[73]	valid_0's auc: 0.931726	valid_0's binary_logloss: 0.283669	valid_1's auc: 0.90851	valid_1's binary_logloss: 0.315903
[74]	valid_0's auc: 0.932125	valid_0's binary_logloss: 0.282974	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.315905
[75]	valid_0's auc: 0.932428	valid_0's binary_logloss: 0.282409	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.31589
[76]	valid_0's auc: 0.932714	valid_0's binary_logloss: 0.281881	valid_1's auc: 0.90841	valid_1's binary_logloss: 0.316028
[77]	valid_0's auc: 0.932943	valid_0's binary_logloss: 0.281395	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.316051
[78]	valid_0's auc: 0.933236	valid_0's binary_logloss: 0.280842	valid_1's auc: 0.908358	valid_1's binary_logloss: 0.316065
[79]	valid_0's auc: 0.933504	valid_0's binary_logloss: 0.280386	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.316032
[80]	valid_0's auc: 0.933789	valid_0's binary_logloss: 0.279887	valid_1's auc: 0.908329	valid_1's binary_logloss: 0.31616
[81]	valid_0's auc: 0.934074	valid_0's binary_logloss: 0.279392	valid_1's auc: 0.90824	valid_1's binary_logloss: 0.316318
[82]	valid_0's auc: 0.934475	valid_0's binary_logloss: 0.278776	valid_1's auc: 0.907988	valid_1's binary_logloss: 0.316662
[83]	valid_0's auc: 0.934643	valid_0's binary_logloss: 0.278377	valid_1's auc: 0.907947	valid_1's binary_logloss: 0.316766
[84]	valid_0's auc: 0.935033	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.316834
[85]	valid_0's auc: 0.935339	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.316819
[86]	valid_0's auc: 0.935647	valid_0's binary_logloss: 0.276578	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.316874
[87]	valid_0's auc: 0.935948	valid_0's binary_logloss: 0.276046	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.316769
[88]	valid_0's auc: 0.936226	valid_0's binary_logloss: 0.275577	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.316912
[89]	valid_0's auc: 0.936536	valid_0's binary_logloss: 0.27507	valid_1's auc: 0.907904	valid_1's binary_logloss: 0.316884
[90]	valid_0's auc: 0.936798	valid_0's binary_logloss: 0.274596	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317093
[91]	valid_0's auc: 0.937008	valid_0's binary_logloss: 0.274182	valid_1's auc: 0.907779	valid_1's binary_logloss: 0.317153
[92]	valid_0's auc: 0.937247	valid_0's binary_logloss: 0.273779	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.317298
[93]	valid_0's auc: 0.93754	valid_0's binary_logloss: 0.273258	valid_1's auc: 0.907675	valid_1's binary_logloss: 0.317343
[94]	valid_0's auc: 0.937791	valid_0's binary_logloss: 0.272782	valid_1's auc: 0.907733	valid_1's binary_logloss: 0.317316
[95]	valid_0's auc: 0.938034	valid_0's binary_logloss: 0.272319	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.317292
[96]	valid_0's auc: 0.938271	valid_0's binary_logloss: 0.271854	valid_1's auc: 0.90773	valid_1's binary_logloss: 0.317378
[97]	valid_0's auc: 0.938571	valid_0's binary_logloss: 0.271365	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.317329
[98]	valid_0's auc: 0.938902	valid_0's binary_logloss: 0.270772	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.317015
[99]	valid_0's auc: 0.939057	valid_0's binary_logloss: 0.270461	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.317001
[100]	valid_0's auc: 0.939282	valid_0's binary_logloss: 0.270065	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.317056
[101]	valid_0's auc: 0.939464	valid_0's binary_logloss: 0.26966	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.317329
[102]	valid_0's auc: 0.939653	valid_0's binary_logloss: 0.269343	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.317496
[103]	valid_0's auc: 0.939842	valid_0's binary_logloss: 0.269011	valid_1's auc: 0.907626	valid_1's binary_logloss: 0.317627
[104]	valid_0's auc: 0.94004	valid_0's binary_logloss: 0.268624	valid_1's auc: 0.907666	valid_1's binary_logloss: 0.317601
[105]	valid_0's auc: 0.940256	valid_0's binary_logloss: 0.268225	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.317696
[106]	valid_0's auc: 0.940548	valid_0's binary_logloss: 0.267708	valid_1's auc: 0.907647	valid_1's binary_logloss: 0.317633
[107]	valid_0's auc: 0.940765	valid_0's binary_logloss: 0.267305	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.317608
[108]	valid_0's auc: 0.940982	valid_0's binary_logloss: 0.266889	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317756
[109]	valid_0's auc: 0.94119	valid_0's binary_logloss: 0.266491	valid_1's auc: 0.907583	valid_1's binary_logloss: 0.317823
[110]	valid_0's auc: 0.941413	valid_0's binary_logloss: 0.266082	valid_1's auc: 0.90756	valid_1's binary_logloss: 0.317867
[111]	valid_0's auc: 0.941553	valid_0's binary_logloss: 0.265822	valid_1's auc: 0.90756	valid_1's binary_logloss: 0.317877
[112]	valid_0's auc: 0.941791	valid_0's binary_logloss: 0.265416	valid_1's auc: 0.907567	valid_1's binary_logloss: 0.317896
[113]	valid_0's auc: 0.941943	valid_0's binary_logloss: 0.265093	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317969
[114]	valid_0's auc: 0.942174	valid_0's binary_logloss: 0.264669	valid_1's auc: 0.90751	valid_1's binary_logloss: 0.318083
[115]	valid_0's auc: 0.942316	valid_0's binary_logloss: 0.264399	valid_1's auc: 0.907497	valid_1's binary_logloss: 0.318134
[116]	valid_0's auc: 0.942492	valid_0's binary_logloss: 0.264052	valid_1's auc: 0.907444	valid_1's binary_logloss: 0.318205
[117]	valid_0's auc: 0.942663	valid_0's binary_logloss: 0.2637	valid_1's auc: 0.90745	valid_1's binary_logloss: 0.318214
[118]	valid_0's auc: 0.942891	valid_0's binary_logloss: 0.263308	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.3183
[119]	valid_0's auc: 0.943086	valid_0's binary_logloss: 0.262949	valid_1's auc: 0.907409	valid_1's binary_logloss: 0.318284
[120]	valid_0's auc: 0.943308	valid_0's binary_logloss: 0.262541	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.318262
[121]	valid_0's auc: 0.943457	valid_0's binary_logloss: 0.262217	valid_1's auc: 0.907396	valid_1's binary_logloss: 0.318417
[122]	valid_0's auc: 0.943611	valid_0's binary_logloss: 0.261921	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.31846
[123]	valid_0's auc: 0.943818	valid_0's binary_logloss: 0.261558	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318468
[124]	valid_0's auc: 0.944111	valid_0's binary_logloss: 0.261062	valid_1's auc: 0.907386	valid_1's binary_logloss: 0.318455
[125]	valid_0's auc: 0.944236	valid_0's binary_logloss: 0.26077	valid_1's auc: 0.907281	valid_1's binary_logloss: 0.318719
[126]	valid_0's auc: 0.944379	valid_0's binary_logloss: 0.260453	valid_1's auc: 0.907227	valid_1's binary_logloss: 0.318839
[127]	valid_0's auc: 0.944544	valid_0's binary_logloss: 0.260075	valid_1's auc: 0.90716	valid_1's binary_logloss: 0.318955
[128]	valid_0's auc: 0.944774	valid_0's binary_logloss: 0.25963	valid_1's auc: 0.907052	valid_1's binary_logloss: 0.319164
[129]	valid_0's auc: 0.944911	valid_0's binary_logloss: 0.259355	valid_1's auc: 0.906971	valid_1's binary_logloss: 0.319325
[130]	valid_0's auc: 0.945108	valid_0's binary_logloss: 0.258953	valid_1's auc: 0.906841	valid_1's binary_logloss: 0.319601
[131]	valid_0's auc: 0.945258	valid_0's binary_logloss: 0.25867	valid_1's auc: 0.906801	valid_1's binary_logloss: 0.319688
[132]	valid_0's auc: 0.945446	valid_0's binary_logloss: 0.258318	valid_1's auc: 0.906762	valid_1's binary_logloss: 0.319781
[133]	valid_0's auc: 0.945699	valid_0's binary_logloss: 0.257864	valid_1's auc: 0.906818	valid_1's binary_logloss: 0.319698
[134]	valid_0's auc: 0.945975	valid_0's binary_logloss: 0.257359	valid_1's auc: 0.906692	valid_1's binary_logloss: 0.319899
[135]	valid_0's auc: 0.946145	valid_0's binary_logloss: 0.257045	valid_1's auc: 0.9067	valid_1's binary_logloss: 0.319919
[136]	valid_0's auc: 0.94628	valid_0's binary_logloss: 0.256771	valid_1's auc: 0.906535	valid_1's binary_logloss: 0.320198
[137]	valid_0's auc: 0.94641	valid_0's binary_logloss: 0.256444	valid_1's auc: 0.906571	valid_1's binary_logloss: 0.320166
[138]	valid_0's auc: 0.946543	valid_0's binary_logloss: 0.256174	valid_1's auc: 0.906514	valid_1's binary_logloss: 0.320288
[139]	valid_0's auc: 0.946642	valid_0's binary_logloss: 0.25599	valid_1's auc: 0.906455	valid_1's binary_logloss: 0.320412
[140]	valid_0's auc: 0.946828	valid_0's binary_logloss: 0.255669	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320413
[141]	valid_0's auc: 0.946928	valid_0's binary_logloss: 0.255444	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.3205
[142]	valid_0's auc: 0.947042	valid_0's binary_logloss: 0.255206	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.320529
[143]	valid_0's auc: 0.947164	valid_0's binary_logloss: 0.254923	valid_1's auc: 0.906416	valid_1's binary_logloss: 0.320549
[144]	valid_0's auc: 0.947268	valid_0's binary_logloss: 0.254669	valid_1's auc: 0.906445	valid_1's binary_logloss: 0.320565
[145]	valid_0's auc: 0.947509	valid_0's binary_logloss: 0.254222	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.320627
[146]	valid_0's auc: 0.947605	valid_0's binary_logloss: 0.254007	valid_1's auc: 0.906355	valid_1's binary_logloss: 0.320733
[147]	valid_0's auc: 0.94773	valid_0's binary_logloss: 0.25373	valid_1's auc: 0.90634	valid_1's binary_logloss: 0.320766
[148]	valid_0's auc: 0.947901	valid_0's binary_logloss: 0.253409	valid_1's auc: 0.90626	valid_1's binary_logloss: 0.320963
[149]	valid_0's auc: 0.948078	valid_0's binary_logloss: 0.253064	valid_1's auc: 0.906183	valid_1's binary_logloss: 0.321127
Early stopping, best iteration is:
[49]	valid_0's auc: 0.924661	valid_0's binary_logloss: 0.296542	valid_1's auc: 0.909755	valid_1's binary_logloss: 0.314616
[1]	valid_0's auc: 0.888162	valid_0's binary_logloss: 0.517463	valid_1's auc: 0.894517	valid_1's binary_logloss: 0.508366
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891775	valid_0's binary_logloss: 0.488624	valid_1's auc: 0.896817	valid_1's binary_logloss: 0.47901
[3]	valid_0's auc: 0.89565	valid_0's binary_logloss: 0.465045	valid_1's auc: 0.899721	valid_1's binary_logloss: 0.4552
[4]	valid_0's auc: 0.896702	valid_0's binary_logloss: 0.445723	valid_1's auc: 0.900399	valid_1's binary_logloss: 0.436017
[5]	valid_0's auc: 0.898238	valid_0's binary_logloss: 0.429424	valid_1's auc: 0.901062	valid_1's binary_logloss: 0.419756
[6]	valid_0's auc: 0.899111	valid_0's binary_logloss: 0.415791	valid_1's auc: 0.901759	valid_1's binary_logloss: 0.406127
[7]	valid_0's auc: 0.899871	valid_0's binary_logloss: 0.404216	valid_1's auc: 0.90188	valid_1's binary_logloss: 0.394702
[8]	valid_0's auc: 0.900845	valid_0's binary_logloss: 0.39409	valid_1's auc: 0.90346	valid_1's binary_logloss: 0.384765
[9]	valid_0's auc: 0.901696	valid_0's binary_logloss: 0.385334	valid_1's auc: 0.903827	valid_1's binary_logloss: 0.376385
[10]	valid_0's auc: 0.902434	valid_0's binary_logloss: 0.37758	valid_1's auc: 0.903959	valid_1's binary_logloss: 0.369052
[11]	valid_0's auc: 0.902902	valid_0's binary_logloss: 0.370971	valid_1's auc: 0.903836	valid_1's binary_logloss: 0.362978
[12]	valid_0's auc: 0.903909	valid_0's binary_logloss: 0.36487	valid_1's auc: 0.904482	valid_1's binary_logloss: 0.357409
[13]	valid_0's auc: 0.904882	valid_0's binary_logloss: 0.359514	valid_1's auc: 0.905256	valid_1's binary_logloss: 0.352658
[14]	valid_0's auc: 0.90553	valid_0's binary_logloss: 0.354805	valid_1's auc: 0.905299	valid_1's binary_logloss: 0.348578
[15]	valid_0's auc: 0.906178	valid_0's binary_logloss: 0.35052	valid_1's auc: 0.905473	valid_1's binary_logloss: 0.344935
[16]	valid_0's auc: 0.906821	valid_0's binary_logloss: 0.346738	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.341641
[17]	valid_0's auc: 0.907218	valid_0's binary_logloss: 0.343324	valid_1's auc: 0.905981	valid_1's binary_logloss: 0.338602
[18]	valid_0's auc: 0.907824	valid_0's binary_logloss: 0.340224	valid_1's auc: 0.906424	valid_1's binary_logloss: 0.335775
[19]	valid_0's auc: 0.908712	valid_0's binary_logloss: 0.337156	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.333646
[20]	valid_0's auc: 0.909527	valid_0's binary_logloss: 0.334344	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.3317
[21]	valid_0's auc: 0.910443	valid_0's binary_logloss: 0.331731	valid_1's auc: 0.906939	valid_1's binary_logloss: 0.330161
[22]	valid_0's auc: 0.910947	valid_0's binary_logloss: 0.329448	valid_1's auc: 0.907265	valid_1's binary_logloss: 0.328201
[23]	valid_0's auc: 0.911697	valid_0's binary_logloss: 0.327086	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.326356
[24]	valid_0's auc: 0.912328	valid_0's binary_logloss: 0.32508	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.325342
[25]	valid_0's auc: 0.912926	valid_0's binary_logloss: 0.323227	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.324101
[26]	valid_0's auc: 0.913607	valid_0's binary_logloss: 0.321347	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.322949
[27]	valid_0's auc: 0.91415	valid_0's binary_logloss: 0.31972	valid_1's auc: 0.908277	valid_1's binary_logloss: 0.321966
[28]	valid_0's auc: 0.914784	valid_0's binary_logloss: 0.318077	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.32121
[29]	valid_0's auc: 0.915309	valid_0's binary_logloss: 0.31659	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.32068
[30]	valid_0's auc: 0.915713	valid_0's binary_logloss: 0.315286	valid_1's auc: 0.908241	valid_1's binary_logloss: 0.320096
[31]	valid_0's auc: 0.916226	valid_0's binary_logloss: 0.313975	valid_1's auc: 0.908428	valid_1's binary_logloss: 0.319403
[32]	valid_0's auc: 0.916673	valid_0's binary_logloss: 0.312816	valid_1's auc: 0.908384	valid_1's binary_logloss: 0.318979
[33]	valid_0's auc: 0.917163	valid_0's binary_logloss: 0.311675	valid_1's auc: 0.908571	valid_1's binary_logloss: 0.318438
[34]	valid_0's auc: 0.917665	valid_0's binary_logloss: 0.310498	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.317976
[35]	valid_0's auc: 0.918171	valid_0's binary_logloss: 0.309348	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.31745
[36]	valid_0's auc: 0.91863	valid_0's binary_logloss: 0.308417	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.317311
[37]	valid_0's auc: 0.919111	valid_0's binary_logloss: 0.307321	valid_1's auc: 0.908748	valid_1's binary_logloss: 0.317071
[38]	valid_0's auc: 0.91946	valid_0's binary_logloss: 0.306449	valid_1's auc: 0.908845	valid_1's binary_logloss: 0.316672
[39]	valid_0's auc: 0.919842	valid_0's binary_logloss: 0.305636	valid_1's auc: 0.908983	valid_1's binary_logloss: 0.316353
[40]	valid_0's auc: 0.920294	valid_0's binary_logloss: 0.304729	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31599
[41]	valid_0's auc: 0.920811	valid_0's binary_logloss: 0.303773	valid_1's auc: 0.90906	valid_1's binary_logloss: 0.315911
[42]	valid_0's auc: 0.921343	valid_0's binary_logloss: 0.302763	valid_1's auc: 0.90908	valid_1's binary_logloss: 0.315786
[43]	valid_0's auc: 0.921758	valid_0's binary_logloss: 0.301888	valid_1's auc: 0.909049	valid_1's binary_logloss: 0.315709
[44]	valid_0's auc: 0.92204	valid_0's binary_logloss: 0.301183	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315745
[45]	valid_0's auc: 0.922419	valid_0's binary_logloss: 0.300435	valid_1's auc: 0.908877	valid_1's binary_logloss: 0.315749
[46]	valid_0's auc: 0.922865	valid_0's binary_logloss: 0.29962	valid_1's auc: 0.908874	valid_1's binary_logloss: 0.31561
[47]	valid_0's auc: 0.923193	valid_0's binary_logloss: 0.298963	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.315383
[48]	valid_0's auc: 0.923597	valid_0's binary_logloss: 0.298199	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315339
[49]	valid_0's auc: 0.923913	valid_0's binary_logloss: 0.297567	valid_1's auc: 0.908893	valid_1's binary_logloss: 0.31527
[50]	valid_0's auc: 0.924356	valid_0's binary_logloss: 0.2968	valid_1's auc: 0.9089	valid_1's binary_logloss: 0.315207
[51]	valid_0's auc: 0.924734	valid_0's binary_logloss: 0.296127	valid_1's auc: 0.908953	valid_1's binary_logloss: 0.315072
[52]	valid_0's auc: 0.925154	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.908955	valid_1's binary_logloss: 0.31503
[53]	valid_0's auc: 0.925516	valid_0's binary_logloss: 0.294784	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.315061
[54]	valid_0's auc: 0.92585	valid_0's binary_logloss: 0.294194	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315076
[55]	valid_0's auc: 0.926177	valid_0's binary_logloss: 0.293527	valid_1's auc: 0.908784	valid_1's binary_logloss: 0.315121
[56]	valid_0's auc: 0.926598	valid_0's binary_logloss: 0.292814	valid_1's auc: 0.908609	valid_1's binary_logloss: 0.315329
[57]	valid_0's auc: 0.926908	valid_0's binary_logloss: 0.292244	valid_1's auc: 0.908552	valid_1's binary_logloss: 0.315385
[58]	valid_0's auc: 0.92718	valid_0's binary_logloss: 0.29169	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.315558
[59]	valid_0's auc: 0.9275	valid_0's binary_logloss: 0.291146	valid_1's auc: 0.908317	valid_1's binary_logloss: 0.315749
[60]	valid_0's auc: 0.927861	valid_0's binary_logloss: 0.290496	valid_1's auc: 0.908327	valid_1's binary_logloss: 0.315769
[61]	valid_0's auc: 0.928184	valid_0's binary_logloss: 0.289871	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.315546
[62]	valid_0's auc: 0.928472	valid_0's binary_logloss: 0.289368	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.315713
[63]	valid_0's auc: 0.928792	valid_0's binary_logloss: 0.288778	valid_1's auc: 0.908433	valid_1's binary_logloss: 0.315492
[64]	valid_0's auc: 0.92907	valid_0's binary_logloss: 0.288238	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.315636
[65]	valid_0's auc: 0.929315	valid_0's binary_logloss: 0.287762	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.315684
[66]	valid_0's auc: 0.929495	valid_0's binary_logloss: 0.287413	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.315607
[67]	valid_0's auc: 0.929788	valid_0's binary_logloss: 0.286874	valid_1's auc: 0.90837	valid_1's binary_logloss: 0.315623
[68]	valid_0's auc: 0.929989	valid_0's binary_logloss: 0.28647	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.315785
[69]	valid_0's auc: 0.930058	valid_0's binary_logloss: 0.286302	valid_1's auc: 0.908199	valid_1's binary_logloss: 0.315851
[70]	valid_0's auc: 0.930309	valid_0's binary_logloss: 0.285833	valid_1's auc: 0.908131	valid_1's binary_logloss: 0.315997
[71]	valid_0's auc: 0.930538	valid_0's binary_logloss: 0.285429	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.315946
[72]	valid_0's auc: 0.930969	valid_0's binary_logloss: 0.284737	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.316218
[73]	valid_0's auc: 0.931303	valid_0's binary_logloss: 0.284157	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.316337
[74]	valid_0's auc: 0.931561	valid_0's binary_logloss: 0.283726	valid_1's auc: 0.90766	valid_1's binary_logloss: 0.31665
[75]	valid_0's auc: 0.931854	valid_0's binary_logloss: 0.283125	valid_1's auc: 0.907645	valid_1's binary_logloss: 0.316665
[76]	valid_0's auc: 0.93219	valid_0's binary_logloss: 0.28254	valid_1's auc: 0.907645	valid_1's binary_logloss: 0.316688
[77]	valid_0's auc: 0.932539	valid_0's binary_logloss: 0.281959	valid_1's auc: 0.907628	valid_1's binary_logloss: 0.316669
[78]	valid_0's auc: 0.932688	valid_0's binary_logloss: 0.281681	valid_1's auc: 0.907598	valid_1's binary_logloss: 0.316786
[79]	valid_0's auc: 0.932987	valid_0's binary_logloss: 0.281165	valid_1's auc: 0.907392	valid_1's binary_logloss: 0.317074
[80]	valid_0's auc: 0.933283	valid_0's binary_logloss: 0.280667	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.317125
[81]	valid_0's auc: 0.93356	valid_0's binary_logloss: 0.280124	valid_1's auc: 0.907407	valid_1's binary_logloss: 0.317118
[82]	valid_0's auc: 0.933729	valid_0's binary_logloss: 0.27981	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.317157
[83]	valid_0's auc: 0.933951	valid_0's binary_logloss: 0.279427	valid_1's auc: 0.907249	valid_1's binary_logloss: 0.317349
[84]	valid_0's auc: 0.93428	valid_0's binary_logloss: 0.278817	valid_1's auc: 0.907211	valid_1's binary_logloss: 0.317478
[85]	valid_0's auc: 0.934535	valid_0's binary_logloss: 0.278351	valid_1's auc: 0.907194	valid_1's binary_logloss: 0.317518
[86]	valid_0's auc: 0.934766	valid_0's binary_logloss: 0.277917	valid_1's auc: 0.907124	valid_1's binary_logloss: 0.317617
[87]	valid_0's auc: 0.934904	valid_0's binary_logloss: 0.277594	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.317597
[88]	valid_0's auc: 0.935191	valid_0's binary_logloss: 0.277146	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.317702
[89]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.276714	valid_1's auc: 0.907046	valid_1's binary_logloss: 0.31778
[90]	valid_0's auc: 0.935691	valid_0's binary_logloss: 0.276288	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.317811
[91]	valid_0's auc: 0.935993	valid_0's binary_logloss: 0.275785	valid_1's auc: 0.906841	valid_1's binary_logloss: 0.318086
[92]	valid_0's auc: 0.93631	valid_0's binary_logloss: 0.275191	valid_1's auc: 0.906823	valid_1's binary_logloss: 0.318185
[93]	valid_0's auc: 0.936559	valid_0's binary_logloss: 0.27475	valid_1's auc: 0.906683	valid_1's binary_logloss: 0.318432
[94]	valid_0's auc: 0.9368	valid_0's binary_logloss: 0.274249	valid_1's auc: 0.906465	valid_1's binary_logloss: 0.318792
[95]	valid_0's auc: 0.937079	valid_0's binary_logloss: 0.273763	valid_1's auc: 0.906326	valid_1's binary_logloss: 0.319
[96]	valid_0's auc: 0.937303	valid_0's binary_logloss: 0.273353	valid_1's auc: 0.906221	valid_1's binary_logloss: 0.319194
[97]	valid_0's auc: 0.937559	valid_0's binary_logloss: 0.27293	valid_1's auc: 0.906232	valid_1's binary_logloss: 0.319209
[98]	valid_0's auc: 0.937754	valid_0's binary_logloss: 0.272493	valid_1's auc: 0.906164	valid_1's binary_logloss: 0.319334
[99]	valid_0's auc: 0.93791	valid_0's binary_logloss: 0.2722	valid_1's auc: 0.90605	valid_1's binary_logloss: 0.319501
[100]	valid_0's auc: 0.938159	valid_0's binary_logloss: 0.271784	valid_1's auc: 0.905986	valid_1's binary_logloss: 0.319579
[101]	valid_0's auc: 0.93834	valid_0's binary_logloss: 0.271467	valid_1's auc: 0.905871	valid_1's binary_logloss: 0.319773
[102]	valid_0's auc: 0.938551	valid_0's binary_logloss: 0.271091	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.319711
[103]	valid_0's auc: 0.938745	valid_0's binary_logloss: 0.270727	valid_1's auc: 0.905752	valid_1's binary_logloss: 0.319973
[104]	valid_0's auc: 0.938965	valid_0's binary_logloss: 0.270314	valid_1's auc: 0.905744	valid_1's binary_logloss: 0.320034
[105]	valid_0's auc: 0.939123	valid_0's binary_logloss: 0.269968	valid_1's auc: 0.905603	valid_1's binary_logloss: 0.320261
[106]	valid_0's auc: 0.939273	valid_0's binary_logloss: 0.269706	valid_1's auc: 0.905568	valid_1's binary_logloss: 0.320337
[107]	valid_0's auc: 0.939492	valid_0's binary_logloss: 0.269319	valid_1's auc: 0.905518	valid_1's binary_logloss: 0.320434
[108]	valid_0's auc: 0.939671	valid_0's binary_logloss: 0.269021	valid_1's auc: 0.905511	valid_1's binary_logloss: 0.320428
[109]	valid_0's auc: 0.939813	valid_0's binary_logloss: 0.268694	valid_1's auc: 0.905424	valid_1's binary_logloss: 0.320587
[110]	valid_0's auc: 0.940145	valid_0's binary_logloss: 0.268135	valid_1's auc: 0.905397	valid_1's binary_logloss: 0.320657
[111]	valid_0's auc: 0.940341	valid_0's binary_logloss: 0.26777	valid_1's auc: 0.905378	valid_1's binary_logloss: 0.320705
[112]	valid_0's auc: 0.940525	valid_0's binary_logloss: 0.267399	valid_1's auc: 0.905252	valid_1's binary_logloss: 0.320937
[113]	valid_0's auc: 0.940659	valid_0's binary_logloss: 0.267129	valid_1's auc: 0.905158	valid_1's binary_logloss: 0.321088
[114]	valid_0's auc: 0.940891	valid_0's binary_logloss: 0.266714	valid_1's auc: 0.905079	valid_1's binary_logloss: 0.321191
[115]	valid_0's auc: 0.941086	valid_0's binary_logloss: 0.266363	valid_1's auc: 0.90508	valid_1's binary_logloss: 0.321189
[116]	valid_0's auc: 0.941246	valid_0's binary_logloss: 0.266046	valid_1's auc: 0.904924	valid_1's binary_logloss: 0.321468
[117]	valid_0's auc: 0.941569	valid_0's binary_logloss: 0.265525	valid_1's auc: 0.90486	valid_1's binary_logloss: 0.321575
[118]	valid_0's auc: 0.941695	valid_0's binary_logloss: 0.265262	valid_1's auc: 0.904891	valid_1's binary_logloss: 0.321602
[119]	valid_0's auc: 0.941889	valid_0's binary_logloss: 0.264936	valid_1's auc: 0.904803	valid_1's binary_logloss: 0.321722
[120]	valid_0's auc: 0.942127	valid_0's binary_logloss: 0.264532	valid_1's auc: 0.904714	valid_1's binary_logloss: 0.321947
[121]	valid_0's auc: 0.942304	valid_0's binary_logloss: 0.264224	valid_1's auc: 0.904662	valid_1's binary_logloss: 0.322021
[122]	valid_0's auc: 0.942435	valid_0's binary_logloss: 0.26397	valid_1's auc: 0.904669	valid_1's binary_logloss: 0.322066
[123]	valid_0's auc: 0.942591	valid_0's binary_logloss: 0.26366	valid_1's auc: 0.9046	valid_1's binary_logloss: 0.322223
[124]	valid_0's auc: 0.942812	valid_0's binary_logloss: 0.263272	valid_1's auc: 0.90453	valid_1's binary_logloss: 0.32237
[125]	valid_0's auc: 0.943025	valid_0's binary_logloss: 0.26288	valid_1's auc: 0.904411	valid_1's binary_logloss: 0.322594
[126]	valid_0's auc: 0.943194	valid_0's binary_logloss: 0.262559	valid_1's auc: 0.904302	valid_1's binary_logloss: 0.322759
[127]	valid_0's auc: 0.943377	valid_0's binary_logloss: 0.262223	valid_1's auc: 0.904272	valid_1's binary_logloss: 0.322846
[128]	valid_0's auc: 0.943747	valid_0's binary_logloss: 0.261606	valid_1's auc: 0.904199	valid_1's binary_logloss: 0.322905
[129]	valid_0's auc: 0.943913	valid_0's binary_logloss: 0.261221	valid_1's auc: 0.90421	valid_1's binary_logloss: 0.323003
[130]	valid_0's auc: 0.944064	valid_0's binary_logloss: 0.260922	valid_1's auc: 0.904146	valid_1's binary_logloss: 0.323093
[131]	valid_0's auc: 0.944343	valid_0's binary_logloss: 0.260427	valid_1's auc: 0.904101	valid_1's binary_logloss: 0.323208
[132]	valid_0's auc: 0.944496	valid_0's binary_logloss: 0.26012	valid_1's auc: 0.903994	valid_1's binary_logloss: 0.323423
[133]	valid_0's auc: 0.944643	valid_0's binary_logloss: 0.25981	valid_1's auc: 0.903951	valid_1's binary_logloss: 0.323561
[134]	valid_0's auc: 0.944837	valid_0's binary_logloss: 0.259465	valid_1's auc: 0.903836	valid_1's binary_logloss: 0.323733
[135]	valid_0's auc: 0.945052	valid_0's binary_logloss: 0.259053	valid_1's auc: 0.903808	valid_1's binary_logloss: 0.323841
[136]	valid_0's auc: 0.945228	valid_0's binary_logloss: 0.258684	valid_1's auc: 0.903737	valid_1's binary_logloss: 0.324009
[137]	valid_0's auc: 0.945447	valid_0's binary_logloss: 0.258263	valid_1's auc: 0.903763	valid_1's binary_logloss: 0.324027
[138]	valid_0's auc: 0.945594	valid_0's binary_logloss: 0.25797	valid_1's auc: 0.903762	valid_1's binary_logloss: 0.324043
[139]	valid_0's auc: 0.945758	valid_0's binary_logloss: 0.257637	valid_1's auc: 0.903648	valid_1's binary_logloss: 0.324276
[140]	valid_0's auc: 0.946053	valid_0's binary_logloss: 0.257145	valid_1's auc: 0.90363	valid_1's binary_logloss: 0.324344
Early stopping, best iteration is:
[40]	valid_0's auc: 0.920294	valid_0's binary_logloss: 0.304729	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31599
[1]	valid_0's auc: 0.88811	valid_0's binary_logloss: 0.516701	valid_1's auc: 0.895814	valid_1's binary_logloss: 0.507528
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891491	valid_0's binary_logloss: 0.487539	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.477417
[3]	valid_0's auc: 0.893109	valid_0's binary_logloss: 0.464326	valid_1's auc: 0.901507	valid_1's binary_logloss: 0.453478
[4]	valid_0's auc: 0.894791	valid_0's binary_logloss: 0.444982	valid_1's auc: 0.901224	valid_1's binary_logloss: 0.434583
[5]	valid_0's auc: 0.895624	valid_0's binary_logloss: 0.428966	valid_1's auc: 0.901056	valid_1's binary_logloss: 0.418654
[6]	valid_0's auc: 0.896944	valid_0's binary_logloss: 0.415161	valid_1's auc: 0.902052	valid_1's binary_logloss: 0.405135
[7]	valid_0's auc: 0.89758	valid_0's binary_logloss: 0.403513	valid_1's auc: 0.901691	valid_1's binary_logloss: 0.394009
[8]	valid_0's auc: 0.90015	valid_0's binary_logloss: 0.393394	valid_1's auc: 0.903784	valid_1's binary_logloss: 0.383993
[9]	valid_0's auc: 0.901255	valid_0's binary_logloss: 0.384675	valid_1's auc: 0.904091	valid_1's binary_logloss: 0.375696
[10]	valid_0's auc: 0.902629	valid_0's binary_logloss: 0.376904	valid_1's auc: 0.904387	valid_1's binary_logloss: 0.368673
[11]	valid_0's auc: 0.903701	valid_0's binary_logloss: 0.369943	valid_1's auc: 0.904709	valid_1's binary_logloss: 0.36236
[12]	valid_0's auc: 0.904339	valid_0's binary_logloss: 0.363963	valid_1's auc: 0.904816	valid_1's binary_logloss: 0.357033
[13]	valid_0's auc: 0.905081	valid_0's binary_logloss: 0.35849	valid_1's auc: 0.905014	valid_1's binary_logloss: 0.352166
[14]	valid_0's auc: 0.905811	valid_0's binary_logloss: 0.353858	valid_1's auc: 0.905424	valid_1's binary_logloss: 0.347997
[15]	valid_0's auc: 0.906466	valid_0's binary_logloss: 0.349608	valid_1's auc: 0.905498	valid_1's binary_logloss: 0.344373
[16]	valid_0's auc: 0.907398	valid_0's binary_logloss: 0.345736	valid_1's auc: 0.905873	valid_1's binary_logloss: 0.341236
[17]	valid_0's auc: 0.908186	valid_0's binary_logloss: 0.342228	valid_1's auc: 0.906329	valid_1's binary_logloss: 0.338301
[18]	valid_0's auc: 0.90925	valid_0's binary_logloss: 0.338743	valid_1's auc: 0.906826	valid_1's binary_logloss: 0.335503
[19]	valid_0's auc: 0.9102	valid_0's binary_logloss: 0.335607	valid_1's auc: 0.907031	valid_1's binary_logloss: 0.333281
[20]	valid_0's auc: 0.910757	valid_0's binary_logloss: 0.332976	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.331059
[21]	valid_0's auc: 0.911478	valid_0's binary_logloss: 0.330345	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.329002
[22]	valid_0's auc: 0.912097	valid_0's binary_logloss: 0.328103	valid_1's auc: 0.907709	valid_1's binary_logloss: 0.327752
[23]	valid_0's auc: 0.912771	valid_0's binary_logloss: 0.325821	valid_1's auc: 0.907903	valid_1's binary_logloss: 0.326202
[24]	valid_0's auc: 0.913361	valid_0's binary_logloss: 0.323845	valid_1's auc: 0.908218	valid_1's binary_logloss: 0.324854
[25]	valid_0's auc: 0.913946	valid_0's binary_logloss: 0.321961	valid_1's auc: 0.90831	valid_1's binary_logloss: 0.323874
[26]	valid_0's auc: 0.91455	valid_0's binary_logloss: 0.320134	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.323006
[27]	valid_0's auc: 0.915219	valid_0's binary_logloss: 0.31836	valid_1's auc: 0.908516	valid_1's binary_logloss: 0.32199
[28]	valid_0's auc: 0.915726	valid_0's binary_logloss: 0.316889	valid_1's auc: 0.908564	valid_1's binary_logloss: 0.321327
[29]	valid_0's auc: 0.91619	valid_0's binary_logloss: 0.315516	valid_1's auc: 0.90867	valid_1's binary_logloss: 0.320607
[30]	valid_0's auc: 0.916569	valid_0's binary_logloss: 0.314309	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.320117
[31]	valid_0's auc: 0.917126	valid_0's binary_logloss: 0.312888	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.319493
[32]	valid_0's auc: 0.91757	valid_0's binary_logloss: 0.311679	valid_1's auc: 0.908779	valid_1's binary_logloss: 0.318951
[33]	valid_0's auc: 0.917964	valid_0's binary_logloss: 0.310557	valid_1's auc: 0.908819	valid_1's binary_logloss: 0.318463
[34]	valid_0's auc: 0.918382	valid_0's binary_logloss: 0.309535	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.318127
[35]	valid_0's auc: 0.918733	valid_0's binary_logloss: 0.308551	valid_1's auc: 0.908792	valid_1's binary_logloss: 0.317897
[36]	valid_0's auc: 0.919112	valid_0's binary_logloss: 0.307602	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.317699
[37]	valid_0's auc: 0.919463	valid_0's binary_logloss: 0.306776	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.317513
[38]	valid_0's auc: 0.919828	valid_0's binary_logloss: 0.305866	valid_1's auc: 0.908665	valid_1's binary_logloss: 0.317308
[39]	valid_0's auc: 0.920308	valid_0's binary_logloss: 0.304893	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.317152
[40]	valid_0's auc: 0.920795	valid_0's binary_logloss: 0.303863	valid_1's auc: 0.908721	valid_1's binary_logloss: 0.316854
[41]	valid_0's auc: 0.921115	valid_0's binary_logloss: 0.303161	valid_1's auc: 0.908923	valid_1's binary_logloss: 0.316414
[42]	valid_0's auc: 0.921626	valid_0's binary_logloss: 0.30218	valid_1's auc: 0.909034	valid_1's binary_logloss: 0.316124
[43]	valid_0's auc: 0.921967	valid_0's binary_logloss: 0.301384	valid_1's auc: 0.90906	valid_1's binary_logloss: 0.315972
[44]	valid_0's auc: 0.922381	valid_0's binary_logloss: 0.300544	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.315775
[45]	valid_0's auc: 0.922724	valid_0's binary_logloss: 0.299847	valid_1's auc: 0.909255	valid_1's binary_logloss: 0.31551
[46]	valid_0's auc: 0.923109	valid_0's binary_logloss: 0.299055	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.315314
[47]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.298118	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314961
[48]	valid_0's auc: 0.923891	valid_0's binary_logloss: 0.297555	valid_1's auc: 0.909524	valid_1's binary_logloss: 0.3149
[49]	valid_0's auc: 0.924244	valid_0's binary_logloss: 0.296844	valid_1's auc: 0.909481	valid_1's binary_logloss: 0.314913
[50]	valid_0's auc: 0.924564	valid_0's binary_logloss: 0.296173	valid_1's auc: 0.909383	valid_1's binary_logloss: 0.315025
[51]	valid_0's auc: 0.924961	valid_0's binary_logloss: 0.295467	valid_1's auc: 0.909383	valid_1's binary_logloss: 0.314976
[52]	valid_0's auc: 0.925195	valid_0's binary_logloss: 0.294975	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.314991
[53]	valid_0's auc: 0.925647	valid_0's binary_logloss: 0.294161	valid_1's auc: 0.90934	valid_1's binary_logloss: 0.314888
[54]	valid_0's auc: 0.925997	valid_0's binary_logloss: 0.2935	valid_1's auc: 0.909236	valid_1's binary_logloss: 0.315024
[55]	valid_0's auc: 0.926277	valid_0's binary_logloss: 0.2929	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.314992
[56]	valid_0's auc: 0.926582	valid_0's binary_logloss: 0.292287	valid_1's auc: 0.909223	valid_1's binary_logloss: 0.315062
[57]	valid_0's auc: 0.92688	valid_0's binary_logloss: 0.29172	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.315032
[58]	valid_0's auc: 0.927334	valid_0's binary_logloss: 0.291011	valid_1's auc: 0.909121	valid_1's binary_logloss: 0.315143
[59]	valid_0's auc: 0.927683	valid_0's binary_logloss: 0.290395	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.315113
[60]	valid_0's auc: 0.928065	valid_0's binary_logloss: 0.289762	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.315009
[61]	valid_0's auc: 0.928429	valid_0's binary_logloss: 0.289104	valid_1's auc: 0.909258	valid_1's binary_logloss: 0.314842
[62]	valid_0's auc: 0.92862	valid_0's binary_logloss: 0.288702	valid_1's auc: 0.909183	valid_1's binary_logloss: 0.314959
[63]	valid_0's auc: 0.928868	valid_0's binary_logloss: 0.288211	valid_1's auc: 0.909076	valid_1's binary_logloss: 0.315194
[64]	valid_0's auc: 0.929161	valid_0's binary_logloss: 0.287692	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.315242
[65]	valid_0's auc: 0.929563	valid_0's binary_logloss: 0.287013	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.315388
[66]	valid_0's auc: 0.929823	valid_0's binary_logloss: 0.286561	valid_1's auc: 0.908968	valid_1's binary_logloss: 0.315378
[67]	valid_0's auc: 0.930093	valid_0's binary_logloss: 0.286061	valid_1's auc: 0.909037	valid_1's binary_logloss: 0.315321
[68]	valid_0's auc: 0.93035	valid_0's binary_logloss: 0.285546	valid_1's auc: 0.908945	valid_1's binary_logloss: 0.31545
[69]	valid_0's auc: 0.930726	valid_0's binary_logloss: 0.284913	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.315504
[70]	valid_0's auc: 0.930968	valid_0's binary_logloss: 0.28453	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315647
[71]	valid_0's auc: 0.93134	valid_0's binary_logloss: 0.283869	valid_1's auc: 0.908706	valid_1's binary_logloss: 0.315753
[72]	valid_0's auc: 0.93172	valid_0's binary_logloss: 0.283214	valid_1's auc: 0.908642	valid_1's binary_logloss: 0.315869
[73]	valid_0's auc: 0.932009	valid_0's binary_logloss: 0.282652	valid_1's auc: 0.908566	valid_1's binary_logloss: 0.315999
[74]	valid_0's auc: 0.932201	valid_0's binary_logloss: 0.282262	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.31589
[75]	valid_0's auc: 0.932428	valid_0's binary_logloss: 0.281839	valid_1's auc: 0.908487	valid_1's binary_logloss: 0.31607
[76]	valid_0's auc: 0.932791	valid_0's binary_logloss: 0.281226	valid_1's auc: 0.908356	valid_1's binary_logloss: 0.316221
[77]	valid_0's auc: 0.933059	valid_0's binary_logloss: 0.2807	valid_1's auc: 0.908286	valid_1's binary_logloss: 0.316308
[78]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.280385	valid_1's auc: 0.908333	valid_1's binary_logloss: 0.316177
[79]	valid_0's auc: 0.933516	valid_0's binary_logloss: 0.279893	valid_1's auc: 0.908365	valid_1's binary_logloss: 0.316135
[80]	valid_0's auc: 0.933729	valid_0's binary_logloss: 0.27946	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.315971
[81]	valid_0's auc: 0.933952	valid_0's binary_logloss: 0.279028	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.316027
[82]	valid_0's auc: 0.934221	valid_0's binary_logloss: 0.278529	valid_1's auc: 0.908367	valid_1's binary_logloss: 0.316183
[83]	valid_0's auc: 0.934457	valid_0's binary_logloss: 0.278106	valid_1's auc: 0.908348	valid_1's binary_logloss: 0.316245
[84]	valid_0's auc: 0.934695	valid_0's binary_logloss: 0.277675	valid_1's auc: 0.908334	valid_1's binary_logloss: 0.316322
[85]	valid_0's auc: 0.934988	valid_0's binary_logloss: 0.277153	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.31623
[86]	valid_0's auc: 0.935259	valid_0's binary_logloss: 0.276612	valid_1's auc: 0.908249	valid_1's binary_logloss: 0.316403
[87]	valid_0's auc: 0.935495	valid_0's binary_logloss: 0.276187	valid_1's auc: 0.908153	valid_1's binary_logloss: 0.316596
[88]	valid_0's auc: 0.9357	valid_0's binary_logloss: 0.275835	valid_1's auc: 0.908143	valid_1's binary_logloss: 0.316609
[89]	valid_0's auc: 0.935983	valid_0's binary_logloss: 0.27537	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.316608
[90]	valid_0's auc: 0.936187	valid_0's binary_logloss: 0.275004	valid_1's auc: 0.908099	valid_1's binary_logloss: 0.316766
[91]	valid_0's auc: 0.936418	valid_0's binary_logloss: 0.274592	valid_1's auc: 0.908081	valid_1's binary_logloss: 0.31684
[92]	valid_0's auc: 0.936681	valid_0's binary_logloss: 0.274166	valid_1's auc: 0.908078	valid_1's binary_logloss: 0.316839
[93]	valid_0's auc: 0.936846	valid_0's binary_logloss: 0.27383	valid_1's auc: 0.908067	valid_1's binary_logloss: 0.316875
[94]	valid_0's auc: 0.937079	valid_0's binary_logloss: 0.273405	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.316867
[95]	valid_0's auc: 0.937314	valid_0's binary_logloss: 0.273007	valid_1's auc: 0.908061	valid_1's binary_logloss: 0.316877
[96]	valid_0's auc: 0.937517	valid_0's binary_logloss: 0.272584	valid_1's auc: 0.908022	valid_1's binary_logloss: 0.316916
[97]	valid_0's auc: 0.937702	valid_0's binary_logloss: 0.272251	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.317073
[98]	valid_0's auc: 0.937961	valid_0's binary_logloss: 0.271826	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317144
[99]	valid_0's auc: 0.938178	valid_0's binary_logloss: 0.271404	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317241
[100]	valid_0's auc: 0.938427	valid_0's binary_logloss: 0.270949	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.317206
[101]	valid_0's auc: 0.938591	valid_0's binary_logloss: 0.270614	valid_1's auc: 0.907846	valid_1's binary_logloss: 0.31732
[102]	valid_0's auc: 0.938838	valid_0's binary_logloss: 0.270184	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317444
[103]	valid_0's auc: 0.938987	valid_0's binary_logloss: 0.269885	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.31752
[104]	valid_0's auc: 0.939178	valid_0's binary_logloss: 0.269525	valid_1's auc: 0.907699	valid_1's binary_logloss: 0.317614
[105]	valid_0's auc: 0.939406	valid_0's binary_logloss: 0.269026	valid_1's auc: 0.907646	valid_1's binary_logloss: 0.317768
[106]	valid_0's auc: 0.939667	valid_0's binary_logloss: 0.268561	valid_1's auc: 0.907539	valid_1's binary_logloss: 0.318006
[107]	valid_0's auc: 0.939889	valid_0's binary_logloss: 0.268161	valid_1's auc: 0.907603	valid_1's binary_logloss: 0.317868
[108]	valid_0's auc: 0.940077	valid_0's binary_logloss: 0.267819	valid_1's auc: 0.907488	valid_1's binary_logloss: 0.31808
[109]	valid_0's auc: 0.940431	valid_0's binary_logloss: 0.267208	valid_1's auc: 0.907364	valid_1's binary_logloss: 0.318348
[110]	valid_0's auc: 0.940604	valid_0's binary_logloss: 0.266871	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318394
[111]	valid_0's auc: 0.940869	valid_0's binary_logloss: 0.266387	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.318384
[112]	valid_0's auc: 0.941066	valid_0's binary_logloss: 0.266009	valid_1's auc: 0.907229	valid_1's binary_logloss: 0.318669
[113]	valid_0's auc: 0.941253	valid_0's binary_logloss: 0.265676	valid_1's auc: 0.907266	valid_1's binary_logloss: 0.318566
[114]	valid_0's auc: 0.941558	valid_0's binary_logloss: 0.265141	valid_1's auc: 0.907168	valid_1's binary_logloss: 0.318755
[115]	valid_0's auc: 0.941744	valid_0's binary_logloss: 0.264763	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.31875
[116]	valid_0's auc: 0.941938	valid_0's binary_logloss: 0.264427	valid_1's auc: 0.907147	valid_1's binary_logloss: 0.318857
[117]	valid_0's auc: 0.942219	valid_0's binary_logloss: 0.263954	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.31905
[118]	valid_0's auc: 0.942452	valid_0's binary_logloss: 0.263544	valid_1's auc: 0.907074	valid_1's binary_logloss: 0.319091
[119]	valid_0's auc: 0.942624	valid_0's binary_logloss: 0.26321	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.319072
[120]	valid_0's auc: 0.942816	valid_0's binary_logloss: 0.262845	valid_1's auc: 0.907134	valid_1's binary_logloss: 0.318947
[121]	valid_0's auc: 0.943014	valid_0's binary_logloss: 0.26249	valid_1's auc: 0.907025	valid_1's binary_logloss: 0.319165
[122]	valid_0's auc: 0.943171	valid_0's binary_logloss: 0.262168	valid_1's auc: 0.906988	valid_1's binary_logloss: 0.319254
[123]	valid_0's auc: 0.943442	valid_0's binary_logloss: 0.261681	valid_1's auc: 0.90697	valid_1's binary_logloss: 0.319257
[124]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261195	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.319146
[125]	valid_0's auc: 0.943889	valid_0's binary_logloss: 0.260818	valid_1's auc: 0.90698	valid_1's binary_logloss: 0.319304
[126]	valid_0's auc: 0.944043	valid_0's binary_logloss: 0.260521	valid_1's auc: 0.906853	valid_1's binary_logloss: 0.319539
[127]	valid_0's auc: 0.944193	valid_0's binary_logloss: 0.260216	valid_1's auc: 0.906814	valid_1's binary_logloss: 0.319673
[128]	valid_0's auc: 0.944309	valid_0's binary_logloss: 0.259954	valid_1's auc: 0.906718	valid_1's binary_logloss: 0.319883
[129]	valid_0's auc: 0.94455	valid_0's binary_logloss: 0.259526	valid_1's auc: 0.906642	valid_1's binary_logloss: 0.320084
[130]	valid_0's auc: 0.944753	valid_0's binary_logloss: 0.259168	valid_1's auc: 0.906523	valid_1's binary_logloss: 0.320297
[131]	valid_0's auc: 0.944973	valid_0's binary_logloss: 0.258766	valid_1's auc: 0.906307	valid_1's binary_logloss: 0.320604
[132]	valid_0's auc: 0.945145	valid_0's binary_logloss: 0.258424	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.320798
[133]	valid_0's auc: 0.945318	valid_0's binary_logloss: 0.258071	valid_1's auc: 0.9061	valid_1's binary_logloss: 0.320996
[134]	valid_0's auc: 0.945451	valid_0's binary_logloss: 0.257783	valid_1's auc: 0.906152	valid_1's binary_logloss: 0.320968
[135]	valid_0's auc: 0.945733	valid_0's binary_logloss: 0.257292	valid_1's auc: 0.90607	valid_1's binary_logloss: 0.321139
[136]	valid_0's auc: 0.945855	valid_0's binary_logloss: 0.257031	valid_1's auc: 0.906069	valid_1's binary_logloss: 0.321141
[137]	valid_0's auc: 0.946126	valid_0's binary_logloss: 0.256557	valid_1's auc: 0.906074	valid_1's binary_logloss: 0.321185
[138]	valid_0's auc: 0.946246	valid_0's binary_logloss: 0.256295	valid_1's auc: 0.906142	valid_1's binary_logloss: 0.321141
[139]	valid_0's auc: 0.946394	valid_0's binary_logloss: 0.256023	valid_1's auc: 0.906082	valid_1's binary_logloss: 0.321251
[140]	valid_0's auc: 0.946547	valid_0's binary_logloss: 0.255736	valid_1's auc: 0.905991	valid_1's binary_logloss: 0.321412
[141]	valid_0's auc: 0.946643	valid_0's binary_logloss: 0.255552	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321492
[142]	valid_0's auc: 0.946765	valid_0's binary_logloss: 0.255317	valid_1's auc: 0.905916	valid_1's binary_logloss: 0.321635
[143]	valid_0's auc: 0.946949	valid_0's binary_logloss: 0.254972	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.321442
[144]	valid_0's auc: 0.947192	valid_0's binary_logloss: 0.254554	valid_1's auc: 0.905936	valid_1's binary_logloss: 0.321675
[145]	valid_0's auc: 0.947377	valid_0's binary_logloss: 0.254218	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.321929
[146]	valid_0's auc: 0.947597	valid_0's binary_logloss: 0.253808	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.321868
[147]	valid_0's auc: 0.947805	valid_0's binary_logloss: 0.253426	valid_1's auc: 0.905835	valid_1's binary_logloss: 0.321933
Early stopping, best iteration is:
[47]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.298118	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314961
[1]	valid_0's auc: 0.887844	valid_0's binary_logloss: 0.516909	valid_1's auc: 0.893598	valid_1's binary_logloss: 0.508126
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890776	valid_0's binary_logloss: 0.487736	valid_1's auc: 0.897625	valid_1's binary_logloss: 0.478463
[3]	valid_0's auc: 0.892243	valid_0's binary_logloss: 0.46442	valid_1's auc: 0.8988	valid_1's binary_logloss: 0.454774
[4]	valid_0's auc: 0.894428	valid_0's binary_logloss: 0.444999	valid_1's auc: 0.899598	valid_1's binary_logloss: 0.435309
[5]	valid_0's auc: 0.895593	valid_0's binary_logloss: 0.428839	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419556
[6]	valid_0's auc: 0.899007	valid_0's binary_logloss: 0.415152	valid_1's auc: 0.902729	valid_1's binary_logloss: 0.40594
[7]	valid_0's auc: 0.900436	valid_0's binary_logloss: 0.403446	valid_1's auc: 0.903024	valid_1's binary_logloss: 0.394665
[8]	valid_0's auc: 0.901051	valid_0's binary_logloss: 0.393489	valid_1's auc: 0.902967	valid_1's binary_logloss: 0.384948
[9]	valid_0's auc: 0.901858	valid_0's binary_logloss: 0.384773	valid_1's auc: 0.903102	valid_1's binary_logloss: 0.376834
[10]	valid_0's auc: 0.903132	valid_0's binary_logloss: 0.376975	valid_1's auc: 0.903628	valid_1's binary_logloss: 0.369655
[11]	valid_0's auc: 0.904	valid_0's binary_logloss: 0.370072	valid_1's auc: 0.903765	valid_1's binary_logloss: 0.363506
[12]	valid_0's auc: 0.905057	valid_0's binary_logloss: 0.364037	valid_1's auc: 0.904378	valid_1's binary_logloss: 0.358122
[13]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.35866	valid_1's auc: 0.904218	valid_1's binary_logloss: 0.353501
[14]	valid_0's auc: 0.906631	valid_0's binary_logloss: 0.353842	valid_1's auc: 0.904667	valid_1's binary_logloss: 0.349238
[15]	valid_0's auc: 0.907502	valid_0's binary_logloss: 0.349434	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.345342
[16]	valid_0's auc: 0.90815	valid_0's binary_logloss: 0.345598	valid_1's auc: 0.905737	valid_1's binary_logloss: 0.342243
[17]	valid_0's auc: 0.908763	valid_0's binary_logloss: 0.342075	valid_1's auc: 0.906229	valid_1's binary_logloss: 0.338999
[18]	valid_0's auc: 0.909472	valid_0's binary_logloss: 0.33895	valid_1's auc: 0.906632	valid_1's binary_logloss: 0.3364
[19]	valid_0's auc: 0.910184	valid_0's binary_logloss: 0.33601	valid_1's auc: 0.90668	valid_1's binary_logloss: 0.334514
[20]	valid_0's auc: 0.910866	valid_0's binary_logloss: 0.333221	valid_1's auc: 0.906811	valid_1's binary_logloss: 0.332442
[21]	valid_0's auc: 0.911311	valid_0's binary_logloss: 0.330891	valid_1's auc: 0.906728	valid_1's binary_logloss: 0.330824
[22]	valid_0's auc: 0.912013	valid_0's binary_logloss: 0.328569	valid_1's auc: 0.906759	valid_1's binary_logloss: 0.32944
[23]	valid_0's auc: 0.912723	valid_0's binary_logloss: 0.326299	valid_1's auc: 0.907021	valid_1's binary_logloss: 0.328001
[24]	valid_0's auc: 0.913276	valid_0's binary_logloss: 0.324362	valid_1's auc: 0.907054	valid_1's binary_logloss: 0.326907
[25]	valid_0's auc: 0.913833	valid_0's binary_logloss: 0.322553	valid_1's auc: 0.907087	valid_1's binary_logloss: 0.325903
[26]	valid_0's auc: 0.914514	valid_0's binary_logloss: 0.320627	valid_1's auc: 0.907221	valid_1's binary_logloss: 0.324823
[27]	valid_0's auc: 0.915013	valid_0's binary_logloss: 0.318967	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.324008
[28]	valid_0's auc: 0.915582	valid_0's binary_logloss: 0.317412	valid_1's auc: 0.907248	valid_1's binary_logloss: 0.323309
[29]	valid_0's auc: 0.916129	valid_0's binary_logloss: 0.315921	valid_1's auc: 0.907335	valid_1's binary_logloss: 0.322681
[30]	valid_0's auc: 0.916649	valid_0's binary_logloss: 0.314505	valid_1's auc: 0.907438	valid_1's binary_logloss: 0.321974
[31]	valid_0's auc: 0.917204	valid_0's binary_logloss: 0.313113	valid_1's auc: 0.907455	valid_1's binary_logloss: 0.321466
[32]	valid_0's auc: 0.917806	valid_0's binary_logloss: 0.311733	valid_1's auc: 0.907527	valid_1's binary_logloss: 0.320952
[33]	valid_0's auc: 0.918199	valid_0's binary_logloss: 0.310677	valid_1's auc: 0.90752	valid_1's binary_logloss: 0.320625
[34]	valid_0's auc: 0.918605	valid_0's binary_logloss: 0.309584	valid_1's auc: 0.907562	valid_1's binary_logloss: 0.320235
[35]	valid_0's auc: 0.919112	valid_0's binary_logloss: 0.308438	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.319694
[36]	valid_0's auc: 0.919618	valid_0's binary_logloss: 0.307289	valid_1's auc: 0.907846	valid_1's binary_logloss: 0.319321
[37]	valid_0's auc: 0.920128	valid_0's binary_logloss: 0.306185	valid_1's auc: 0.907789	valid_1's binary_logloss: 0.31915
[38]	valid_0's auc: 0.920495	valid_0's binary_logloss: 0.305296	valid_1's auc: 0.907682	valid_1's binary_logloss: 0.319109
[39]	valid_0's auc: 0.920946	valid_0's binary_logloss: 0.304239	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.318808
[40]	valid_0's auc: 0.921364	valid_0's binary_logloss: 0.303311	valid_1's auc: 0.907691	valid_1's binary_logloss: 0.318693
[41]	valid_0's auc: 0.921773	valid_0's binary_logloss: 0.302446	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.318445
[42]	valid_0's auc: 0.922186	valid_0's binary_logloss: 0.301579	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.318465
[43]	valid_0's auc: 0.922503	valid_0's binary_logloss: 0.300906	valid_1's auc: 0.907673	valid_1's binary_logloss: 0.318345
[44]	valid_0's auc: 0.922926	valid_0's binary_logloss: 0.300042	valid_1's auc: 0.907635	valid_1's binary_logloss: 0.318257
[45]	valid_0's auc: 0.923263	valid_0's binary_logloss: 0.299331	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.318079
[46]	valid_0's auc: 0.923617	valid_0's binary_logloss: 0.298539	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317876
[47]	valid_0's auc: 0.924114	valid_0's binary_logloss: 0.297662	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317968
[48]	valid_0's auc: 0.924503	valid_0's binary_logloss: 0.296954	valid_1's auc: 0.907788	valid_1's binary_logloss: 0.317785
[49]	valid_0's auc: 0.92476	valid_0's binary_logloss: 0.296343	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.317598
[50]	valid_0's auc: 0.925129	valid_0's binary_logloss: 0.295661	valid_1's auc: 0.907782	valid_1's binary_logloss: 0.31771
[51]	valid_0's auc: 0.925509	valid_0's binary_logloss: 0.294896	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.317825
[52]	valid_0's auc: 0.925952	valid_0's binary_logloss: 0.294104	valid_1's auc: 0.907701	valid_1's binary_logloss: 0.317753
[53]	valid_0's auc: 0.926345	valid_0's binary_logloss: 0.293368	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.317706
[54]	valid_0's auc: 0.926601	valid_0's binary_logloss: 0.292847	valid_1's auc: 0.907553	valid_1's binary_logloss: 0.317872
[55]	valid_0's auc: 0.926831	valid_0's binary_logloss: 0.292356	valid_1's auc: 0.907538	valid_1's binary_logloss: 0.317816
[56]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.291782	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.317695
[57]	valid_0's auc: 0.927485	valid_0's binary_logloss: 0.291119	valid_1's auc: 0.907529	valid_1's binary_logloss: 0.317839
[58]	valid_0's auc: 0.927817	valid_0's binary_logloss: 0.290466	valid_1's auc: 0.907475	valid_1's binary_logloss: 0.317907
[59]	valid_0's auc: 0.928079	valid_0's binary_logloss: 0.289918	valid_1's auc: 0.907395	valid_1's binary_logloss: 0.317979
[60]	valid_0's auc: 0.928363	valid_0's binary_logloss: 0.289377	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.318084
[61]	valid_0's auc: 0.928694	valid_0's binary_logloss: 0.288835	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318084
[62]	valid_0's auc: 0.928954	valid_0's binary_logloss: 0.28835	valid_1's auc: 0.907237	valid_1's binary_logloss: 0.318221
[63]	valid_0's auc: 0.929319	valid_0's binary_logloss: 0.28774	valid_1's auc: 0.907257	valid_1's binary_logloss: 0.3182
[64]	valid_0's auc: 0.929634	valid_0's binary_logloss: 0.287191	valid_1's auc: 0.907167	valid_1's binary_logloss: 0.318289
[65]	valid_0's auc: 0.929985	valid_0's binary_logloss: 0.286569	valid_1's auc: 0.90696	valid_1's binary_logloss: 0.318675
[66]	valid_0's auc: 0.930249	valid_0's binary_logloss: 0.286086	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318632
[67]	valid_0's auc: 0.930512	valid_0's binary_logloss: 0.285546	valid_1's auc: 0.906977	valid_1's binary_logloss: 0.318746
[68]	valid_0's auc: 0.931011	valid_0's binary_logloss: 0.284738	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.318823
[69]	valid_0's auc: 0.931402	valid_0's binary_logloss: 0.284061	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.318922
[70]	valid_0's auc: 0.931641	valid_0's binary_logloss: 0.283641	valid_1's auc: 0.906847	valid_1's binary_logloss: 0.319008
[71]	valid_0's auc: 0.931905	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318965
[72]	valid_0's auc: 0.932175	valid_0's binary_logloss: 0.282667	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.319064
[73]	valid_0's auc: 0.932404	valid_0's binary_logloss: 0.282207	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.319023
[74]	valid_0's auc: 0.932665	valid_0's binary_logloss: 0.281711	valid_1's auc: 0.906668	valid_1's binary_logloss: 0.319203
[75]	valid_0's auc: 0.932941	valid_0's binary_logloss: 0.281234	valid_1's auc: 0.906611	valid_1's binary_logloss: 0.319329
[76]	valid_0's auc: 0.933306	valid_0's binary_logloss: 0.280605	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.319485
[77]	valid_0's auc: 0.933602	valid_0's binary_logloss: 0.280037	valid_1's auc: 0.906549	valid_1's binary_logloss: 0.319398
[78]	valid_0's auc: 0.933963	valid_0's binary_logloss: 0.27942	valid_1's auc: 0.906464	valid_1's binary_logloss: 0.319541
[79]	valid_0's auc: 0.934249	valid_0's binary_logloss: 0.278885	valid_1's auc: 0.906414	valid_1's binary_logloss: 0.319641
[80]	valid_0's auc: 0.93456	valid_0's binary_logloss: 0.278314	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319676
[81]	valid_0's auc: 0.934874	valid_0's binary_logloss: 0.277757	valid_1's auc: 0.90656	valid_1's binary_logloss: 0.319506
[82]	valid_0's auc: 0.935088	valid_0's binary_logloss: 0.277344	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.319624
[83]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.276902	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.319607
[84]	valid_0's auc: 0.935552	valid_0's binary_logloss: 0.27647	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.31965
[85]	valid_0's auc: 0.93587	valid_0's binary_logloss: 0.275926	valid_1's auc: 0.906437	valid_1's binary_logloss: 0.319734
[86]	valid_0's auc: 0.9361	valid_0's binary_logloss: 0.275494	valid_1's auc: 0.90638	valid_1's binary_logloss: 0.319875
[87]	valid_0's auc: 0.93626	valid_0's binary_logloss: 0.27522	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.319903
[88]	valid_0's auc: 0.936677	valid_0's binary_logloss: 0.274518	valid_1's auc: 0.90637	valid_1's binary_logloss: 0.319925
[89]	valid_0's auc: 0.936916	valid_0's binary_logloss: 0.274088	valid_1's auc: 0.906279	valid_1's binary_logloss: 0.320108
[90]	valid_0's auc: 0.937196	valid_0's binary_logloss: 0.273554	valid_1's auc: 0.906132	valid_1's binary_logloss: 0.320352
[91]	valid_0's auc: 0.937367	valid_0's binary_logloss: 0.273251	valid_1's auc: 0.905999	valid_1's binary_logloss: 0.320638
[92]	valid_0's auc: 0.937682	valid_0's binary_logloss: 0.272694	valid_1's auc: 0.905844	valid_1's binary_logloss: 0.320942
[93]	valid_0's auc: 0.937867	valid_0's binary_logloss: 0.272389	valid_1's auc: 0.905784	valid_1's binary_logloss: 0.321063
[94]	valid_0's auc: 0.938098	valid_0's binary_logloss: 0.271963	valid_1's auc: 0.905736	valid_1's binary_logloss: 0.321136
[95]	valid_0's auc: 0.938341	valid_0's binary_logloss: 0.271481	valid_1's auc: 0.905709	valid_1's binary_logloss: 0.321295
[96]	valid_0's auc: 0.938606	valid_0's binary_logloss: 0.271001	valid_1's auc: 0.90563	valid_1's binary_logloss: 0.321473
[97]	valid_0's auc: 0.938826	valid_0's binary_logloss: 0.270594	valid_1's auc: 0.905659	valid_1's binary_logloss: 0.321457
[98]	valid_0's auc: 0.939042	valid_0's binary_logloss: 0.270193	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.32139
[99]	valid_0's auc: 0.939189	valid_0's binary_logloss: 0.269888	valid_1's auc: 0.905687	valid_1's binary_logloss: 0.321413
[100]	valid_0's auc: 0.939459	valid_0's binary_logloss: 0.269416	valid_1's auc: 0.9058	valid_1's binary_logloss: 0.32127
[101]	valid_0's auc: 0.939642	valid_0's binary_logloss: 0.26904	valid_1's auc: 0.905716	valid_1's binary_logloss: 0.321461
[102]	valid_0's auc: 0.939886	valid_0's binary_logloss: 0.268564	valid_1's auc: 0.905656	valid_1's binary_logloss: 0.321566
[103]	valid_0's auc: 0.940158	valid_0's binary_logloss: 0.268089	valid_1's auc: 0.905678	valid_1's binary_logloss: 0.321517
[104]	valid_0's auc: 0.940334	valid_0's binary_logloss: 0.267732	valid_1's auc: 0.905603	valid_1's binary_logloss: 0.321692
[105]	valid_0's auc: 0.940561	valid_0's binary_logloss: 0.267334	valid_1's auc: 0.90566	valid_1's binary_logloss: 0.321626
[106]	valid_0's auc: 0.940828	valid_0's binary_logloss: 0.266814	valid_1's auc: 0.90567	valid_1's binary_logloss: 0.321619
[107]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.266463	valid_1's auc: 0.905513	valid_1's binary_logloss: 0.321846
[108]	valid_0's auc: 0.941143	valid_0's binary_logloss: 0.266153	valid_1's auc: 0.905256	valid_1's binary_logloss: 0.322338
[109]	valid_0's auc: 0.94127	valid_0's binary_logloss: 0.265891	valid_1's auc: 0.905153	valid_1's binary_logloss: 0.322576
[110]	valid_0's auc: 0.941435	valid_0's binary_logloss: 0.265585	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.322452
[111]	valid_0's auc: 0.941601	valid_0's binary_logloss: 0.265193	valid_1's auc: 0.905164	valid_1's binary_logloss: 0.322605
[112]	valid_0's auc: 0.941779	valid_0's binary_logloss: 0.26484	valid_1's auc: 0.905029	valid_1's binary_logloss: 0.32288
[113]	valid_0's auc: 0.94198	valid_0's binary_logloss: 0.264483	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.322937
[114]	valid_0's auc: 0.942281	valid_0's binary_logloss: 0.263955	valid_1's auc: 0.905008	valid_1's binary_logloss: 0.322958
[115]	valid_0's auc: 0.942433	valid_0's binary_logloss: 0.263622	valid_1's auc: 0.905023	valid_1's binary_logloss: 0.323001
[116]	valid_0's auc: 0.942632	valid_0's binary_logloss: 0.263257	valid_1's auc: 0.905004	valid_1's binary_logloss: 0.323077
[117]	valid_0's auc: 0.942825	valid_0's binary_logloss: 0.262855	valid_1's auc: 0.904993	valid_1's binary_logloss: 0.32315
[118]	valid_0's auc: 0.943037	valid_0's binary_logloss: 0.26246	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.323358
[119]	valid_0's auc: 0.943208	valid_0's binary_logloss: 0.262132	valid_1's auc: 0.904813	valid_1's binary_logloss: 0.323498
[120]	valid_0's auc: 0.943496	valid_0's binary_logloss: 0.261607	valid_1's auc: 0.904807	valid_1's binary_logloss: 0.323481
[121]	valid_0's auc: 0.943662	valid_0's binary_logloss: 0.261226	valid_1's auc: 0.904762	valid_1's binary_logloss: 0.323639
[122]	valid_0's auc: 0.943751	valid_0's binary_logloss: 0.26106	valid_1's auc: 0.904718	valid_1's binary_logloss: 0.323736
[123]	valid_0's auc: 0.943916	valid_0's binary_logloss: 0.260766	valid_1's auc: 0.904588	valid_1's binary_logloss: 0.323936
[124]	valid_0's auc: 0.944155	valid_0's binary_logloss: 0.260319	valid_1's auc: 0.904505	valid_1's binary_logloss: 0.324082
[125]	valid_0's auc: 0.944335	valid_0's binary_logloss: 0.259945	valid_1's auc: 0.904535	valid_1's binary_logloss: 0.324092
[126]	valid_0's auc: 0.944549	valid_0's binary_logloss: 0.259565	valid_1's auc: 0.90448	valid_1's binary_logloss: 0.324222
[127]	valid_0's auc: 0.944763	valid_0's binary_logloss: 0.259165	valid_1's auc: 0.904411	valid_1's binary_logloss: 0.324372
[128]	valid_0's auc: 0.944934	valid_0's binary_logloss: 0.258837	valid_1's auc: 0.90435	valid_1's binary_logloss: 0.32452
[129]	valid_0's auc: 0.945078	valid_0's binary_logloss: 0.258524	valid_1's auc: 0.904248	valid_1's binary_logloss: 0.324813
[130]	valid_0's auc: 0.945396	valid_0's binary_logloss: 0.257954	valid_1's auc: 0.9041	valid_1's binary_logloss: 0.325105
[131]	valid_0's auc: 0.945566	valid_0's binary_logloss: 0.257624	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.325193
[132]	valid_0's auc: 0.945728	valid_0's binary_logloss: 0.257317	valid_1's auc: 0.903912	valid_1's binary_logloss: 0.325447
[133]	valid_0's auc: 0.94593	valid_0's binary_logloss: 0.256915	valid_1's auc: 0.903953	valid_1's binary_logloss: 0.325429
[134]	valid_0's auc: 0.946124	valid_0's binary_logloss: 0.256548	valid_1's auc: 0.903922	valid_1's binary_logloss: 0.325547
[135]	valid_0's auc: 0.946272	valid_0's binary_logloss: 0.256207	valid_1's auc: 0.903917	valid_1's binary_logloss: 0.325616
[136]	valid_0's auc: 0.946445	valid_0's binary_logloss: 0.25588	valid_1's auc: 0.903982	valid_1's binary_logloss: 0.325544
[137]	valid_0's auc: 0.94666	valid_0's binary_logloss: 0.255467	valid_1's auc: 0.903978	valid_1's binary_logloss: 0.325586
[138]	valid_0's auc: 0.946805	valid_0's binary_logloss: 0.25516	valid_1's auc: 0.904015	valid_1's binary_logloss: 0.325594
[139]	valid_0's auc: 0.946965	valid_0's binary_logloss: 0.254797	valid_1's auc: 0.90404	valid_1's binary_logloss: 0.325611
[140]	valid_0's auc: 0.947155	valid_0's binary_logloss: 0.254442	valid_1's auc: 0.904027	valid_1's binary_logloss: 0.325582
[141]	valid_0's auc: 0.947297	valid_0's binary_logloss: 0.254153	valid_1's auc: 0.904033	valid_1's binary_logloss: 0.325561
[142]	valid_0's auc: 0.947408	valid_0's binary_logloss: 0.253916	valid_1's auc: 0.904004	valid_1's binary_logloss: 0.325657
[143]	valid_0's auc: 0.947562	valid_0's binary_logloss: 0.253625	valid_1's auc: 0.903785	valid_1's binary_logloss: 0.326068
[144]	valid_0's auc: 0.94773	valid_0's binary_logloss: 0.25331	valid_1's auc: 0.903871	valid_1's binary_logloss: 0.325958
[145]	valid_0's auc: 0.947867	valid_0's binary_logloss: 0.253029	valid_1's auc: 0.903845	valid_1's binary_logloss: 0.325999
[146]	valid_0's auc: 0.948114	valid_0's binary_logloss: 0.252568	valid_1's auc: 0.90366	valid_1's binary_logloss: 0.326302
[147]	valid_0's auc: 0.948248	valid_0's binary_logloss: 0.252289	valid_1's auc: 0.903538	valid_1's binary_logloss: 0.326518
[148]	valid_0's auc: 0.948389	valid_0's binary_logloss: 0.251996	valid_1's auc: 0.903572	valid_1's binary_logloss: 0.326488
[149]	valid_0's auc: 0.94867	valid_0's binary_logloss: 0.251478	valid_1's auc: 0.903554	valid_1's binary_logloss: 0.326562
Early stopping, best iteration is:
[49]	valid_0's auc: 0.92476	valid_0's binary_logloss: 0.296343	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.317598
[1]	valid_0's auc: 0.888393	valid_0's binary_logloss: 0.516795	valid_1's auc: 0.894288	valid_1's binary_logloss: 0.508216
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891394	valid_0's binary_logloss: 0.487867	valid_1's auc: 0.896915	valid_1's binary_logloss: 0.478643
[3]	valid_0's auc: 0.89265	valid_0's binary_logloss: 0.464849	valid_1's auc: 0.89812	valid_1's binary_logloss: 0.455163
[4]	valid_0's auc: 0.894437	valid_0's binary_logloss: 0.445621	valid_1's auc: 0.899483	valid_1's binary_logloss: 0.436039
[5]	valid_0's auc: 0.896955	valid_0's binary_logloss: 0.429571	valid_1's auc: 0.901051	valid_1's binary_logloss: 0.420482
[6]	valid_0's auc: 0.898332	valid_0's binary_logloss: 0.415928	valid_1's auc: 0.901613	valid_1's binary_logloss: 0.406859
[7]	valid_0's auc: 0.899861	valid_0's binary_logloss: 0.404206	valid_1's auc: 0.902556	valid_1's binary_logloss: 0.395336
[8]	valid_0's auc: 0.900488	valid_0's binary_logloss: 0.394139	valid_1's auc: 0.90247	valid_1's binary_logloss: 0.385733
[9]	valid_0's auc: 0.901452	valid_0's binary_logloss: 0.385418	valid_1's auc: 0.903433	valid_1's binary_logloss: 0.377078
[10]	valid_0's auc: 0.902105	valid_0's binary_logloss: 0.377963	valid_1's auc: 0.903624	valid_1's binary_logloss: 0.370046
[11]	valid_0's auc: 0.902945	valid_0's binary_logloss: 0.371098	valid_1's auc: 0.904239	valid_1's binary_logloss: 0.363529
[12]	valid_0's auc: 0.903515	valid_0's binary_logloss: 0.365223	valid_1's auc: 0.904537	valid_1's binary_logloss: 0.358078
[13]	valid_0's auc: 0.904605	valid_0's binary_logloss: 0.35982	valid_1's auc: 0.904887	valid_1's binary_logloss: 0.353394
[14]	valid_0's auc: 0.905644	valid_0's binary_logloss: 0.354895	valid_1's auc: 0.90514	valid_1's binary_logloss: 0.349229
[15]	valid_0's auc: 0.906416	valid_0's binary_logloss: 0.35056	valid_1's auc: 0.905629	valid_1's binary_logloss: 0.345341
[16]	valid_0's auc: 0.906936	valid_0's binary_logloss: 0.346773	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.341963
[17]	valid_0's auc: 0.907718	valid_0's binary_logloss: 0.343116	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.338764
[18]	valid_0's auc: 0.908265	valid_0's binary_logloss: 0.33999	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.336028
[19]	valid_0's auc: 0.909204	valid_0's binary_logloss: 0.336866	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.333716
[20]	valid_0's auc: 0.909879	valid_0's binary_logloss: 0.334199	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.331886
[21]	valid_0's auc: 0.91049	valid_0's binary_logloss: 0.331733	valid_1's auc: 0.906944	valid_1's binary_logloss: 0.330278
[22]	valid_0's auc: 0.911221	valid_0's binary_logloss: 0.329417	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.328685
[23]	valid_0's auc: 0.91199	valid_0's binary_logloss: 0.327145	valid_1's auc: 0.907289	valid_1's binary_logloss: 0.32728
[24]	valid_0's auc: 0.912599	valid_0's binary_logloss: 0.325046	valid_1's auc: 0.907322	valid_1's binary_logloss: 0.326084
[25]	valid_0's auc: 0.913126	valid_0's binary_logloss: 0.323271	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.325168
[26]	valid_0's auc: 0.913635	valid_0's binary_logloss: 0.321568	valid_1's auc: 0.907363	valid_1's binary_logloss: 0.324235
[27]	valid_0's auc: 0.914109	valid_0's binary_logloss: 0.319968	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.323425
[28]	valid_0's auc: 0.914755	valid_0's binary_logloss: 0.318217	valid_1's auc: 0.907439	valid_1's binary_logloss: 0.322682
[29]	valid_0's auc: 0.91531	valid_0's binary_logloss: 0.316651	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.322161
[30]	valid_0's auc: 0.915799	valid_0's binary_logloss: 0.315432	valid_1's auc: 0.907579	valid_1's binary_logloss: 0.32147
[31]	valid_0's auc: 0.916265	valid_0's binary_logloss: 0.314172	valid_1's auc: 0.907614	valid_1's binary_logloss: 0.321033
[32]	valid_0's auc: 0.916621	valid_0's binary_logloss: 0.313109	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.320231
[33]	valid_0's auc: 0.917134	valid_0's binary_logloss: 0.311835	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.319894
[34]	valid_0's auc: 0.917421	valid_0's binary_logloss: 0.310915	valid_1's auc: 0.90805	valid_1's binary_logloss: 0.319356
[35]	valid_0's auc: 0.917912	valid_0's binary_logloss: 0.309739	valid_1's auc: 0.907945	valid_1's binary_logloss: 0.319148
[36]	valid_0's auc: 0.918368	valid_0's binary_logloss: 0.308658	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.318764
[37]	valid_0's auc: 0.918869	valid_0's binary_logloss: 0.307508	valid_1's auc: 0.908228	valid_1's binary_logloss: 0.318273
[38]	valid_0's auc: 0.919281	valid_0's binary_logloss: 0.306443	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.317879
[39]	valid_0's auc: 0.919868	valid_0's binary_logloss: 0.305344	valid_1's auc: 0.90828	valid_1's binary_logloss: 0.317828
[40]	valid_0's auc: 0.920222	valid_0's binary_logloss: 0.30452	valid_1's auc: 0.908383	valid_1's binary_logloss: 0.317532
[41]	valid_0's auc: 0.92061	valid_0's binary_logloss: 0.303651	valid_1's auc: 0.908374	valid_1's binary_logloss: 0.317365
[42]	valid_0's auc: 0.920924	valid_0's binary_logloss: 0.302944	valid_1's auc: 0.908391	valid_1's binary_logloss: 0.317127
[43]	valid_0's auc: 0.921362	valid_0's binary_logloss: 0.302061	valid_1's auc: 0.908455	valid_1's binary_logloss: 0.316929
[44]	valid_0's auc: 0.921796	valid_0's binary_logloss: 0.301145	valid_1's auc: 0.908605	valid_1's binary_logloss: 0.316586
[45]	valid_0's auc: 0.922275	valid_0's binary_logloss: 0.300213	valid_1's auc: 0.90866	valid_1's binary_logloss: 0.316503
[46]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.299581	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.316401
[47]	valid_0's auc: 0.923	valid_0's binary_logloss: 0.298806	valid_1's auc: 0.908634	valid_1's binary_logloss: 0.316502
[48]	valid_0's auc: 0.923402	valid_0's binary_logloss: 0.298057	valid_1's auc: 0.908615	valid_1's binary_logloss: 0.316498
[49]	valid_0's auc: 0.923728	valid_0's binary_logloss: 0.297433	valid_1's auc: 0.908437	valid_1's binary_logloss: 0.316696
[50]	valid_0's auc: 0.924155	valid_0's binary_logloss: 0.296703	valid_1's auc: 0.908504	valid_1's binary_logloss: 0.316532
[51]	valid_0's auc: 0.924552	valid_0's binary_logloss: 0.295918	valid_1's auc: 0.9085	valid_1's binary_logloss: 0.316456
[52]	valid_0's auc: 0.92501	valid_0's binary_logloss: 0.295165	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.316549
[53]	valid_0's auc: 0.925514	valid_0's binary_logloss: 0.294276	valid_1's auc: 0.908323	valid_1's binary_logloss: 0.316731
[54]	valid_0's auc: 0.92582	valid_0's binary_logloss: 0.293742	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316571
[55]	valid_0's auc: 0.926104	valid_0's binary_logloss: 0.29319	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.316514
[56]	valid_0's auc: 0.926502	valid_0's binary_logloss: 0.292466	valid_1's auc: 0.90838	valid_1's binary_logloss: 0.316596
[57]	valid_0's auc: 0.926723	valid_0's binary_logloss: 0.292045	valid_1's auc: 0.908338	valid_1's binary_logloss: 0.316655
[58]	valid_0's auc: 0.927048	valid_0's binary_logloss: 0.291402	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316719
[59]	valid_0's auc: 0.927413	valid_0's binary_logloss: 0.290762	valid_1's auc: 0.908226	valid_1's binary_logloss: 0.316828
[60]	valid_0's auc: 0.927752	valid_0's binary_logloss: 0.290182	valid_1's auc: 0.9083	valid_1's binary_logloss: 0.316679
[61]	valid_0's auc: 0.927996	valid_0's binary_logloss: 0.289754	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.316671
[62]	valid_0's auc: 0.928274	valid_0's binary_logloss: 0.28928	valid_1's auc: 0.908147	valid_1's binary_logloss: 0.316879
[63]	valid_0's auc: 0.928585	valid_0's binary_logloss: 0.288738	valid_1's auc: 0.908083	valid_1's binary_logloss: 0.317009
[64]	valid_0's auc: 0.928981	valid_0's binary_logloss: 0.28808	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.317155
[65]	valid_0's auc: 0.929281	valid_0's binary_logloss: 0.287522	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.317222
[66]	valid_0's auc: 0.92959	valid_0's binary_logloss: 0.286971	valid_1's auc: 0.907884	valid_1's binary_logloss: 0.317358
[67]	valid_0's auc: 0.929809	valid_0's binary_logloss: 0.286564	valid_1's auc: 0.907889	valid_1's binary_logloss: 0.317357
[68]	valid_0's auc: 0.930079	valid_0's binary_logloss: 0.286062	valid_1's auc: 0.907909	valid_1's binary_logloss: 0.31736
[69]	valid_0's auc: 0.930368	valid_0's binary_logloss: 0.28555	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317541
[70]	valid_0's auc: 0.930619	valid_0's binary_logloss: 0.285058	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317716
[71]	valid_0's auc: 0.930926	valid_0's binary_logloss: 0.284522	valid_1's auc: 0.907659	valid_1's binary_logloss: 0.317847
[72]	valid_0's auc: 0.931329	valid_0's binary_logloss: 0.283894	valid_1's auc: 0.907585	valid_1's binary_logloss: 0.317922
[73]	valid_0's auc: 0.931737	valid_0's binary_logloss: 0.283213	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.318054
[74]	valid_0's auc: 0.931865	valid_0's binary_logloss: 0.282959	valid_1's auc: 0.907416	valid_1's binary_logloss: 0.318242
[75]	valid_0's auc: 0.932046	valid_0's binary_logloss: 0.282589	valid_1's auc: 0.907288	valid_1's binary_logloss: 0.318441
[76]	valid_0's auc: 0.93233	valid_0's binary_logloss: 0.282117	valid_1's auc: 0.907243	valid_1's binary_logloss: 0.3185
[77]	valid_0's auc: 0.932649	valid_0's binary_logloss: 0.28155	valid_1's auc: 0.907118	valid_1's binary_logloss: 0.318655
[78]	valid_0's auc: 0.93293	valid_0's binary_logloss: 0.281041	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.318661
[79]	valid_0's auc: 0.93325	valid_0's binary_logloss: 0.280472	valid_1's auc: 0.907075	valid_1's binary_logloss: 0.318711
[80]	valid_0's auc: 0.933532	valid_0's binary_logloss: 0.280004	valid_1's auc: 0.90702	valid_1's binary_logloss: 0.318809
[81]	valid_0's auc: 0.933806	valid_0's binary_logloss: 0.279547	valid_1's auc: 0.90701	valid_1's binary_logloss: 0.318773
[82]	valid_0's auc: 0.934014	valid_0's binary_logloss: 0.279207	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318856
[83]	valid_0's auc: 0.934285	valid_0's binary_logloss: 0.278727	valid_1's auc: 0.9069	valid_1's binary_logloss: 0.319037
[84]	valid_0's auc: 0.934518	valid_0's binary_logloss: 0.278255	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.319305
[85]	valid_0's auc: 0.934673	valid_0's binary_logloss: 0.277969	valid_1's auc: 0.906769	valid_1's binary_logloss: 0.319276
[86]	valid_0's auc: 0.934888	valid_0's binary_logloss: 0.277615	valid_1's auc: 0.906717	valid_1's binary_logloss: 0.319368
[87]	valid_0's auc: 0.93509	valid_0's binary_logloss: 0.277233	valid_1's auc: 0.906617	valid_1's binary_logloss: 0.31952
[88]	valid_0's auc: 0.935378	valid_0's binary_logloss: 0.276709	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.319544
[89]	valid_0's auc: 0.935603	valid_0's binary_logloss: 0.276289	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319654
[90]	valid_0's auc: 0.935846	valid_0's binary_logloss: 0.275848	valid_1's auc: 0.906561	valid_1's binary_logloss: 0.319663
[91]	valid_0's auc: 0.936049	valid_0's binary_logloss: 0.275501	valid_1's auc: 0.906564	valid_1's binary_logloss: 0.319692
[92]	valid_0's auc: 0.936214	valid_0's binary_logloss: 0.275136	valid_1's auc: 0.906474	valid_1's binary_logloss: 0.319905
[93]	valid_0's auc: 0.936466	valid_0's binary_logloss: 0.274675	valid_1's auc: 0.906375	valid_1's binary_logloss: 0.320121
[94]	valid_0's auc: 0.936738	valid_0's binary_logloss: 0.274212	valid_1's auc: 0.906126	valid_1's binary_logloss: 0.320521
[95]	valid_0's auc: 0.936944	valid_0's binary_logloss: 0.273795	valid_1's auc: 0.906076	valid_1's binary_logloss: 0.320623
[96]	valid_0's auc: 0.93718	valid_0's binary_logloss: 0.27342	valid_1's auc: 0.90608	valid_1's binary_logloss: 0.320639
[97]	valid_0's auc: 0.937323	valid_0's binary_logloss: 0.273127	valid_1's auc: 0.905945	valid_1's binary_logloss: 0.320824
[98]	valid_0's auc: 0.937497	valid_0's binary_logloss: 0.272818	valid_1's auc: 0.905826	valid_1's binary_logloss: 0.321023
[99]	valid_0's auc: 0.937737	valid_0's binary_logloss: 0.272366	valid_1's auc: 0.905725	valid_1's binary_logloss: 0.321271
[100]	valid_0's auc: 0.937973	valid_0's binary_logloss: 0.27195	valid_1's auc: 0.905683	valid_1's binary_logloss: 0.321386
[101]	valid_0's auc: 0.938215	valid_0's binary_logloss: 0.271548	valid_1's auc: 0.905702	valid_1's binary_logloss: 0.321408
[102]	valid_0's auc: 0.938352	valid_0's binary_logloss: 0.271275	valid_1's auc: 0.905756	valid_1's binary_logloss: 0.321341
[103]	valid_0's auc: 0.938645	valid_0's binary_logloss: 0.270795	valid_1's auc: 0.905616	valid_1's binary_logloss: 0.32156
[104]	valid_0's auc: 0.938829	valid_0's binary_logloss: 0.270479	valid_1's auc: 0.905538	valid_1's binary_logloss: 0.321701
[105]	valid_0's auc: 0.939028	valid_0's binary_logloss: 0.27014	valid_1's auc: 0.905469	valid_1's binary_logloss: 0.321868
[106]	valid_0's auc: 0.939251	valid_0's binary_logloss: 0.269737	valid_1's auc: 0.905436	valid_1's binary_logloss: 0.3219
[107]	valid_0's auc: 0.939482	valid_0's binary_logloss: 0.269284	valid_1's auc: 0.905301	valid_1's binary_logloss: 0.322221
[108]	valid_0's auc: 0.939672	valid_0's binary_logloss: 0.268912	valid_1's auc: 0.905222	valid_1's binary_logloss: 0.322372
[109]	valid_0's auc: 0.939943	valid_0's binary_logloss: 0.26847	valid_1's auc: 0.905232	valid_1's binary_logloss: 0.322354
[110]	valid_0's auc: 0.940057	valid_0's binary_logloss: 0.268254	valid_1's auc: 0.905155	valid_1's binary_logloss: 0.322521
[111]	valid_0's auc: 0.940309	valid_0's binary_logloss: 0.267818	valid_1's auc: 0.905126	valid_1's binary_logloss: 0.322585
[112]	valid_0's auc: 0.940462	valid_0's binary_logloss: 0.267507	valid_1's auc: 0.905073	valid_1's binary_logloss: 0.322692
[113]	valid_0's auc: 0.940621	valid_0's binary_logloss: 0.267199	valid_1's auc: 0.905075	valid_1's binary_logloss: 0.322724
[114]	valid_0's auc: 0.940827	valid_0's binary_logloss: 0.266824	valid_1's auc: 0.9049	valid_1's binary_logloss: 0.323049
[115]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.266479	valid_1's auc: 0.904785	valid_1's binary_logloss: 0.323288
[116]	valid_0's auc: 0.941247	valid_0's binary_logloss: 0.266054	valid_1's auc: 0.904662	valid_1's binary_logloss: 0.323534
[117]	valid_0's auc: 0.941417	valid_0's binary_logloss: 0.265695	valid_1's auc: 0.904448	valid_1's binary_logloss: 0.323923
[118]	valid_0's auc: 0.941681	valid_0's binary_logloss: 0.265224	valid_1's auc: 0.904401	valid_1's binary_logloss: 0.324009
[119]	valid_0's auc: 0.941866	valid_0's binary_logloss: 0.264872	valid_1's auc: 0.904384	valid_1's binary_logloss: 0.324105
[120]	valid_0's auc: 0.942011	valid_0's binary_logloss: 0.264578	valid_1's auc: 0.904362	valid_1's binary_logloss: 0.324212
[121]	valid_0's auc: 0.942191	valid_0's binary_logloss: 0.264226	valid_1's auc: 0.904354	valid_1's binary_logloss: 0.324273
[122]	valid_0's auc: 0.942529	valid_0's binary_logloss: 0.263664	valid_1's auc: 0.90424	valid_1's binary_logloss: 0.324454
[123]	valid_0's auc: 0.942667	valid_0's binary_logloss: 0.263382	valid_1's auc: 0.904179	valid_1's binary_logloss: 0.324619
[124]	valid_0's auc: 0.94286	valid_0's binary_logloss: 0.263052	valid_1's auc: 0.904146	valid_1's binary_logloss: 0.324692
[125]	valid_0's auc: 0.943083	valid_0's binary_logloss: 0.262653	valid_1's auc: 0.904196	valid_1's binary_logloss: 0.324582
[126]	valid_0's auc: 0.94319	valid_0's binary_logloss: 0.262477	valid_1's auc: 0.90414	valid_1's binary_logloss: 0.324681
[127]	valid_0's auc: 0.943387	valid_0's binary_logloss: 0.262085	valid_1's auc: 0.904047	valid_1's binary_logloss: 0.324842
[128]	valid_0's auc: 0.943577	valid_0's binary_logloss: 0.26172	valid_1's auc: 0.904025	valid_1's binary_logloss: 0.324896
[129]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261483	valid_1's auc: 0.903993	valid_1's binary_logloss: 0.324942
[130]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.261181	valid_1's auc: 0.903899	valid_1's binary_logloss: 0.325094
[131]	valid_0's auc: 0.944001	valid_0's binary_logloss: 0.26092	valid_1's auc: 0.903794	valid_1's binary_logloss: 0.325264
[132]	valid_0's auc: 0.944233	valid_0's binary_logloss: 0.26052	valid_1's auc: 0.903736	valid_1's binary_logloss: 0.325389
[133]	valid_0's auc: 0.944525	valid_0's binary_logloss: 0.260002	valid_1's auc: 0.903746	valid_1's binary_logloss: 0.325349
[134]	valid_0's auc: 0.944657	valid_0's binary_logloss: 0.259747	valid_1's auc: 0.903668	valid_1's binary_logloss: 0.325479
[135]	valid_0's auc: 0.944825	valid_0's binary_logloss: 0.259415	valid_1's auc: 0.903623	valid_1's binary_logloss: 0.325581
[136]	valid_0's auc: 0.944982	valid_0's binary_logloss: 0.259107	valid_1's auc: 0.903617	valid_1's binary_logloss: 0.325642
[137]	valid_0's auc: 0.945181	valid_0's binary_logloss: 0.258722	valid_1's auc: 0.903588	valid_1's binary_logloss: 0.325731
[138]	valid_0's auc: 0.945318	valid_0's binary_logloss: 0.258468	valid_1's auc: 0.903541	valid_1's binary_logloss: 0.325838
[139]	valid_0's auc: 0.94554	valid_0's binary_logloss: 0.258071	valid_1's auc: 0.903461	valid_1's binary_logloss: 0.326
[140]	valid_0's auc: 0.945801	valid_0's binary_logloss: 0.257622	valid_1's auc: 0.90339	valid_1's binary_logloss: 0.326143
[141]	valid_0's auc: 0.945919	valid_0's binary_logloss: 0.257342	valid_1's auc: 0.903299	valid_1's binary_logloss: 0.326343
[142]	valid_0's auc: 0.946103	valid_0's binary_logloss: 0.257002	valid_1's auc: 0.903188	valid_1's binary_logloss: 0.326585
[143]	valid_0's auc: 0.946229	valid_0's binary_logloss: 0.256722	valid_1's auc: 0.903163	valid_1's binary_logloss: 0.326697
[144]	valid_0's auc: 0.946383	valid_0's binary_logloss: 0.256387	valid_1's auc: 0.903184	valid_1's binary_logloss: 0.326725
[145]	valid_0's auc: 0.946697	valid_0's binary_logloss: 0.255872	valid_1's auc: 0.90321	valid_1's binary_logloss: 0.326683
[146]	valid_0's auc: 0.946846	valid_0's binary_logloss: 0.255551	valid_1's auc: 0.903128	valid_1's binary_logloss: 0.326941
Early stopping, best iteration is:
[46]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.299581	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.316401
[1]	valid_0's auc: 0.888429	valid_0's binary_logloss: 0.517259	valid_1's auc: 0.89287	valid_1's binary_logloss: 0.508675
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893364	valid_0's binary_logloss: 0.488149	valid_1's auc: 0.898668	valid_1's binary_logloss: 0.478942
[3]	valid_0's auc: 0.89471	valid_0's binary_logloss: 0.465013	valid_1's auc: 0.899211	valid_1's binary_logloss: 0.455077
[4]	valid_0's auc: 0.896499	valid_0's binary_logloss: 0.44573	valid_1's auc: 0.900476	valid_1's binary_logloss: 0.435755
[5]	valid_0's auc: 0.898292	valid_0's binary_logloss: 0.429749	valid_1's auc: 0.902577	valid_1's binary_logloss: 0.419702
[6]	valid_0's auc: 0.899447	valid_0's binary_logloss: 0.416012	valid_1's auc: 0.903628	valid_1's binary_logloss: 0.405945
[7]	valid_0's auc: 0.90016	valid_0's binary_logloss: 0.404313	valid_1's auc: 0.904037	valid_1's binary_logloss: 0.394294
[8]	valid_0's auc: 0.900845	valid_0's binary_logloss: 0.394355	valid_1's auc: 0.90441	valid_1's binary_logloss: 0.384406
[9]	valid_0's auc: 0.901491	valid_0's binary_logloss: 0.385709	valid_1's auc: 0.904431	valid_1's binary_logloss: 0.376154
[10]	valid_0's auc: 0.902463	valid_0's binary_logloss: 0.377832	valid_1's auc: 0.905143	valid_1's binary_logloss: 0.368695
[11]	valid_0's auc: 0.903181	valid_0's binary_logloss: 0.371016	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.362121
[12]	valid_0's auc: 0.904072	valid_0's binary_logloss: 0.36506	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.3563
[13]	valid_0's auc: 0.904711	valid_0's binary_logloss: 0.359719	valid_1's auc: 0.90629	valid_1's binary_logloss: 0.351666
[14]	valid_0's auc: 0.90523	valid_0's binary_logloss: 0.354954	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.347564
[15]	valid_0's auc: 0.906387	valid_0's binary_logloss: 0.350653	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.343895
[16]	valid_0's auc: 0.906883	valid_0's binary_logloss: 0.346912	valid_1's auc: 0.906609	valid_1's binary_logloss: 0.340725
[17]	valid_0's auc: 0.90755	valid_0's binary_logloss: 0.343412	valid_1's auc: 0.907061	valid_1's binary_logloss: 0.337858
[18]	valid_0's auc: 0.908164	valid_0's binary_logloss: 0.340268	valid_1's auc: 0.907267	valid_1's binary_logloss: 0.335306
[19]	valid_0's auc: 0.90889	valid_0's binary_logloss: 0.337258	valid_1's auc: 0.90776	valid_1's binary_logloss: 0.332727
[20]	valid_0's auc: 0.90941	valid_0's binary_logloss: 0.334606	valid_1's auc: 0.908151	valid_1's binary_logloss: 0.330547
[21]	valid_0's auc: 0.909787	valid_0's binary_logloss: 0.332353	valid_1's auc: 0.908241	valid_1's binary_logloss: 0.328858
[22]	valid_0's auc: 0.910425	valid_0's binary_logloss: 0.329976	valid_1's auc: 0.90849	valid_1's binary_logloss: 0.327017
[23]	valid_0's auc: 0.910985	valid_0's binary_logloss: 0.327906	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.325594
[24]	valid_0's auc: 0.911603	valid_0's binary_logloss: 0.325949	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.324322
[25]	valid_0's auc: 0.912176	valid_0's binary_logloss: 0.324138	valid_1's auc: 0.908768	valid_1's binary_logloss: 0.32328
[26]	valid_0's auc: 0.912673	valid_0's binary_logloss: 0.322529	valid_1's auc: 0.908666	valid_1's binary_logloss: 0.322518
[27]	valid_0's auc: 0.913087	valid_0's binary_logloss: 0.320998	valid_1's auc: 0.908551	valid_1's binary_logloss: 0.321904
[28]	valid_0's auc: 0.913654	valid_0's binary_logloss: 0.319369	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.32094
[29]	valid_0's auc: 0.914075	valid_0's binary_logloss: 0.318044	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.320494
[30]	valid_0's auc: 0.914561	valid_0's binary_logloss: 0.316755	valid_1's auc: 0.908679	valid_1's binary_logloss: 0.319887
[31]	valid_0's auc: 0.914972	valid_0's binary_logloss: 0.315593	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.3193
[32]	valid_0's auc: 0.915369	valid_0's binary_logloss: 0.314517	valid_1's auc: 0.909071	valid_1's binary_logloss: 0.318458
[33]	valid_0's auc: 0.915722	valid_0's binary_logloss: 0.313502	valid_1's auc: 0.909186	valid_1's binary_logloss: 0.317908
[34]	valid_0's auc: 0.916139	valid_0's binary_logloss: 0.312384	valid_1's auc: 0.909167	valid_1's binary_logloss: 0.317533
[35]	valid_0's auc: 0.916617	valid_0's binary_logloss: 0.311286	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.317049
[36]	valid_0's auc: 0.917004	valid_0's binary_logloss: 0.310382	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316817
[37]	valid_0's auc: 0.917431	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.316675
[38]	valid_0's auc: 0.917978	valid_0's binary_logloss: 0.308351	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.316474
[39]	valid_0's auc: 0.918388	valid_0's binary_logloss: 0.307376	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.316114
[40]	valid_0's auc: 0.918772	valid_0's binary_logloss: 0.306595	valid_1's auc: 0.909401	valid_1's binary_logloss: 0.315829
[41]	valid_0's auc: 0.919067	valid_0's binary_logloss: 0.305985	valid_1's auc: 0.909408	valid_1's binary_logloss: 0.315635
[42]	valid_0's auc: 0.919366	valid_0's binary_logloss: 0.305357	valid_1's auc: 0.909447	valid_1's binary_logloss: 0.315487
[43]	valid_0's auc: 0.919793	valid_0's binary_logloss: 0.304502	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.315409
[44]	valid_0's auc: 0.920061	valid_0's binary_logloss: 0.303848	valid_1's auc: 0.909353	valid_1's binary_logloss: 0.315367
[45]	valid_0's auc: 0.920352	valid_0's binary_logloss: 0.303271	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.315145
[46]	valid_0's auc: 0.920767	valid_0's binary_logloss: 0.302429	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.31481
[47]	valid_0's auc: 0.921195	valid_0's binary_logloss: 0.301635	valid_1's auc: 0.909638	valid_1's binary_logloss: 0.314662
[48]	valid_0's auc: 0.921536	valid_0's binary_logloss: 0.301019	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.314554
[49]	valid_0's auc: 0.921955	valid_0's binary_logloss: 0.300235	valid_1's auc: 0.909513	valid_1's binary_logloss: 0.314613
[50]	valid_0's auc: 0.922367	valid_0's binary_logloss: 0.299513	valid_1's auc: 0.909641	valid_1's binary_logloss: 0.314373
[51]	valid_0's auc: 0.922638	valid_0's binary_logloss: 0.298961	valid_1's auc: 0.909519	valid_1's binary_logloss: 0.31449
[52]	valid_0's auc: 0.922992	valid_0's binary_logloss: 0.298274	valid_1's auc: 0.909616	valid_1's binary_logloss: 0.314297
[53]	valid_0's auc: 0.923405	valid_0's binary_logloss: 0.297495	valid_1's auc: 0.909624	valid_1's binary_logloss: 0.314252
[54]	valid_0's auc: 0.923739	valid_0's binary_logloss: 0.296861	valid_1's auc: 0.909471	valid_1's binary_logloss: 0.314402
[55]	valid_0's auc: 0.924156	valid_0's binary_logloss: 0.296109	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.314407
[56]	valid_0's auc: 0.924417	valid_0's binary_logloss: 0.295532	valid_1's auc: 0.909403	valid_1's binary_logloss: 0.314513
[57]	valid_0's auc: 0.92463	valid_0's binary_logloss: 0.295137	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.314484
[58]	valid_0's auc: 0.924868	valid_0's binary_logloss: 0.294692	valid_1's auc: 0.909318	valid_1's binary_logloss: 0.314593
[59]	valid_0's auc: 0.925031	valid_0's binary_logloss: 0.294386	valid_1's auc: 0.909254	valid_1's binary_logloss: 0.314697
[60]	valid_0's auc: 0.925403	valid_0's binary_logloss: 0.293762	valid_1's auc: 0.909313	valid_1's binary_logloss: 0.314601
[61]	valid_0's auc: 0.925698	valid_0's binary_logloss: 0.293238	valid_1's auc: 0.909252	valid_1's binary_logloss: 0.314682
[62]	valid_0's auc: 0.925982	valid_0's binary_logloss: 0.292777	valid_1's auc: 0.909049	valid_1's binary_logloss: 0.314987
[63]	valid_0's auc: 0.926263	valid_0's binary_logloss: 0.292241	valid_1's auc: 0.909107	valid_1's binary_logloss: 0.314892
[64]	valid_0's auc: 0.926578	valid_0's binary_logloss: 0.291692	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.314942
[65]	valid_0's auc: 0.926824	valid_0's binary_logloss: 0.29131	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.315184
[66]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.29081	valid_1's auc: 0.908889	valid_1's binary_logloss: 0.315181
[67]	valid_0's auc: 0.927344	valid_0's binary_logloss: 0.290392	valid_1's auc: 0.908937	valid_1's binary_logloss: 0.315107
[68]	valid_0's auc: 0.927469	valid_0's binary_logloss: 0.290161	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315265
[69]	valid_0's auc: 0.927743	valid_0's binary_logloss: 0.289646	valid_1's auc: 0.908691	valid_1's binary_logloss: 0.315519
[70]	valid_0's auc: 0.928012	valid_0's binary_logloss: 0.28916	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.315758
[71]	valid_0's auc: 0.928296	valid_0's binary_logloss: 0.288657	valid_1's auc: 0.908443	valid_1's binary_logloss: 0.315894
[72]	valid_0's auc: 0.928446	valid_0's binary_logloss: 0.288413	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316016
[73]	valid_0's auc: 0.928739	valid_0's binary_logloss: 0.287912	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.316239
[74]	valid_0's auc: 0.929085	valid_0's binary_logloss: 0.287342	valid_1's auc: 0.908153	valid_1's binary_logloss: 0.316294
[75]	valid_0's auc: 0.929309	valid_0's binary_logloss: 0.286904	valid_1's auc: 0.908092	valid_1's binary_logloss: 0.316378
[76]	valid_0's auc: 0.92958	valid_0's binary_logloss: 0.286391	valid_1's auc: 0.908019	valid_1's binary_logloss: 0.316517
[77]	valid_0's auc: 0.929725	valid_0's binary_logloss: 0.286122	valid_1's auc: 0.908042	valid_1's binary_logloss: 0.316509
[78]	valid_0's auc: 0.93001	valid_0's binary_logloss: 0.285657	valid_1's auc: 0.907997	valid_1's binary_logloss: 0.31662
[79]	valid_0's auc: 0.930322	valid_0's binary_logloss: 0.28515	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.316691
[80]	valid_0's auc: 0.930548	valid_0's binary_logloss: 0.284787	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316735
[81]	valid_0's auc: 0.930648	valid_0's binary_logloss: 0.28461	valid_1's auc: 0.907964	valid_1's binary_logloss: 0.316721
[82]	valid_0's auc: 0.930816	valid_0's binary_logloss: 0.284306	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.316751
[83]	valid_0's auc: 0.931041	valid_0's binary_logloss: 0.283839	valid_1's auc: 0.907891	valid_1's binary_logloss: 0.316883
[84]	valid_0's auc: 0.931322	valid_0's binary_logloss: 0.283365	valid_1's auc: 0.907873	valid_1's binary_logloss: 0.316948
[85]	valid_0's auc: 0.931498	valid_0's binary_logloss: 0.283027	valid_1's auc: 0.907722	valid_1's binary_logloss: 0.317235
[86]	valid_0's auc: 0.931754	valid_0's binary_logloss: 0.282594	valid_1's auc: 0.907739	valid_1's binary_logloss: 0.317206
[87]	valid_0's auc: 0.932004	valid_0's binary_logloss: 0.282094	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.317247
[88]	valid_0's auc: 0.93222	valid_0's binary_logloss: 0.281702	valid_1's auc: 0.907748	valid_1's binary_logloss: 0.31727
[89]	valid_0's auc: 0.932374	valid_0's binary_logloss: 0.281433	valid_1's auc: 0.907709	valid_1's binary_logloss: 0.317396
[90]	valid_0's auc: 0.932615	valid_0's binary_logloss: 0.280976	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.317421
[91]	valid_0's auc: 0.932858	valid_0's binary_logloss: 0.280554	valid_1's auc: 0.907628	valid_1's binary_logloss: 0.31751
[92]	valid_0's auc: 0.933112	valid_0's binary_logloss: 0.280053	valid_1's auc: 0.907654	valid_1's binary_logloss: 0.317492
[93]	valid_0's auc: 0.933237	valid_0's binary_logloss: 0.279815	valid_1's auc: 0.907673	valid_1's binary_logloss: 0.317454
[94]	valid_0's auc: 0.933415	valid_0's binary_logloss: 0.279467	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.317575
[95]	valid_0's auc: 0.933681	valid_0's binary_logloss: 0.278992	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317669
[96]	valid_0's auc: 0.934074	valid_0's binary_logloss: 0.278372	valid_1's auc: 0.907517	valid_1's binary_logloss: 0.317795
[97]	valid_0's auc: 0.934276	valid_0's binary_logloss: 0.277993	valid_1's auc: 0.907495	valid_1's binary_logloss: 0.31785
[98]	valid_0's auc: 0.934483	valid_0's binary_logloss: 0.277572	valid_1's auc: 0.907388	valid_1's binary_logloss: 0.318059
[99]	valid_0's auc: 0.934701	valid_0's binary_logloss: 0.277192	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.31821
[100]	valid_0's auc: 0.934904	valid_0's binary_logloss: 0.27682	valid_1's auc: 0.90733	valid_1's binary_logloss: 0.31823
[101]	valid_0's auc: 0.935043	valid_0's binary_logloss: 0.276577	valid_1's auc: 0.907183	valid_1's binary_logloss: 0.318483
[102]	valid_0's auc: 0.935245	valid_0's binary_logloss: 0.276236	valid_1's auc: 0.907181	valid_1's binary_logloss: 0.318481
[103]	valid_0's auc: 0.935368	valid_0's binary_logloss: 0.27599	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.318524
[104]	valid_0's auc: 0.935575	valid_0's binary_logloss: 0.275605	valid_1's auc: 0.9071	valid_1's binary_logloss: 0.318678
[105]	valid_0's auc: 0.935859	valid_0's binary_logloss: 0.275138	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.318694
[106]	valid_0's auc: 0.936102	valid_0's binary_logloss: 0.274749	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.318699
[107]	valid_0's auc: 0.936329	valid_0's binary_logloss: 0.274345	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.31867
[108]	valid_0's auc: 0.936558	valid_0's binary_logloss: 0.273969	valid_1's auc: 0.907092	valid_1's binary_logloss: 0.318754
[109]	valid_0's auc: 0.936804	valid_0's binary_logloss: 0.273586	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318834
[110]	valid_0's auc: 0.936966	valid_0's binary_logloss: 0.273298	valid_1's auc: 0.906977	valid_1's binary_logloss: 0.318941
[111]	valid_0's auc: 0.937206	valid_0's binary_logloss: 0.272868	valid_1's auc: 0.906913	valid_1's binary_logloss: 0.319014
[112]	valid_0's auc: 0.937468	valid_0's binary_logloss: 0.272409	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.319233
[113]	valid_0's auc: 0.937607	valid_0's binary_logloss: 0.272133	valid_1's auc: 0.906704	valid_1's binary_logloss: 0.319419
[114]	valid_0's auc: 0.93777	valid_0's binary_logloss: 0.271825	valid_1's auc: 0.906764	valid_1's binary_logloss: 0.319344
[115]	valid_0's auc: 0.937839	valid_0's binary_logloss: 0.271712	valid_1's auc: 0.906723	valid_1's binary_logloss: 0.319418
[116]	valid_0's auc: 0.938023	valid_0's binary_logloss: 0.27138	valid_1's auc: 0.906741	valid_1's binary_logloss: 0.319423
[117]	valid_0's auc: 0.93816	valid_0's binary_logloss: 0.27112	valid_1's auc: 0.906719	valid_1's binary_logloss: 0.319503
[118]	valid_0's auc: 0.938402	valid_0's binary_logloss: 0.270714	valid_1's auc: 0.906501	valid_1's binary_logloss: 0.319795
[119]	valid_0's auc: 0.938644	valid_0's binary_logloss: 0.27028	valid_1's auc: 0.90641	valid_1's binary_logloss: 0.31996
[120]	valid_0's auc: 0.938869	valid_0's binary_logloss: 0.269859	valid_1's auc: 0.906334	valid_1's binary_logloss: 0.320085
[121]	valid_0's auc: 0.939085	valid_0's binary_logloss: 0.269442	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320392
[122]	valid_0's auc: 0.939216	valid_0's binary_logloss: 0.269181	valid_1's auc: 0.906099	valid_1's binary_logloss: 0.320532
[123]	valid_0's auc: 0.939431	valid_0's binary_logloss: 0.268804	valid_1's auc: 0.906011	valid_1's binary_logloss: 0.320714
[124]	valid_0's auc: 0.939658	valid_0's binary_logloss: 0.268386	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.320852
[125]	valid_0's auc: 0.939745	valid_0's binary_logloss: 0.26819	valid_1's auc: 0.905842	valid_1's binary_logloss: 0.321067
[126]	valid_0's auc: 0.939944	valid_0's binary_logloss: 0.267804	valid_1's auc: 0.90586	valid_1's binary_logloss: 0.321083
[127]	valid_0's auc: 0.940044	valid_0's binary_logloss: 0.26759	valid_1's auc: 0.9059	valid_1's binary_logloss: 0.321048
[128]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267262	valid_1's auc: 0.905781	valid_1's binary_logloss: 0.321202
[129]	valid_0's auc: 0.940271	valid_0's binary_logloss: 0.267158	valid_1's auc: 0.905754	valid_1's binary_logloss: 0.321245
[130]	valid_0's auc: 0.940428	valid_0's binary_logloss: 0.266876	valid_1's auc: 0.905718	valid_1's binary_logloss: 0.321287
[131]	valid_0's auc: 0.940662	valid_0's binary_logloss: 0.266465	valid_1's auc: 0.905657	valid_1's binary_logloss: 0.321419
[132]	valid_0's auc: 0.940808	valid_0's binary_logloss: 0.266163	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.32162
[133]	valid_0's auc: 0.941028	valid_0's binary_logloss: 0.265782	valid_1's auc: 0.905503	valid_1's binary_logloss: 0.321786
[134]	valid_0's auc: 0.941266	valid_0's binary_logloss: 0.265359	valid_1's auc: 0.905457	valid_1's binary_logloss: 0.321929
[135]	valid_0's auc: 0.941462	valid_0's binary_logloss: 0.265008	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.322102
[136]	valid_0's auc: 0.941578	valid_0's binary_logloss: 0.264764	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322247
[137]	valid_0's auc: 0.941727	valid_0's binary_logloss: 0.264491	valid_1's auc: 0.905249	valid_1's binary_logloss: 0.322412
[138]	valid_0's auc: 0.941836	valid_0's binary_logloss: 0.264238	valid_1's auc: 0.905239	valid_1's binary_logloss: 0.322502
[139]	valid_0's auc: 0.942039	valid_0's binary_logloss: 0.263852	valid_1's auc: 0.905174	valid_1's binary_logloss: 0.322597
[140]	valid_0's auc: 0.942214	valid_0's binary_logloss: 0.263512	valid_1's auc: 0.905103	valid_1's binary_logloss: 0.322743
[141]	valid_0's auc: 0.942431	valid_0's binary_logloss: 0.263143	valid_1's auc: 0.904978	valid_1's binary_logloss: 0.322994
[142]	valid_0's auc: 0.942552	valid_0's binary_logloss: 0.262922	valid_1's auc: 0.904954	valid_1's binary_logloss: 0.323034
[143]	valid_0's auc: 0.942712	valid_0's binary_logloss: 0.262576	valid_1's auc: 0.904982	valid_1's binary_logloss: 0.323027
[144]	valid_0's auc: 0.94288	valid_0's binary_logloss: 0.262269	valid_1's auc: 0.904939	valid_1's binary_logloss: 0.323169
[145]	valid_0's auc: 0.943033	valid_0's binary_logloss: 0.26196	valid_1's auc: 0.905	valid_1's binary_logloss: 0.323105
[146]	valid_0's auc: 0.943224	valid_0's binary_logloss: 0.261627	valid_1's auc: 0.904949	valid_1's binary_logloss: 0.32318
[147]	valid_0's auc: 0.943429	valid_0's binary_logloss: 0.261296	valid_1's auc: 0.904973	valid_1's binary_logloss: 0.323148
[148]	valid_0's auc: 0.943558	valid_0's binary_logloss: 0.261013	valid_1's auc: 0.904971	valid_1's binary_logloss: 0.323197
[149]	valid_0's auc: 0.943756	valid_0's binary_logloss: 0.260688	valid_1's auc: 0.90494	valid_1's binary_logloss: 0.323276
[150]	valid_0's auc: 0.943989	valid_0's binary_logloss: 0.260262	valid_1's auc: 0.904844	valid_1's binary_logloss: 0.323457
Early stopping, best iteration is:
[50]	valid_0's auc: 0.922367	valid_0's binary_logloss: 0.299513	valid_1's auc: 0.909641	valid_1's binary_logloss: 0.314373
[1]	valid_0's auc: 0.88862	valid_0's binary_logloss: 0.517559	valid_1's auc: 0.895216	valid_1's binary_logloss: 0.508462
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891685	valid_0's binary_logloss: 0.488823	valid_1's auc: 0.897251	valid_1's binary_logloss: 0.479045
[3]	valid_0's auc: 0.89535	valid_0's binary_logloss: 0.465318	valid_1's auc: 0.900709	valid_1's binary_logloss: 0.454958
[4]	valid_0's auc: 0.897143	valid_0's binary_logloss: 0.445958	valid_1's auc: 0.901126	valid_1's binary_logloss: 0.435898
[5]	valid_0's auc: 0.897936	valid_0's binary_logloss: 0.429982	valid_1's auc: 0.900752	valid_1's binary_logloss: 0.420148
[6]	valid_0's auc: 0.898453	valid_0's binary_logloss: 0.416378	valid_1's auc: 0.900947	valid_1's binary_logloss: 0.406481
[7]	valid_0's auc: 0.899579	valid_0's binary_logloss: 0.404589	valid_1's auc: 0.903086	valid_1's binary_logloss: 0.394663
[8]	valid_0's auc: 0.900549	valid_0's binary_logloss: 0.394529	valid_1's auc: 0.904172	valid_1's binary_logloss: 0.384427
[9]	valid_0's auc: 0.901078	valid_0's binary_logloss: 0.385787	valid_1's auc: 0.904166	valid_1's binary_logloss: 0.376075
[10]	valid_0's auc: 0.901717	valid_0's binary_logloss: 0.378226	valid_1's auc: 0.903991	valid_1's binary_logloss: 0.368931
[11]	valid_0's auc: 0.902526	valid_0's binary_logloss: 0.371393	valid_1's auc: 0.904364	valid_1's binary_logloss: 0.362505
[12]	valid_0's auc: 0.903143	valid_0's binary_logloss: 0.36552	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.356834
[13]	valid_0's auc: 0.903994	valid_0's binary_logloss: 0.360206	valid_1's auc: 0.905684	valid_1's binary_logloss: 0.352023
[14]	valid_0's auc: 0.904587	valid_0's binary_logloss: 0.355569	valid_1's auc: 0.906016	valid_1's binary_logloss: 0.347746
[15]	valid_0's auc: 0.9054	valid_0's binary_logloss: 0.351301	valid_1's auc: 0.906315	valid_1's binary_logloss: 0.343932
[16]	valid_0's auc: 0.905978	valid_0's binary_logloss: 0.347447	valid_1's auc: 0.906464	valid_1's binary_logloss: 0.340751
[17]	valid_0's auc: 0.90637	valid_0's binary_logloss: 0.344146	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.337835
[18]	valid_0's auc: 0.907012	valid_0's binary_logloss: 0.34113	valid_1's auc: 0.907124	valid_1's binary_logloss: 0.335133
[19]	valid_0's auc: 0.907575	valid_0's binary_logloss: 0.338369	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.333063
[20]	valid_0's auc: 0.908083	valid_0's binary_logloss: 0.335808	valid_1's auc: 0.90734	valid_1's binary_logloss: 0.330934
[21]	valid_0's auc: 0.908935	valid_0's binary_logloss: 0.333309	valid_1's auc: 0.907671	valid_1's binary_logloss: 0.329015
[22]	valid_0's auc: 0.909579	valid_0's binary_logloss: 0.331027	valid_1's auc: 0.907832	valid_1's binary_logloss: 0.3273
[23]	valid_0's auc: 0.910166	valid_0's binary_logloss: 0.328944	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.325891
[24]	valid_0's auc: 0.910648	valid_0's binary_logloss: 0.326994	valid_1's auc: 0.908071	valid_1's binary_logloss: 0.324484
[25]	valid_0's auc: 0.911167	valid_0's binary_logloss: 0.325209	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.323336
[26]	valid_0's auc: 0.911793	valid_0's binary_logloss: 0.3234	valid_1's auc: 0.908344	valid_1's binary_logloss: 0.322211
[27]	valid_0's auc: 0.912343	valid_0's binary_logloss: 0.321816	valid_1's auc: 0.908461	valid_1's binary_logloss: 0.321367
[28]	valid_0's auc: 0.912823	valid_0's binary_logloss: 0.320473	valid_1's auc: 0.908591	valid_1's binary_logloss: 0.32059
[29]	valid_0's auc: 0.913392	valid_0's binary_logloss: 0.31905	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.320199
[30]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.317803	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.319699
[31]	valid_0's auc: 0.914299	valid_0's binary_logloss: 0.316516	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.319061
[32]	valid_0's auc: 0.91474	valid_0's binary_logloss: 0.31538	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.31856
[33]	valid_0's auc: 0.915288	valid_0's binary_logloss: 0.314177	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.318255
[34]	valid_0's auc: 0.915715	valid_0's binary_logloss: 0.313181	valid_1's auc: 0.908632	valid_1's binary_logloss: 0.317799
[35]	valid_0's auc: 0.9161	valid_0's binary_logloss: 0.312164	valid_1's auc: 0.908764	valid_1's binary_logloss: 0.317349
[36]	valid_0's auc: 0.916425	valid_0's binary_logloss: 0.311339	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.31695
[37]	valid_0's auc: 0.916845	valid_0's binary_logloss: 0.310432	valid_1's auc: 0.908969	valid_1's binary_logloss: 0.316533
[38]	valid_0's auc: 0.917237	valid_0's binary_logloss: 0.309561	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.316221
[39]	valid_0's auc: 0.917669	valid_0's binary_logloss: 0.308602	valid_1's auc: 0.909163	valid_1's binary_logloss: 0.315781
[40]	valid_0's auc: 0.918179	valid_0's binary_logloss: 0.307636	valid_1's auc: 0.909047	valid_1's binary_logloss: 0.315717
[41]	valid_0's auc: 0.918577	valid_0's binary_logloss: 0.30689	valid_1's auc: 0.909046	valid_1's binary_logloss: 0.315612
[42]	valid_0's auc: 0.918755	valid_0's binary_logloss: 0.306455	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.315502
[43]	valid_0's auc: 0.919205	valid_0's binary_logloss: 0.305561	valid_1's auc: 0.90899	valid_1's binary_logloss: 0.315422
[44]	valid_0's auc: 0.919622	valid_0's binary_logloss: 0.304748	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.315353
[45]	valid_0's auc: 0.920027	valid_0's binary_logloss: 0.303928	valid_1's auc: 0.909017	valid_1's binary_logloss: 0.315198
[46]	valid_0's auc: 0.920432	valid_0's binary_logloss: 0.303174	valid_1's auc: 0.908933	valid_1's binary_logloss: 0.315189
[47]	valid_0's auc: 0.920849	valid_0's binary_logloss: 0.302442	valid_1's auc: 0.908971	valid_1's binary_logloss: 0.315111
[48]	valid_0's auc: 0.921409	valid_0's binary_logloss: 0.301489	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.314986
[49]	valid_0's auc: 0.921715	valid_0's binary_logloss: 0.300878	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.314863
[50]	valid_0's auc: 0.922034	valid_0's binary_logloss: 0.300275	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.314831
[51]	valid_0's auc: 0.9224	valid_0's binary_logloss: 0.299547	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.314717
[52]	valid_0's auc: 0.922692	valid_0's binary_logloss: 0.298997	valid_1's auc: 0.908923	valid_1's binary_logloss: 0.314803
[53]	valid_0's auc: 0.923019	valid_0's binary_logloss: 0.298347	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.314544
[54]	valid_0's auc: 0.92336	valid_0's binary_logloss: 0.297748	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.314504
[55]	valid_0's auc: 0.923639	valid_0's binary_logloss: 0.29719	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.314323
[56]	valid_0's auc: 0.923999	valid_0's binary_logloss: 0.296552	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.314269
[57]	valid_0's auc: 0.924344	valid_0's binary_logloss: 0.295942	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.314281
[58]	valid_0's auc: 0.924564	valid_0's binary_logloss: 0.295517	valid_1's auc: 0.909147	valid_1's binary_logloss: 0.314254
[59]	valid_0's auc: 0.924814	valid_0's binary_logloss: 0.295033	valid_1's auc: 0.90902	valid_1's binary_logloss: 0.314378
[60]	valid_0's auc: 0.925184	valid_0's binary_logloss: 0.294379	valid_1's auc: 0.909002	valid_1's binary_logloss: 0.314372
[61]	valid_0's auc: 0.925428	valid_0's binary_logloss: 0.293944	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.314346
[62]	valid_0's auc: 0.925667	valid_0's binary_logloss: 0.293427	valid_1's auc: 0.908909	valid_1's binary_logloss: 0.314423
[63]	valid_0's auc: 0.925996	valid_0's binary_logloss: 0.292878	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.31447
[64]	valid_0's auc: 0.926222	valid_0's binary_logloss: 0.292382	valid_1's auc: 0.908875	valid_1's binary_logloss: 0.314407
[65]	valid_0's auc: 0.926482	valid_0's binary_logloss: 0.291895	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.314397
[66]	valid_0's auc: 0.926725	valid_0's binary_logloss: 0.291464	valid_1's auc: 0.908826	valid_1's binary_logloss: 0.314453
[67]	valid_0's auc: 0.92696	valid_0's binary_logloss: 0.291004	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.314418
[68]	valid_0's auc: 0.927209	valid_0's binary_logloss: 0.290539	valid_1's auc: 0.908793	valid_1's binary_logloss: 0.314518
[69]	valid_0's auc: 0.92753	valid_0's binary_logloss: 0.290003	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.314824
[70]	valid_0's auc: 0.927758	valid_0's binary_logloss: 0.289565	valid_1's auc: 0.908556	valid_1's binary_logloss: 0.31484
[71]	valid_0's auc: 0.928008	valid_0's binary_logloss: 0.289084	valid_1's auc: 0.908522	valid_1's binary_logloss: 0.314872
[72]	valid_0's auc: 0.928203	valid_0's binary_logloss: 0.288755	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.314879
[73]	valid_0's auc: 0.928438	valid_0's binary_logloss: 0.288347	valid_1's auc: 0.90851	valid_1's binary_logloss: 0.314864
[74]	valid_0's auc: 0.928774	valid_0's binary_logloss: 0.287737	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.314957
[75]	valid_0's auc: 0.928862	valid_0's binary_logloss: 0.287563	valid_1's auc: 0.908459	valid_1's binary_logloss: 0.314956
[76]	valid_0's auc: 0.929142	valid_0's binary_logloss: 0.287076	valid_1's auc: 0.908395	valid_1's binary_logloss: 0.315029
[77]	valid_0's auc: 0.929407	valid_0's binary_logloss: 0.286613	valid_1's auc: 0.90835	valid_1's binary_logloss: 0.315127
[78]	valid_0's auc: 0.929552	valid_0's binary_logloss: 0.286381	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.315166
[79]	valid_0's auc: 0.929798	valid_0's binary_logloss: 0.28593	valid_1's auc: 0.908256	valid_1's binary_logloss: 0.315335
[80]	valid_0's auc: 0.929995	valid_0's binary_logloss: 0.285577	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.315515
[81]	valid_0's auc: 0.930165	valid_0's binary_logloss: 0.285294	valid_1's auc: 0.908103	valid_1's binary_logloss: 0.3156
[82]	valid_0's auc: 0.9304	valid_0's binary_logloss: 0.284896	valid_1's auc: 0.90815	valid_1's binary_logloss: 0.315556
[83]	valid_0's auc: 0.930624	valid_0's binary_logloss: 0.284465	valid_1's auc: 0.908238	valid_1's binary_logloss: 0.315451
[84]	valid_0's auc: 0.930826	valid_0's binary_logloss: 0.284076	valid_1's auc: 0.908101	valid_1's binary_logloss: 0.315717
[85]	valid_0's auc: 0.93117	valid_0's binary_logloss: 0.283493	valid_1's auc: 0.908034	valid_1's binary_logloss: 0.315812
[86]	valid_0's auc: 0.931416	valid_0's binary_logloss: 0.283041	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.315913
[87]	valid_0's auc: 0.931605	valid_0's binary_logloss: 0.282724	valid_1's auc: 0.907896	valid_1's binary_logloss: 0.316044
[88]	valid_0's auc: 0.931715	valid_0's binary_logloss: 0.282556	valid_1's auc: 0.907856	valid_1's binary_logloss: 0.316113
[89]	valid_0's auc: 0.931992	valid_0's binary_logloss: 0.282102	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.31618
[90]	valid_0's auc: 0.93223	valid_0's binary_logloss: 0.281669	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.31632
[91]	valid_0's auc: 0.932531	valid_0's binary_logloss: 0.281184	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.316653
[92]	valid_0's auc: 0.932673	valid_0's binary_logloss: 0.280819	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.316863
[93]	valid_0's auc: 0.932916	valid_0's binary_logloss: 0.280403	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.317108
[94]	valid_0's auc: 0.933116	valid_0's binary_logloss: 0.28003	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.317135
[95]	valid_0's auc: 0.933326	valid_0's binary_logloss: 0.279648	valid_1's auc: 0.907274	valid_1's binary_logloss: 0.317099
[96]	valid_0's auc: 0.933386	valid_0's binary_logloss: 0.279528	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.317148
[97]	valid_0's auc: 0.933536	valid_0's binary_logloss: 0.279258	valid_1's auc: 0.907211	valid_1's binary_logloss: 0.317271
[98]	valid_0's auc: 0.933803	valid_0's binary_logloss: 0.278734	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.317344
[99]	valid_0's auc: 0.934009	valid_0's binary_logloss: 0.278361	valid_1's auc: 0.907171	valid_1's binary_logloss: 0.317475
[100]	valid_0's auc: 0.934166	valid_0's binary_logloss: 0.278061	valid_1's auc: 0.907056	valid_1's binary_logloss: 0.31771
[101]	valid_0's auc: 0.934364	valid_0's binary_logloss: 0.277693	valid_1's auc: 0.906999	valid_1's binary_logloss: 0.317807
[102]	valid_0's auc: 0.934539	valid_0's binary_logloss: 0.27737	valid_1's auc: 0.907043	valid_1's binary_logloss: 0.317724
[103]	valid_0's auc: 0.934885	valid_0's binary_logloss: 0.276834	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.317614
[104]	valid_0's auc: 0.935079	valid_0's binary_logloss: 0.276475	valid_1's auc: 0.907063	valid_1's binary_logloss: 0.317724
[105]	valid_0's auc: 0.935347	valid_0's binary_logloss: 0.276009	valid_1's auc: 0.907193	valid_1's binary_logloss: 0.317555
[106]	valid_0's auc: 0.935599	valid_0's binary_logloss: 0.275522	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.317615
[107]	valid_0's auc: 0.935806	valid_0's binary_logloss: 0.275167	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.317811
[108]	valid_0's auc: 0.935959	valid_0's binary_logloss: 0.274905	valid_1's auc: 0.907016	valid_1's binary_logloss: 0.317888
[109]	valid_0's auc: 0.936196	valid_0's binary_logloss: 0.274505	valid_1's auc: 0.906963	valid_1's binary_logloss: 0.317999
[110]	valid_0's auc: 0.936392	valid_0's binary_logloss: 0.27414	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318048
[111]	valid_0's auc: 0.93661	valid_0's binary_logloss: 0.273757	valid_1's auc: 0.90687	valid_1's binary_logloss: 0.318233
[112]	valid_0's auc: 0.936781	valid_0's binary_logloss: 0.273429	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.318199
[113]	valid_0's auc: 0.936975	valid_0's binary_logloss: 0.273086	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.317949
[114]	valid_0's auc: 0.93716	valid_0's binary_logloss: 0.272753	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.318002
[115]	valid_0's auc: 0.937341	valid_0's binary_logloss: 0.27244	valid_1's auc: 0.90704	valid_1's binary_logloss: 0.318104
[116]	valid_0's auc: 0.937502	valid_0's binary_logloss: 0.272148	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318063
[117]	valid_0's auc: 0.9376	valid_0's binary_logloss: 0.271972	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.318223
[118]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.271783	valid_1's auc: 0.906942	valid_1's binary_logloss: 0.318312
[119]	valid_0's auc: 0.937767	valid_0's binary_logloss: 0.271675	valid_1's auc: 0.906918	valid_1's binary_logloss: 0.31835
[120]	valid_0's auc: 0.937901	valid_0's binary_logloss: 0.271427	valid_1's auc: 0.906913	valid_1's binary_logloss: 0.318384
[121]	valid_0's auc: 0.938139	valid_0's binary_logloss: 0.271001	valid_1's auc: 0.90696	valid_1's binary_logloss: 0.318385
[122]	valid_0's auc: 0.938291	valid_0's binary_logloss: 0.270745	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.318413
[123]	valid_0's auc: 0.938433	valid_0's binary_logloss: 0.270483	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.318496
[124]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.270222	valid_1's auc: 0.906875	valid_1's binary_logloss: 0.318566
[125]	valid_0's auc: 0.938683	valid_0's binary_logloss: 0.269992	valid_1's auc: 0.9069	valid_1's binary_logloss: 0.318551
[126]	valid_0's auc: 0.938887	valid_0's binary_logloss: 0.26965	valid_1's auc: 0.90685	valid_1's binary_logloss: 0.318645
[127]	valid_0's auc: 0.938994	valid_0's binary_logloss: 0.269391	valid_1's auc: 0.906859	valid_1's binary_logloss: 0.318667
[128]	valid_0's auc: 0.939173	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.318908
[129]	valid_0's auc: 0.939432	valid_0's binary_logloss: 0.268601	valid_1's auc: 0.906849	valid_1's binary_logloss: 0.318696
[130]	valid_0's auc: 0.939638	valid_0's binary_logloss: 0.268221	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.318817
[131]	valid_0's auc: 0.939786	valid_0's binary_logloss: 0.267956	valid_1's auc: 0.90673	valid_1's binary_logloss: 0.318959
[132]	valid_0's auc: 0.940027	valid_0's binary_logloss: 0.267552	valid_1's auc: 0.906614	valid_1's binary_logloss: 0.319133
[133]	valid_0's auc: 0.940227	valid_0's binary_logloss: 0.267185	valid_1's auc: 0.906567	valid_1's binary_logloss: 0.319237
[134]	valid_0's auc: 0.940329	valid_0's binary_logloss: 0.266997	valid_1's auc: 0.906575	valid_1's binary_logloss: 0.319333
[135]	valid_0's auc: 0.940532	valid_0's binary_logloss: 0.266634	valid_1's auc: 0.906603	valid_1's binary_logloss: 0.319358
[136]	valid_0's auc: 0.940696	valid_0's binary_logloss: 0.26632	valid_1's auc: 0.906522	valid_1's binary_logloss: 0.319537
[137]	valid_0's auc: 0.940889	valid_0's binary_logloss: 0.265947	valid_1's auc: 0.906387	valid_1's binary_logloss: 0.319788
[138]	valid_0's auc: 0.940963	valid_0's binary_logloss: 0.265791	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.319791
[139]	valid_0's auc: 0.941217	valid_0's binary_logloss: 0.265342	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.319993
[140]	valid_0's auc: 0.941362	valid_0's binary_logloss: 0.265059	valid_1's auc: 0.90624	valid_1's binary_logloss: 0.320087
[141]	valid_0's auc: 0.941468	valid_0's binary_logloss: 0.26486	valid_1's auc: 0.906128	valid_1's binary_logloss: 0.320288
[142]	valid_0's auc: 0.941614	valid_0's binary_logloss: 0.264566	valid_1's auc: 0.906025	valid_1's binary_logloss: 0.320515
[143]	valid_0's auc: 0.941739	valid_0's binary_logloss: 0.264323	valid_1's auc: 0.905944	valid_1's binary_logloss: 0.320684
[144]	valid_0's auc: 0.941944	valid_0's binary_logloss: 0.263955	valid_1's auc: 0.905822	valid_1's binary_logloss: 0.320915
[145]	valid_0's auc: 0.942136	valid_0's binary_logloss: 0.263569	valid_1's auc: 0.905748	valid_1's binary_logloss: 0.321061
[146]	valid_0's auc: 0.942312	valid_0's binary_logloss: 0.263196	valid_1's auc: 0.905691	valid_1's binary_logloss: 0.321189
[147]	valid_0's auc: 0.942489	valid_0's binary_logloss: 0.262897	valid_1's auc: 0.905657	valid_1's binary_logloss: 0.321295
[148]	valid_0's auc: 0.94266	valid_0's binary_logloss: 0.262569	valid_1's auc: 0.905523	valid_1's binary_logloss: 0.321516
[149]	valid_0's auc: 0.942884	valid_0's binary_logloss: 0.262177	valid_1's auc: 0.905403	valid_1's binary_logloss: 0.321759
[150]	valid_0's auc: 0.94307	valid_0's binary_logloss: 0.261803	valid_1's auc: 0.905336	valid_1's binary_logloss: 0.321881
[151]	valid_0's auc: 0.943142	valid_0's binary_logloss: 0.261649	valid_1's auc: 0.905196	valid_1's binary_logloss: 0.322075
[152]	valid_0's auc: 0.943333	valid_0's binary_logloss: 0.26132	valid_1's auc: 0.905221	valid_1's binary_logloss: 0.322054
[153]	valid_0's auc: 0.943484	valid_0's binary_logloss: 0.261045	valid_1's auc: 0.905133	valid_1's binary_logloss: 0.322201
[154]	valid_0's auc: 0.943625	valid_0's binary_logloss: 0.260773	valid_1's auc: 0.905127	valid_1's binary_logloss: 0.322292
[155]	valid_0's auc: 0.943803	valid_0's binary_logloss: 0.260451	valid_1's auc: 0.905017	valid_1's binary_logloss: 0.322437
[156]	valid_0's auc: 0.943973	valid_0's binary_logloss: 0.260147	valid_1's auc: 0.904931	valid_1's binary_logloss: 0.322598
Early stopping, best iteration is:
[56]	valid_0's auc: 0.923999	valid_0's binary_logloss: 0.296552	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.314269
[1]	valid_0's auc: 0.887968	valid_0's binary_logloss: 0.516768	valid_1's auc: 0.895544	valid_1's binary_logloss: 0.50753
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891765	valid_0's binary_logloss: 0.487735	valid_1's auc: 0.899568	valid_1's binary_logloss: 0.477309
[3]	valid_0's auc: 0.892862	valid_0's binary_logloss: 0.46446	valid_1's auc: 0.901473	valid_1's binary_logloss: 0.453476
[4]	valid_0's auc: 0.894319	valid_0's binary_logloss: 0.445017	valid_1's auc: 0.900978	valid_1's binary_logloss: 0.434504
[5]	valid_0's auc: 0.894429	valid_0's binary_logloss: 0.429143	valid_1's auc: 0.901054	valid_1's binary_logloss: 0.418425
[6]	valid_0's auc: 0.895715	valid_0's binary_logloss: 0.415531	valid_1's auc: 0.902036	valid_1's binary_logloss: 0.404972
[7]	valid_0's auc: 0.899511	valid_0's binary_logloss: 0.403934	valid_1's auc: 0.90367	valid_1's binary_logloss: 0.393802
[8]	valid_0's auc: 0.900147	valid_0's binary_logloss: 0.39396	valid_1's auc: 0.903745	valid_1's binary_logloss: 0.384144
[9]	valid_0's auc: 0.901231	valid_0's binary_logloss: 0.385144	valid_1's auc: 0.904038	valid_1's binary_logloss: 0.375981
[10]	valid_0's auc: 0.901867	valid_0's binary_logloss: 0.377458	valid_1's auc: 0.904795	valid_1's binary_logloss: 0.368387
[11]	valid_0's auc: 0.902896	valid_0's binary_logloss: 0.370583	valid_1's auc: 0.905303	valid_1's binary_logloss: 0.361999
[12]	valid_0's auc: 0.903488	valid_0's binary_logloss: 0.36458	valid_1's auc: 0.905294	valid_1's binary_logloss: 0.356463
[13]	valid_0's auc: 0.904282	valid_0's binary_logloss: 0.359323	valid_1's auc: 0.90556	valid_1's binary_logloss: 0.351759
[14]	valid_0's auc: 0.905024	valid_0's binary_logloss: 0.354518	valid_1's auc: 0.905903	valid_1's binary_logloss: 0.347369
[15]	valid_0's auc: 0.905556	valid_0's binary_logloss: 0.350322	valid_1's auc: 0.905957	valid_1's binary_logloss: 0.343715
[16]	valid_0's auc: 0.906568	valid_0's binary_logloss: 0.346519	valid_1's auc: 0.906095	valid_1's binary_logloss: 0.340861
[17]	valid_0's auc: 0.907157	valid_0's binary_logloss: 0.343169	valid_1's auc: 0.906578	valid_1's binary_logloss: 0.337949
[18]	valid_0's auc: 0.907969	valid_0's binary_logloss: 0.339887	valid_1's auc: 0.906723	valid_1's binary_logloss: 0.335404
[19]	valid_0's auc: 0.908662	valid_0's binary_logloss: 0.336987	valid_1's auc: 0.907216	valid_1's binary_logloss: 0.33297
[20]	valid_0's auc: 0.909672	valid_0's binary_logloss: 0.334088	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.330837
[21]	valid_0's auc: 0.910329	valid_0's binary_logloss: 0.331571	valid_1's auc: 0.907727	valid_1's binary_logloss: 0.329005
[22]	valid_0's auc: 0.910853	valid_0's binary_logloss: 0.329318	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.326895
[23]	valid_0's auc: 0.911516	valid_0's binary_logloss: 0.327129	valid_1's auc: 0.908399	valid_1's binary_logloss: 0.325605
[24]	valid_0's auc: 0.912071	valid_0's binary_logloss: 0.325197	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.324533
[25]	valid_0's auc: 0.912565	valid_0's binary_logloss: 0.32346	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.323367
[26]	valid_0's auc: 0.913085	valid_0's binary_logloss: 0.321718	valid_1's auc: 0.908727	valid_1's binary_logloss: 0.32235
[27]	valid_0's auc: 0.913463	valid_0's binary_logloss: 0.320353	valid_1's auc: 0.908852	valid_1's binary_logloss: 0.321517
[28]	valid_0's auc: 0.914088	valid_0's binary_logloss: 0.318707	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.320658
[29]	valid_0's auc: 0.914559	valid_0's binary_logloss: 0.317334	valid_1's auc: 0.909145	valid_1's binary_logloss: 0.319981
[30]	valid_0's auc: 0.915013	valid_0's binary_logloss: 0.316039	valid_1's auc: 0.909088	valid_1's binary_logloss: 0.319471
[31]	valid_0's auc: 0.91547	valid_0's binary_logloss: 0.314866	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.318967
[32]	valid_0's auc: 0.915905	valid_0's binary_logloss: 0.313722	valid_1's auc: 0.909153	valid_1's binary_logloss: 0.318498
[33]	valid_0's auc: 0.916402	valid_0's binary_logloss: 0.312547	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.317857
[34]	valid_0's auc: 0.916782	valid_0's binary_logloss: 0.31151	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.317474
[35]	valid_0's auc: 0.917186	valid_0's binary_logloss: 0.310488	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.317096
[36]	valid_0's auc: 0.917615	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.316717
[37]	valid_0's auc: 0.917959	valid_0's binary_logloss: 0.308601	valid_1's auc: 0.909527	valid_1's binary_logloss: 0.31637
[38]	valid_0's auc: 0.91833	valid_0's binary_logloss: 0.307708	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.316097
[39]	valid_0's auc: 0.918721	valid_0's binary_logloss: 0.306879	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315931
[40]	valid_0's auc: 0.919214	valid_0's binary_logloss: 0.305938	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.315667
[41]	valid_0's auc: 0.919596	valid_0's binary_logloss: 0.305087	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.315512
[42]	valid_0's auc: 0.919962	valid_0's binary_logloss: 0.304323	valid_1's auc: 0.909634	valid_1's binary_logloss: 0.315282
[43]	valid_0's auc: 0.920261	valid_0's binary_logloss: 0.303672	valid_1's auc: 0.909642	valid_1's binary_logloss: 0.315116
[44]	valid_0's auc: 0.920662	valid_0's binary_logloss: 0.302854	valid_1's auc: 0.909586	valid_1's binary_logloss: 0.315123
[45]	valid_0's auc: 0.921081	valid_0's binary_logloss: 0.301985	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314883
[46]	valid_0's auc: 0.92143	valid_0's binary_logloss: 0.301287	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.314969
[47]	valid_0's auc: 0.92185	valid_0's binary_logloss: 0.300487	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314862
[48]	valid_0's auc: 0.922167	valid_0's binary_logloss: 0.299817	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.314899
[49]	valid_0's auc: 0.922499	valid_0's binary_logloss: 0.299188	valid_1's auc: 0.909412	valid_1's binary_logloss: 0.314948
[50]	valid_0's auc: 0.922769	valid_0's binary_logloss: 0.298591	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.31487
[51]	valid_0's auc: 0.923028	valid_0's binary_logloss: 0.298016	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.314789
[52]	valid_0's auc: 0.92325	valid_0's binary_logloss: 0.297525	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.314792
[53]	valid_0's auc: 0.923583	valid_0's binary_logloss: 0.296929	valid_1's auc: 0.909322	valid_1's binary_logloss: 0.314853
[54]	valid_0's auc: 0.923883	valid_0's binary_logloss: 0.29637	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314759
[55]	valid_0's auc: 0.924151	valid_0's binary_logloss: 0.295834	valid_1's auc: 0.909512	valid_1's binary_logloss: 0.314504
[56]	valid_0's auc: 0.924447	valid_0's binary_logloss: 0.295236	valid_1's auc: 0.909387	valid_1's binary_logloss: 0.314599
[57]	valid_0's auc: 0.92469	valid_0's binary_logloss: 0.294835	valid_1's auc: 0.909312	valid_1's binary_logloss: 0.314692
[58]	valid_0's auc: 0.924978	valid_0's binary_logloss: 0.294298	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314614
[59]	valid_0's auc: 0.92525	valid_0's binary_logloss: 0.293785	valid_1's auc: 0.909413	valid_1's binary_logloss: 0.314573
[60]	valid_0's auc: 0.925491	valid_0's binary_logloss: 0.293351	valid_1's auc: 0.909277	valid_1's binary_logloss: 0.314769
[61]	valid_0's auc: 0.925811	valid_0's binary_logloss: 0.292779	valid_1's auc: 0.909305	valid_1's binary_logloss: 0.31473
[62]	valid_0's auc: 0.926232	valid_0's binary_logloss: 0.292119	valid_1's auc: 0.909224	valid_1's binary_logloss: 0.314874
[63]	valid_0's auc: 0.926507	valid_0's binary_logloss: 0.291604	valid_1's auc: 0.909282	valid_1's binary_logloss: 0.314801
[64]	valid_0's auc: 0.926781	valid_0's binary_logloss: 0.29112	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.31489
[65]	valid_0's auc: 0.927027	valid_0's binary_logloss: 0.290641	valid_1's auc: 0.909225	valid_1's binary_logloss: 0.314843
[66]	valid_0's auc: 0.927268	valid_0's binary_logloss: 0.290255	valid_1's auc: 0.909174	valid_1's binary_logloss: 0.314955
[67]	valid_0's auc: 0.927615	valid_0's binary_logloss: 0.289645	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.314967
[68]	valid_0's auc: 0.927841	valid_0's binary_logloss: 0.289156	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.314937
[69]	valid_0's auc: 0.928156	valid_0's binary_logloss: 0.288614	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315212
[70]	valid_0's auc: 0.928588	valid_0's binary_logloss: 0.287949	valid_1's auc: 0.90916	valid_1's binary_logloss: 0.314991
[71]	valid_0's auc: 0.928892	valid_0's binary_logloss: 0.287442	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.315088
[72]	valid_0's auc: 0.929023	valid_0's binary_logloss: 0.287193	valid_1's auc: 0.909078	valid_1's binary_logloss: 0.315107
[73]	valid_0's auc: 0.929329	valid_0's binary_logloss: 0.286701	valid_1's auc: 0.909084	valid_1's binary_logloss: 0.315099
[74]	valid_0's auc: 0.929556	valid_0's binary_logloss: 0.286232	valid_1's auc: 0.909048	valid_1's binary_logloss: 0.3152
[75]	valid_0's auc: 0.929861	valid_0's binary_logloss: 0.285673	valid_1's auc: 0.908986	valid_1's binary_logloss: 0.31532
[76]	valid_0's auc: 0.930189	valid_0's binary_logloss: 0.285142	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.315571
[77]	valid_0's auc: 0.930399	valid_0's binary_logloss: 0.284728	valid_1's auc: 0.908845	valid_1's binary_logloss: 0.315576
[78]	valid_0's auc: 0.930645	valid_0's binary_logloss: 0.284312	valid_1's auc: 0.908951	valid_1's binary_logloss: 0.315348
[79]	valid_0's auc: 0.930901	valid_0's binary_logloss: 0.283869	valid_1's auc: 0.908812	valid_1's binary_logloss: 0.315599
[80]	valid_0's auc: 0.931126	valid_0's binary_logloss: 0.283444	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.315577
[81]	valid_0's auc: 0.931394	valid_0's binary_logloss: 0.283008	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.315525
[82]	valid_0's auc: 0.931579	valid_0's binary_logloss: 0.282706	valid_1's auc: 0.908879	valid_1's binary_logloss: 0.315528
[83]	valid_0's auc: 0.931844	valid_0's binary_logloss: 0.282301	valid_1's auc: 0.908808	valid_1's binary_logloss: 0.315657
[84]	valid_0's auc: 0.932088	valid_0's binary_logloss: 0.281844	valid_1's auc: 0.908769	valid_1's binary_logloss: 0.315693
[85]	valid_0's auc: 0.932298	valid_0's binary_logloss: 0.281441	valid_1's auc: 0.908795	valid_1's binary_logloss: 0.315703
[86]	valid_0's auc: 0.93247	valid_0's binary_logloss: 0.281108	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.315849
[87]	valid_0's auc: 0.932719	valid_0's binary_logloss: 0.28065	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.315878
[88]	valid_0's auc: 0.932935	valid_0's binary_logloss: 0.280274	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.315917
[89]	valid_0's auc: 0.933082	valid_0's binary_logloss: 0.279995	valid_1's auc: 0.908618	valid_1's binary_logloss: 0.316062
[90]	valid_0's auc: 0.933344	valid_0's binary_logloss: 0.279565	valid_1's auc: 0.908424	valid_1's binary_logloss: 0.316377
[91]	valid_0's auc: 0.933567	valid_0's binary_logloss: 0.279171	valid_1's auc: 0.908394	valid_1's binary_logloss: 0.316424
[92]	valid_0's auc: 0.933817	valid_0's binary_logloss: 0.27875	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316582
[93]	valid_0's auc: 0.934051	valid_0's binary_logloss: 0.278319	valid_1's auc: 0.908201	valid_1's binary_logloss: 0.316733
[94]	valid_0's auc: 0.934234	valid_0's binary_logloss: 0.278004	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.316673
[95]	valid_0's auc: 0.9344	valid_0's binary_logloss: 0.277691	valid_1's auc: 0.908146	valid_1's binary_logloss: 0.31691
[96]	valid_0's auc: 0.934601	valid_0's binary_logloss: 0.277328	valid_1's auc: 0.908034	valid_1's binary_logloss: 0.317106
[97]	valid_0's auc: 0.934782	valid_0's binary_logloss: 0.276996	valid_1's auc: 0.907954	valid_1's binary_logloss: 0.317305
[98]	valid_0's auc: 0.934929	valid_0's binary_logloss: 0.276705	valid_1's auc: 0.907881	valid_1's binary_logloss: 0.31743
[99]	valid_0's auc: 0.935076	valid_0's binary_logloss: 0.276401	valid_1's auc: 0.907856	valid_1's binary_logloss: 0.31754
[100]	valid_0's auc: 0.935297	valid_0's binary_logloss: 0.276022	valid_1's auc: 0.907719	valid_1's binary_logloss: 0.317787
[101]	valid_0's auc: 0.935483	valid_0's binary_logloss: 0.275687	valid_1's auc: 0.90776	valid_1's binary_logloss: 0.317757
[102]	valid_0's auc: 0.935739	valid_0's binary_logloss: 0.27526	valid_1's auc: 0.907729	valid_1's binary_logloss: 0.317832
[103]	valid_0's auc: 0.935939	valid_0's binary_logloss: 0.274892	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318103
[104]	valid_0's auc: 0.936021	valid_0's binary_logloss: 0.274727	valid_1's auc: 0.907529	valid_1's binary_logloss: 0.31818
[105]	valid_0's auc: 0.93623	valid_0's binary_logloss: 0.274383	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.318173
[106]	valid_0's auc: 0.936313	valid_0's binary_logloss: 0.274222	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318255
[107]	valid_0's auc: 0.936538	valid_0's binary_logloss: 0.273849	valid_1's auc: 0.907395	valid_1's binary_logloss: 0.318435
[108]	valid_0's auc: 0.936728	valid_0's binary_logloss: 0.273515	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.31856
[109]	valid_0's auc: 0.936842	valid_0's binary_logloss: 0.273321	valid_1's auc: 0.907341	valid_1's binary_logloss: 0.318588
[110]	valid_0's auc: 0.937006	valid_0's binary_logloss: 0.27302	valid_1's auc: 0.907319	valid_1's binary_logloss: 0.318684
[111]	valid_0's auc: 0.93726	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.907362	valid_1's binary_logloss: 0.318587
[112]	valid_0's auc: 0.937335	valid_0's binary_logloss: 0.272447	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318566
[113]	valid_0's auc: 0.937435	valid_0's binary_logloss: 0.272272	valid_1's auc: 0.90733	valid_1's binary_logloss: 0.318674
[114]	valid_0's auc: 0.937647	valid_0's binary_logloss: 0.271865	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318784
[115]	valid_0's auc: 0.937904	valid_0's binary_logloss: 0.271417	valid_1's auc: 0.907286	valid_1's binary_logloss: 0.318768
[116]	valid_0's auc: 0.938114	valid_0's binary_logloss: 0.271029	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.318884
[117]	valid_0's auc: 0.93827	valid_0's binary_logloss: 0.27072	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.319005
[118]	valid_0's auc: 0.938429	valid_0's binary_logloss: 0.270421	valid_1's auc: 0.907194	valid_1's binary_logloss: 0.31903
[119]	valid_0's auc: 0.938578	valid_0's binary_logloss: 0.27014	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.319181
[120]	valid_0's auc: 0.938728	valid_0's binary_logloss: 0.269851	valid_1's auc: 0.907129	valid_1's binary_logloss: 0.319193
[121]	valid_0's auc: 0.938883	valid_0's binary_logloss: 0.269553	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.319384
[122]	valid_0's auc: 0.939092	valid_0's binary_logloss: 0.269189	valid_1's auc: 0.906872	valid_1's binary_logloss: 0.31964
[123]	valid_0's auc: 0.939239	valid_0's binary_logloss: 0.26892	valid_1's auc: 0.906922	valid_1's binary_logloss: 0.319588
[124]	valid_0's auc: 0.939435	valid_0's binary_logloss: 0.268585	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.319846
[125]	valid_0's auc: 0.939643	valid_0's binary_logloss: 0.268179	valid_1's auc: 0.906724	valid_1's binary_logloss: 0.319991
[126]	valid_0's auc: 0.939878	valid_0's binary_logloss: 0.267727	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.32017
[127]	valid_0's auc: 0.940041	valid_0's binary_logloss: 0.267408	valid_1's auc: 0.906565	valid_1's binary_logloss: 0.320258
[128]	valid_0's auc: 0.940213	valid_0's binary_logloss: 0.267094	valid_1's auc: 0.906408	valid_1's binary_logloss: 0.320551
[129]	valid_0's auc: 0.940472	valid_0's binary_logloss: 0.266673	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.320736
[130]	valid_0's auc: 0.940599	valid_0's binary_logloss: 0.266403	valid_1's auc: 0.906308	valid_1's binary_logloss: 0.320749
[131]	valid_0's auc: 0.9408	valid_0's binary_logloss: 0.266038	valid_1's auc: 0.90625	valid_1's binary_logloss: 0.320875
[132]	valid_0's auc: 0.941025	valid_0's binary_logloss: 0.265635	valid_1's auc: 0.906104	valid_1's binary_logloss: 0.321131
[133]	valid_0's auc: 0.941163	valid_0's binary_logloss: 0.265371	valid_1's auc: 0.906053	valid_1's binary_logloss: 0.321214
[134]	valid_0's auc: 0.941274	valid_0's binary_logloss: 0.265178	valid_1's auc: 0.906033	valid_1's binary_logloss: 0.321227
[135]	valid_0's auc: 0.94145	valid_0's binary_logloss: 0.264854	valid_1's auc: 0.905954	valid_1's binary_logloss: 0.321423
[136]	valid_0's auc: 0.941626	valid_0's binary_logloss: 0.264555	valid_1's auc: 0.905913	valid_1's binary_logloss: 0.321526
[137]	valid_0's auc: 0.941764	valid_0's binary_logloss: 0.264298	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.321587
[138]	valid_0's auc: 0.941998	valid_0's binary_logloss: 0.263905	valid_1's auc: 0.905741	valid_1's binary_logloss: 0.321798
[139]	valid_0's auc: 0.942137	valid_0's binary_logloss: 0.263585	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.321806
[140]	valid_0's auc: 0.942314	valid_0's binary_logloss: 0.263261	valid_1's auc: 0.905664	valid_1's binary_logloss: 0.322003
[141]	valid_0's auc: 0.942483	valid_0's binary_logloss: 0.262973	valid_1's auc: 0.905598	valid_1's binary_logloss: 0.322157
[142]	valid_0's auc: 0.942616	valid_0's binary_logloss: 0.262687	valid_1's auc: 0.905692	valid_1's binary_logloss: 0.32203
[143]	valid_0's auc: 0.942767	valid_0's binary_logloss: 0.2624	valid_1's auc: 0.905667	valid_1's binary_logloss: 0.322112
[144]	valid_0's auc: 0.942937	valid_0's binary_logloss: 0.262058	valid_1's auc: 0.90561	valid_1's binary_logloss: 0.322264
[145]	valid_0's auc: 0.943116	valid_0's binary_logloss: 0.261722	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.322285
Early stopping, best iteration is:
[45]	valid_0's auc: 0.921081	valid_0's binary_logloss: 0.301985	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314883
[1]	valid_0's auc: 0.886951	valid_0's binary_logloss: 0.517075	valid_1's auc: 0.893067	valid_1's binary_logloss: 0.508488
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.88938	valid_0's binary_logloss: 0.488106	valid_1's auc: 0.896263	valid_1's binary_logloss: 0.478809
[3]	valid_0's auc: 0.891182	valid_0's binary_logloss: 0.464886	valid_1's auc: 0.896152	valid_1's binary_logloss: 0.455599
[4]	valid_0's auc: 0.895894	valid_0's binary_logloss: 0.44539	valid_1's auc: 0.900075	valid_1's binary_logloss: 0.43602
[5]	valid_0's auc: 0.896739	valid_0's binary_logloss: 0.42935	valid_1's auc: 0.901125	valid_1's binary_logloss: 0.419645
[6]	valid_0's auc: 0.897966	valid_0's binary_logloss: 0.415626	valid_1's auc: 0.901221	valid_1's binary_logloss: 0.406434
[7]	valid_0's auc: 0.899512	valid_0's binary_logloss: 0.403958	valid_1's auc: 0.90233	valid_1's binary_logloss: 0.394936
[8]	valid_0's auc: 0.900274	valid_0's binary_logloss: 0.393933	valid_1's auc: 0.902651	valid_1's binary_logloss: 0.385157
[9]	valid_0's auc: 0.900676	valid_0's binary_logloss: 0.385299	valid_1's auc: 0.902871	valid_1's binary_logloss: 0.376891
[10]	valid_0's auc: 0.901657	valid_0's binary_logloss: 0.377584	valid_1's auc: 0.903325	valid_1's binary_logloss: 0.369694
[11]	valid_0's auc: 0.902313	valid_0's binary_logloss: 0.370878	valid_1's auc: 0.903737	valid_1's binary_logloss: 0.363398
[12]	valid_0's auc: 0.903472	valid_0's binary_logloss: 0.364884	valid_1's auc: 0.90419	valid_1's binary_logloss: 0.35792
[13]	valid_0's auc: 0.904409	valid_0's binary_logloss: 0.359658	valid_1's auc: 0.904295	valid_1's binary_logloss: 0.353429
[14]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.35487	valid_1's auc: 0.904454	valid_1's binary_logloss: 0.349213
[15]	valid_0's auc: 0.906051	valid_0's binary_logloss: 0.350515	valid_1's auc: 0.904685	valid_1's binary_logloss: 0.345556
[16]	valid_0's auc: 0.906807	valid_0's binary_logloss: 0.346706	valid_1's auc: 0.905496	valid_1's binary_logloss: 0.342213
[17]	valid_0's auc: 0.907328	valid_0's binary_logloss: 0.343289	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.339192
[18]	valid_0's auc: 0.908084	valid_0's binary_logloss: 0.340079	valid_1's auc: 0.906207	valid_1's binary_logloss: 0.336494
[19]	valid_0's auc: 0.908583	valid_0's binary_logloss: 0.337307	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.334217
[20]	valid_0's auc: 0.909297	valid_0's binary_logloss: 0.334607	valid_1's auc: 0.906821	valid_1's binary_logloss: 0.332118
[21]	valid_0's auc: 0.909973	valid_0's binary_logloss: 0.332045	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.329869
[22]	valid_0's auc: 0.910689	valid_0's binary_logloss: 0.329736	valid_1's auc: 0.907445	valid_1's binary_logloss: 0.328419
[23]	valid_0's auc: 0.91125	valid_0's binary_logloss: 0.32772	valid_1's auc: 0.907486	valid_1's binary_logloss: 0.327031
[24]	valid_0's auc: 0.911734	valid_0's binary_logloss: 0.325914	valid_1's auc: 0.907401	valid_1's binary_logloss: 0.326007
[25]	valid_0's auc: 0.912237	valid_0's binary_logloss: 0.324151	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.32492
[26]	valid_0's auc: 0.912855	valid_0's binary_logloss: 0.322348	valid_1's auc: 0.907706	valid_1's binary_logloss: 0.323853
[27]	valid_0's auc: 0.913351	valid_0's binary_logloss: 0.320751	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.322916
[28]	valid_0's auc: 0.913918	valid_0's binary_logloss: 0.319267	valid_1's auc: 0.908082	valid_1's binary_logloss: 0.322092
[29]	valid_0's auc: 0.914317	valid_0's binary_logloss: 0.317929	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.321585
[30]	valid_0's auc: 0.914775	valid_0's binary_logloss: 0.316624	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.321139
[31]	valid_0's auc: 0.915234	valid_0's binary_logloss: 0.315369	valid_1's auc: 0.907906	valid_1's binary_logloss: 0.320746
[32]	valid_0's auc: 0.915573	valid_0's binary_logloss: 0.314259	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.320417
[33]	valid_0's auc: 0.916083	valid_0's binary_logloss: 0.31316	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.320248
[34]	valid_0's auc: 0.91653	valid_0's binary_logloss: 0.312094	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.319838
[35]	valid_0's auc: 0.916919	valid_0's binary_logloss: 0.311069	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.319583
[36]	valid_0's auc: 0.917504	valid_0's binary_logloss: 0.30988	valid_1's auc: 0.907767	valid_1's binary_logloss: 0.319455
[37]	valid_0's auc: 0.917825	valid_0's binary_logloss: 0.309029	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.319415
[38]	valid_0's auc: 0.91823	valid_0's binary_logloss: 0.308097	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.318928
[39]	valid_0's auc: 0.918545	valid_0's binary_logloss: 0.307294	valid_1's auc: 0.907692	valid_1's binary_logloss: 0.318778
[40]	valid_0's auc: 0.918951	valid_0's binary_logloss: 0.306507	valid_1's auc: 0.907562	valid_1's binary_logloss: 0.318828
[41]	valid_0's auc: 0.91937	valid_0's binary_logloss: 0.305627	valid_1's auc: 0.907605	valid_1's binary_logloss: 0.318644
[42]	valid_0's auc: 0.91976	valid_0's binary_logloss: 0.304849	valid_1's auc: 0.907597	valid_1's binary_logloss: 0.318495
[43]	valid_0's auc: 0.920154	valid_0's binary_logloss: 0.304024	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.318365
[44]	valid_0's auc: 0.920458	valid_0's binary_logloss: 0.303364	valid_1's auc: 0.90767	valid_1's binary_logloss: 0.318163
[45]	valid_0's auc: 0.920846	valid_0's binary_logloss: 0.30255	valid_1's auc: 0.907536	valid_1's binary_logloss: 0.318234
[46]	valid_0's auc: 0.921388	valid_0's binary_logloss: 0.301605	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318168
[47]	valid_0's auc: 0.921741	valid_0's binary_logloss: 0.300956	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.318087
[48]	valid_0's auc: 0.922021	valid_0's binary_logloss: 0.300339	valid_1's auc: 0.907561	valid_1's binary_logloss: 0.31805
[49]	valid_0's auc: 0.922277	valid_0's binary_logloss: 0.299855	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.318021
[50]	valid_0's auc: 0.922684	valid_0's binary_logloss: 0.299075	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.317961
[51]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.298476	valid_1's auc: 0.907465	valid_1's binary_logloss: 0.318069
[52]	valid_0's auc: 0.923311	valid_0's binary_logloss: 0.297877	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318093
[53]	valid_0's auc: 0.923717	valid_0's binary_logloss: 0.297146	valid_1's auc: 0.907276	valid_1's binary_logloss: 0.318175
[54]	valid_0's auc: 0.924003	valid_0's binary_logloss: 0.296561	valid_1's auc: 0.907393	valid_1's binary_logloss: 0.317938
[55]	valid_0's auc: 0.924273	valid_0's binary_logloss: 0.296048	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.317744
[56]	valid_0's auc: 0.924676	valid_0's binary_logloss: 0.295318	valid_1's auc: 0.907332	valid_1's binary_logloss: 0.317946
[57]	valid_0's auc: 0.925001	valid_0's binary_logloss: 0.294707	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.31797
[58]	valid_0's auc: 0.925375	valid_0's binary_logloss: 0.29402	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.317819
[59]	valid_0's auc: 0.9255	valid_0's binary_logloss: 0.293748	valid_1's auc: 0.907358	valid_1's binary_logloss: 0.317821
[60]	valid_0's auc: 0.925749	valid_0's binary_logloss: 0.293257	valid_1's auc: 0.907292	valid_1's binary_logloss: 0.317946
[61]	valid_0's auc: 0.926047	valid_0's binary_logloss: 0.292679	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318037
[62]	valid_0's auc: 0.926356	valid_0's binary_logloss: 0.292127	valid_1's auc: 0.907077	valid_1's binary_logloss: 0.318312
[63]	valid_0's auc: 0.92673	valid_0's binary_logloss: 0.291498	valid_1's auc: 0.907058	valid_1's binary_logloss: 0.318411
[64]	valid_0's auc: 0.927044	valid_0's binary_logloss: 0.290942	valid_1's auc: 0.907104	valid_1's binary_logloss: 0.318327
[65]	valid_0's auc: 0.927314	valid_0's binary_logloss: 0.29045	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.318339
[66]	valid_0's auc: 0.927579	valid_0's binary_logloss: 0.289948	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318207
[67]	valid_0's auc: 0.927724	valid_0's binary_logloss: 0.289678	valid_1's auc: 0.90717	valid_1's binary_logloss: 0.318213
[68]	valid_0's auc: 0.927985	valid_0's binary_logloss: 0.289184	valid_1's auc: 0.90715	valid_1's binary_logloss: 0.318251
[69]	valid_0's auc: 0.928262	valid_0's binary_logloss: 0.288694	valid_1's auc: 0.907036	valid_1's binary_logloss: 0.318459
[70]	valid_0's auc: 0.928557	valid_0's binary_logloss: 0.288165	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318587
[71]	valid_0's auc: 0.92888	valid_0's binary_logloss: 0.287556	valid_1's auc: 0.906954	valid_1's binary_logloss: 0.318587
[72]	valid_0's auc: 0.929098	valid_0's binary_logloss: 0.287164	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.318951
[73]	valid_0's auc: 0.929326	valid_0's binary_logloss: 0.28681	valid_1's auc: 0.906637	valid_1's binary_logloss: 0.319137
[74]	valid_0's auc: 0.929678	valid_0's binary_logloss: 0.286225	valid_1's auc: 0.9066	valid_1's binary_logloss: 0.319176
[75]	valid_0's auc: 0.929863	valid_0's binary_logloss: 0.285857	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.319288
[76]	valid_0's auc: 0.930125	valid_0's binary_logloss: 0.285387	valid_1's auc: 0.906526	valid_1's binary_logloss: 0.319259
[77]	valid_0's auc: 0.930301	valid_0's binary_logloss: 0.285025	valid_1's auc: 0.906532	valid_1's binary_logloss: 0.3193
[78]	valid_0's auc: 0.930523	valid_0's binary_logloss: 0.284607	valid_1's auc: 0.906509	valid_1's binary_logloss: 0.319352
[79]	valid_0's auc: 0.930735	valid_0's binary_logloss: 0.284177	valid_1's auc: 0.906489	valid_1's binary_logloss: 0.319369
[80]	valid_0's auc: 0.931025	valid_0's binary_logloss: 0.28366	valid_1's auc: 0.906547	valid_1's binary_logloss: 0.319296
[81]	valid_0's auc: 0.931243	valid_0's binary_logloss: 0.283253	valid_1's auc: 0.906463	valid_1's binary_logloss: 0.319448
[82]	valid_0's auc: 0.931538	valid_0's binary_logloss: 0.282767	valid_1's auc: 0.906358	valid_1's binary_logloss: 0.319596
[83]	valid_0's auc: 0.931777	valid_0's binary_logloss: 0.282346	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.319515
[84]	valid_0's auc: 0.932063	valid_0's binary_logloss: 0.281831	valid_1's auc: 0.906407	valid_1's binary_logloss: 0.31957
[85]	valid_0's auc: 0.932357	valid_0's binary_logloss: 0.281361	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.319759
[86]	valid_0's auc: 0.932545	valid_0's binary_logloss: 0.28101	valid_1's auc: 0.906405	valid_1's binary_logloss: 0.31961
[87]	valid_0's auc: 0.932641	valid_0's binary_logloss: 0.280824	valid_1's auc: 0.906367	valid_1's binary_logloss: 0.319719
[88]	valid_0's auc: 0.932884	valid_0's binary_logloss: 0.280387	valid_1's auc: 0.906275	valid_1's binary_logloss: 0.319916
[89]	valid_0's auc: 0.93302	valid_0's binary_logloss: 0.280147	valid_1's auc: 0.906105	valid_1's binary_logloss: 0.320216
[90]	valid_0's auc: 0.93325	valid_0's binary_logloss: 0.279732	valid_1's auc: 0.906073	valid_1's binary_logloss: 0.320288
[91]	valid_0's auc: 0.933481	valid_0's binary_logloss: 0.279311	valid_1's auc: 0.906095	valid_1's binary_logloss: 0.32029
[92]	valid_0's auc: 0.9337	valid_0's binary_logloss: 0.278931	valid_1's auc: 0.906092	valid_1's binary_logloss: 0.320357
[93]	valid_0's auc: 0.933885	valid_0's binary_logloss: 0.27861	valid_1's auc: 0.906003	valid_1's binary_logloss: 0.320577
[94]	valid_0's auc: 0.934064	valid_0's binary_logloss: 0.278253	valid_1's auc: 0.906067	valid_1's binary_logloss: 0.320527
[95]	valid_0's auc: 0.934218	valid_0's binary_logloss: 0.277965	valid_1's auc: 0.905971	valid_1's binary_logloss: 0.320689
[96]	valid_0's auc: 0.934431	valid_0's binary_logloss: 0.277541	valid_1's auc: 0.905837	valid_1's binary_logloss: 0.320955
[97]	valid_0's auc: 0.934697	valid_0's binary_logloss: 0.277085	valid_1's auc: 0.905817	valid_1's binary_logloss: 0.320998
[98]	valid_0's auc: 0.934809	valid_0's binary_logloss: 0.276898	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.321142
[99]	valid_0's auc: 0.934967	valid_0's binary_logloss: 0.276635	valid_1's auc: 0.905753	valid_1's binary_logloss: 0.321125
[100]	valid_0's auc: 0.935137	valid_0's binary_logloss: 0.276325	valid_1's auc: 0.905682	valid_1's binary_logloss: 0.321256
[101]	valid_0's auc: 0.935382	valid_0's binary_logloss: 0.275869	valid_1's auc: 0.905617	valid_1's binary_logloss: 0.321467
[102]	valid_0's auc: 0.93553	valid_0's binary_logloss: 0.275564	valid_1's auc: 0.905524	valid_1's binary_logloss: 0.321629
[103]	valid_0's auc: 0.93571	valid_0's binary_logloss: 0.275264	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.321751
[104]	valid_0's auc: 0.935965	valid_0's binary_logloss: 0.274845	valid_1's auc: 0.905473	valid_1's binary_logloss: 0.321725
[105]	valid_0's auc: 0.936135	valid_0's binary_logloss: 0.27451	valid_1's auc: 0.90527	valid_1's binary_logloss: 0.32205
[106]	valid_0's auc: 0.936342	valid_0's binary_logloss: 0.274145	valid_1's auc: 0.905326	valid_1's binary_logloss: 0.322028
[107]	valid_0's auc: 0.9364	valid_0's binary_logloss: 0.274043	valid_1's auc: 0.905226	valid_1's binary_logloss: 0.322186
[108]	valid_0's auc: 0.936593	valid_0's binary_logloss: 0.273682	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.322071
[109]	valid_0's auc: 0.936751	valid_0's binary_logloss: 0.273424	valid_1's auc: 0.905275	valid_1's binary_logloss: 0.322088
[110]	valid_0's auc: 0.936973	valid_0's binary_logloss: 0.273036	valid_1's auc: 0.905225	valid_1's binary_logloss: 0.322155
[111]	valid_0's auc: 0.937234	valid_0's binary_logloss: 0.272568	valid_1's auc: 0.905107	valid_1's binary_logloss: 0.322427
[112]	valid_0's auc: 0.937531	valid_0's binary_logloss: 0.272014	valid_1's auc: 0.905065	valid_1's binary_logloss: 0.322537
[113]	valid_0's auc: 0.937727	valid_0's binary_logloss: 0.271664	valid_1's auc: 0.904945	valid_1's binary_logloss: 0.322785
[114]	valid_0's auc: 0.937932	valid_0's binary_logloss: 0.271266	valid_1's auc: 0.904823	valid_1's binary_logloss: 0.322972
[115]	valid_0's auc: 0.938108	valid_0's binary_logloss: 0.270938	valid_1's auc: 0.904743	valid_1's binary_logloss: 0.323147
[116]	valid_0's auc: 0.938294	valid_0's binary_logloss: 0.270575	valid_1's auc: 0.904833	valid_1's binary_logloss: 0.323066
[117]	valid_0's auc: 0.938361	valid_0's binary_logloss: 0.270433	valid_1's auc: 0.904784	valid_1's binary_logloss: 0.323155
[118]	valid_0's auc: 0.938572	valid_0's binary_logloss: 0.270047	valid_1's auc: 0.904765	valid_1's binary_logloss: 0.323208
[119]	valid_0's auc: 0.938786	valid_0's binary_logloss: 0.269671	valid_1's auc: 0.904648	valid_1's binary_logloss: 0.323345
[120]	valid_0's auc: 0.938956	valid_0's binary_logloss: 0.269353	valid_1's auc: 0.904628	valid_1's binary_logloss: 0.323428
[121]	valid_0's auc: 0.939069	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.904585	valid_1's binary_logloss: 0.323517
[122]	valid_0's auc: 0.939228	valid_0's binary_logloss: 0.268855	valid_1's auc: 0.904603	valid_1's binary_logloss: 0.323459
[123]	valid_0's auc: 0.939371	valid_0's binary_logloss: 0.268571	valid_1's auc: 0.904602	valid_1's binary_logloss: 0.323494
[124]	valid_0's auc: 0.939597	valid_0's binary_logloss: 0.268186	valid_1's auc: 0.904542	valid_1's binary_logloss: 0.323636
[125]	valid_0's auc: 0.93966	valid_0's binary_logloss: 0.268064	valid_1's auc: 0.904485	valid_1's binary_logloss: 0.323754
[126]	valid_0's auc: 0.939885	valid_0's binary_logloss: 0.267653	valid_1's auc: 0.90437	valid_1's binary_logloss: 0.323973
[127]	valid_0's auc: 0.94009	valid_0's binary_logloss: 0.267311	valid_1's auc: 0.904285	valid_1's binary_logloss: 0.324156
[128]	valid_0's auc: 0.940268	valid_0's binary_logloss: 0.266948	valid_1's auc: 0.904328	valid_1's binary_logloss: 0.324122
Early stopping, best iteration is:
[28]	valid_0's auc: 0.913918	valid_0's binary_logloss: 0.319267	valid_1's auc: 0.908082	valid_1's binary_logloss: 0.322092
[1]	valid_0's auc: 0.887462	valid_0's binary_logloss: 0.51703	valid_1's auc: 0.894485	valid_1's binary_logloss: 0.508323
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891154	valid_0's binary_logloss: 0.488204	valid_1's auc: 0.897176	valid_1's binary_logloss: 0.478744
[3]	valid_0's auc: 0.891804	valid_0's binary_logloss: 0.465194	valid_1's auc: 0.89747	valid_1's binary_logloss: 0.455444
[4]	valid_0's auc: 0.894831	valid_0's binary_logloss: 0.446304	valid_1's auc: 0.89973	valid_1's binary_logloss: 0.436459
[5]	valid_0's auc: 0.896638	valid_0's binary_logloss: 0.430189	valid_1's auc: 0.901137	valid_1's binary_logloss: 0.420345
[6]	valid_0's auc: 0.897554	valid_0's binary_logloss: 0.416605	valid_1's auc: 0.901277	valid_1's binary_logloss: 0.406735
[7]	valid_0's auc: 0.898818	valid_0's binary_logloss: 0.404965	valid_1's auc: 0.902495	valid_1's binary_logloss: 0.395091
[8]	valid_0's auc: 0.899599	valid_0's binary_logloss: 0.394892	valid_1's auc: 0.902897	valid_1's binary_logloss: 0.384982
[9]	valid_0's auc: 0.900002	valid_0's binary_logloss: 0.386213	valid_1's auc: 0.903464	valid_1's binary_logloss: 0.376485
[10]	valid_0's auc: 0.90114	valid_0's binary_logloss: 0.378489	valid_1's auc: 0.904002	valid_1's binary_logloss: 0.369393
[11]	valid_0's auc: 0.902141	valid_0's binary_logloss: 0.371758	valid_1's auc: 0.90444	valid_1's binary_logloss: 0.362989
[12]	valid_0's auc: 0.903312	valid_0's binary_logloss: 0.365802	valid_1's auc: 0.905002	valid_1's binary_logloss: 0.357566
[13]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.360438	valid_1's auc: 0.9049	valid_1's binary_logloss: 0.352735
[14]	valid_0's auc: 0.904872	valid_0's binary_logloss: 0.355607	valid_1's auc: 0.905732	valid_1's binary_logloss: 0.348375
[15]	valid_0's auc: 0.905862	valid_0's binary_logloss: 0.351052	valid_1's auc: 0.905976	valid_1's binary_logloss: 0.344517
[16]	valid_0's auc: 0.906477	valid_0's binary_logloss: 0.347207	valid_1's auc: 0.906222	valid_1's binary_logloss: 0.341397
[17]	valid_0's auc: 0.907078	valid_0's binary_logloss: 0.343688	valid_1's auc: 0.906537	valid_1's binary_logloss: 0.338437
[18]	valid_0's auc: 0.90752	valid_0's binary_logloss: 0.340684	valid_1's auc: 0.906709	valid_1's binary_logloss: 0.335981
[19]	valid_0's auc: 0.908432	valid_0's binary_logloss: 0.337645	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.333599
[20]	valid_0's auc: 0.908981	valid_0's binary_logloss: 0.335146	valid_1's auc: 0.907099	valid_1's binary_logloss: 0.331801
[21]	valid_0's auc: 0.909679	valid_0's binary_logloss: 0.332538	valid_1's auc: 0.907277	valid_1's binary_logloss: 0.330028
[22]	valid_0's auc: 0.910393	valid_0's binary_logloss: 0.330279	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.328314
[23]	valid_0's auc: 0.910924	valid_0's binary_logloss: 0.328261	valid_1's auc: 0.90754	valid_1's binary_logloss: 0.326981
[24]	valid_0's auc: 0.911443	valid_0's binary_logloss: 0.326385	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.325796
[25]	valid_0's auc: 0.912077	valid_0's binary_logloss: 0.324538	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.32473
[26]	valid_0's auc: 0.912576	valid_0's binary_logloss: 0.322893	valid_1's auc: 0.907637	valid_1's binary_logloss: 0.323819
[27]	valid_0's auc: 0.913175	valid_0's binary_logloss: 0.321194	valid_1's auc: 0.907828	valid_1's binary_logloss: 0.322828
[28]	valid_0's auc: 0.913644	valid_0's binary_logloss: 0.31979	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.322042
[29]	valid_0's auc: 0.914118	valid_0's binary_logloss: 0.318401	valid_1's auc: 0.908115	valid_1's binary_logloss: 0.321181
[30]	valid_0's auc: 0.914589	valid_0's binary_logloss: 0.317022	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.32041
[31]	valid_0's auc: 0.91499	valid_0's binary_logloss: 0.315844	valid_1's auc: 0.908545	valid_1's binary_logloss: 0.319662
[32]	valid_0's auc: 0.915507	valid_0's binary_logloss: 0.314533	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.319046
[33]	valid_0's auc: 0.915824	valid_0's binary_logloss: 0.313594	valid_1's auc: 0.908668	valid_1's binary_logloss: 0.318595
[34]	valid_0's auc: 0.91636	valid_0's binary_logloss: 0.312316	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.318074
[35]	valid_0's auc: 0.916909	valid_0's binary_logloss: 0.311113	valid_1's auc: 0.908705	valid_1's binary_logloss: 0.317806
[36]	valid_0's auc: 0.91738	valid_0's binary_logloss: 0.310061	valid_1's auc: 0.90869	valid_1's binary_logloss: 0.317615
[37]	valid_0's auc: 0.917622	valid_0's binary_logloss: 0.309353	valid_1's auc: 0.908669	valid_1's binary_logloss: 0.317339
[38]	valid_0's auc: 0.918138	valid_0's binary_logloss: 0.308206	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.317113
[39]	valid_0's auc: 0.918442	valid_0's binary_logloss: 0.30749	valid_1's auc: 0.908623	valid_1's binary_logloss: 0.316968
[40]	valid_0's auc: 0.91882	valid_0's binary_logloss: 0.306644	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.316715
[41]	valid_0's auc: 0.91923	valid_0's binary_logloss: 0.305816	valid_1's auc: 0.908718	valid_1's binary_logloss: 0.316525
[42]	valid_0's auc: 0.919663	valid_0's binary_logloss: 0.304901	valid_1's auc: 0.90869	valid_1's binary_logloss: 0.316399
[43]	valid_0's auc: 0.920176	valid_0's binary_logloss: 0.303959	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.316434
[44]	valid_0's auc: 0.920583	valid_0's binary_logloss: 0.303137	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.31641
[45]	valid_0's auc: 0.920931	valid_0's binary_logloss: 0.302411	valid_1's auc: 0.908537	valid_1's binary_logloss: 0.316298
[46]	valid_0's auc: 0.921312	valid_0's binary_logloss: 0.301733	valid_1's auc: 0.908563	valid_1's binary_logloss: 0.316212
[47]	valid_0's auc: 0.921661	valid_0's binary_logloss: 0.301001	valid_1's auc: 0.908668	valid_1's binary_logloss: 0.316022
[48]	valid_0's auc: 0.921971	valid_0's binary_logloss: 0.300378	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.31605
[49]	valid_0's auc: 0.922377	valid_0's binary_logloss: 0.299607	valid_1's auc: 0.908723	valid_1's binary_logloss: 0.315742
[50]	valid_0's auc: 0.922718	valid_0's binary_logloss: 0.298922	valid_1's auc: 0.908844	valid_1's binary_logloss: 0.315538
[51]	valid_0's auc: 0.922958	valid_0's binary_logloss: 0.298409	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.315673
[52]	valid_0's auc: 0.923253	valid_0's binary_logloss: 0.297769	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.315405
[53]	valid_0's auc: 0.92357	valid_0's binary_logloss: 0.297153	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.315423
[54]	valid_0's auc: 0.92373	valid_0's binary_logloss: 0.296878	valid_1's auc: 0.908793	valid_1's binary_logloss: 0.315419
[55]	valid_0's auc: 0.924118	valid_0's binary_logloss: 0.296128	valid_1's auc: 0.908734	valid_1's binary_logloss: 0.315493
[56]	valid_0's auc: 0.924481	valid_0's binary_logloss: 0.295466	valid_1's auc: 0.908694	valid_1's binary_logloss: 0.315526
[57]	valid_0's auc: 0.924679	valid_0's binary_logloss: 0.295084	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.315669
[58]	valid_0's auc: 0.925005	valid_0's binary_logloss: 0.294523	valid_1's auc: 0.908414	valid_1's binary_logloss: 0.315865
[59]	valid_0's auc: 0.925247	valid_0's binary_logloss: 0.294043	valid_1's auc: 0.908459	valid_1's binary_logloss: 0.31584
[60]	valid_0's auc: 0.925304	valid_0's binary_logloss: 0.293893	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.315821
[61]	valid_0's auc: 0.925643	valid_0's binary_logloss: 0.293274	valid_1's auc: 0.908486	valid_1's binary_logloss: 0.315766
[62]	valid_0's auc: 0.925914	valid_0's binary_logloss: 0.292825	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.315835
[63]	valid_0's auc: 0.926266	valid_0's binary_logloss: 0.292204	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.31586
[64]	valid_0's auc: 0.92647	valid_0's binary_logloss: 0.29185	valid_1's auc: 0.908326	valid_1's binary_logloss: 0.315951
[65]	valid_0's auc: 0.926728	valid_0's binary_logloss: 0.29134	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.315936
[66]	valid_0's auc: 0.927039	valid_0's binary_logloss: 0.290834	valid_1's auc: 0.908265	valid_1's binary_logloss: 0.316049
[67]	valid_0's auc: 0.927346	valid_0's binary_logloss: 0.290278	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.316258
[68]	valid_0's auc: 0.927684	valid_0's binary_logloss: 0.289728	valid_1's auc: 0.908104	valid_1's binary_logloss: 0.316346
[69]	valid_0's auc: 0.92795	valid_0's binary_logloss: 0.289263	valid_1's auc: 0.908083	valid_1's binary_logloss: 0.316347
[70]	valid_0's auc: 0.928141	valid_0's binary_logloss: 0.288886	valid_1's auc: 0.908047	valid_1's binary_logloss: 0.31635
[71]	valid_0's auc: 0.928451	valid_0's binary_logloss: 0.288392	valid_1's auc: 0.908057	valid_1's binary_logloss: 0.316344
[72]	valid_0's auc: 0.928747	valid_0's binary_logloss: 0.287861	valid_1's auc: 0.908051	valid_1's binary_logloss: 0.316399
[73]	valid_0's auc: 0.928844	valid_0's binary_logloss: 0.287703	valid_1's auc: 0.908023	valid_1's binary_logloss: 0.316456
[74]	valid_0's auc: 0.92919	valid_0's binary_logloss: 0.287153	valid_1's auc: 0.907997	valid_1's binary_logloss: 0.316547
[75]	valid_0's auc: 0.929364	valid_0's binary_logloss: 0.286793	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.316585
[76]	valid_0's auc: 0.929792	valid_0's binary_logloss: 0.286109	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.316731
[77]	valid_0's auc: 0.930014	valid_0's binary_logloss: 0.285734	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.316886
[78]	valid_0's auc: 0.930291	valid_0's binary_logloss: 0.285207	valid_1's auc: 0.907621	valid_1's binary_logloss: 0.317062
[79]	valid_0's auc: 0.930405	valid_0's binary_logloss: 0.285025	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317203
[80]	valid_0's auc: 0.930652	valid_0's binary_logloss: 0.284602	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.31735
[81]	valid_0's auc: 0.930942	valid_0's binary_logloss: 0.284097	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.317428
[82]	valid_0's auc: 0.931213	valid_0's binary_logloss: 0.2836	valid_1's auc: 0.907323	valid_1's binary_logloss: 0.317519
[83]	valid_0's auc: 0.931474	valid_0's binary_logloss: 0.283122	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.317635
[84]	valid_0's auc: 0.931711	valid_0's binary_logloss: 0.282702	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.317717
[85]	valid_0's auc: 0.931859	valid_0's binary_logloss: 0.282439	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.317854
[86]	valid_0's auc: 0.932056	valid_0's binary_logloss: 0.282089	valid_1's auc: 0.90721	valid_1's binary_logloss: 0.317876
[87]	valid_0's auc: 0.932326	valid_0's binary_logloss: 0.281665	valid_1's auc: 0.907193	valid_1's binary_logloss: 0.317908
[88]	valid_0's auc: 0.932537	valid_0's binary_logloss: 0.281286	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318008
[89]	valid_0's auc: 0.932781	valid_0's binary_logloss: 0.280858	valid_1's auc: 0.907118	valid_1's binary_logloss: 0.318071
[90]	valid_0's auc: 0.932865	valid_0's binary_logloss: 0.280715	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318249
[91]	valid_0's auc: 0.933094	valid_0's binary_logloss: 0.280277	valid_1's auc: 0.906882	valid_1's binary_logloss: 0.318489
[92]	valid_0's auc: 0.933364	valid_0's binary_logloss: 0.279795	valid_1's auc: 0.90685	valid_1's binary_logloss: 0.318564
[93]	valid_0's auc: 0.933635	valid_0's binary_logloss: 0.279308	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.318646
[94]	valid_0's auc: 0.933756	valid_0's binary_logloss: 0.279094	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.318653
[95]	valid_0's auc: 0.933989	valid_0's binary_logloss: 0.278712	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.318867
[96]	valid_0's auc: 0.93427	valid_0's binary_logloss: 0.278242	valid_1's auc: 0.906628	valid_1's binary_logloss: 0.318963
[97]	valid_0's auc: 0.934445	valid_0's binary_logloss: 0.27793	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319072
[98]	valid_0's auc: 0.934563	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.906574	valid_1's binary_logloss: 0.319093
[99]	valid_0's auc: 0.93468	valid_0's binary_logloss: 0.27748	valid_1's auc: 0.906524	valid_1's binary_logloss: 0.31919
[100]	valid_0's auc: 0.93487	valid_0's binary_logloss: 0.277133	valid_1's auc: 0.906498	valid_1's binary_logloss: 0.319209
[101]	valid_0's auc: 0.935074	valid_0's binary_logloss: 0.276752	valid_1's auc: 0.906391	valid_1's binary_logloss: 0.319466
[102]	valid_0's auc: 0.935328	valid_0's binary_logloss: 0.276325	valid_1's auc: 0.906288	valid_1's binary_logloss: 0.319622
[103]	valid_0's auc: 0.935529	valid_0's binary_logloss: 0.275918	valid_1's auc: 0.906225	valid_1's binary_logloss: 0.319762
[104]	valid_0's auc: 0.935735	valid_0's binary_logloss: 0.275514	valid_1's auc: 0.906215	valid_1's binary_logloss: 0.319775
[105]	valid_0's auc: 0.935896	valid_0's binary_logloss: 0.275222	valid_1's auc: 0.906251	valid_1's binary_logloss: 0.319758
[106]	valid_0's auc: 0.936121	valid_0's binary_logloss: 0.274847	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.319791
[107]	valid_0's auc: 0.936357	valid_0's binary_logloss: 0.27444	valid_1's auc: 0.906127	valid_1's binary_logloss: 0.320039
[108]	valid_0's auc: 0.93656	valid_0's binary_logloss: 0.274051	valid_1's auc: 0.906135	valid_1's binary_logloss: 0.320029
[109]	valid_0's auc: 0.936749	valid_0's binary_logloss: 0.273691	valid_1's auc: 0.906016	valid_1's binary_logloss: 0.320246
[110]	valid_0's auc: 0.936876	valid_0's binary_logloss: 0.273436	valid_1's auc: 0.906046	valid_1's binary_logloss: 0.320193
[111]	valid_0's auc: 0.937038	valid_0's binary_logloss: 0.27311	valid_1's auc: 0.905961	valid_1's binary_logloss: 0.320384
[112]	valid_0's auc: 0.937218	valid_0's binary_logloss: 0.272753	valid_1's auc: 0.90595	valid_1's binary_logloss: 0.320386
[113]	valid_0's auc: 0.937456	valid_0's binary_logloss: 0.272344	valid_1's auc: 0.905862	valid_1's binary_logloss: 0.320581
[114]	valid_0's auc: 0.937628	valid_0's binary_logloss: 0.272054	valid_1's auc: 0.905758	valid_1's binary_logloss: 0.320733
[115]	valid_0's auc: 0.937872	valid_0's binary_logloss: 0.271641	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320608
[116]	valid_0's auc: 0.938059	valid_0's binary_logloss: 0.271324	valid_1's auc: 0.905822	valid_1's binary_logloss: 0.320713
[117]	valid_0's auc: 0.938117	valid_0's binary_logloss: 0.271214	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.32077
[118]	valid_0's auc: 0.938249	valid_0's binary_logloss: 0.270922	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.320943
[119]	valid_0's auc: 0.938352	valid_0's binary_logloss: 0.270666	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.320893
[120]	valid_0's auc: 0.938471	valid_0's binary_logloss: 0.270449	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.320929
[121]	valid_0's auc: 0.938605	valid_0's binary_logloss: 0.270174	valid_1's auc: 0.905806	valid_1's binary_logloss: 0.320922
[122]	valid_0's auc: 0.938704	valid_0's binary_logloss: 0.269949	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.321135
[123]	valid_0's auc: 0.938915	valid_0's binary_logloss: 0.269555	valid_1's auc: 0.905659	valid_1's binary_logloss: 0.321218
[124]	valid_0's auc: 0.939044	valid_0's binary_logloss: 0.269295	valid_1's auc: 0.905488	valid_1's binary_logloss: 0.321515
[125]	valid_0's auc: 0.939113	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.905458	valid_1's binary_logloss: 0.321587
[126]	valid_0's auc: 0.939285	valid_0's binary_logloss: 0.268875	valid_1's auc: 0.905381	valid_1's binary_logloss: 0.321725
[127]	valid_0's auc: 0.939443	valid_0's binary_logloss: 0.268588	valid_1's auc: 0.905335	valid_1's binary_logloss: 0.321828
[128]	valid_0's auc: 0.939595	valid_0's binary_logloss: 0.268319	valid_1's auc: 0.905252	valid_1's binary_logloss: 0.321979
[129]	valid_0's auc: 0.939662	valid_0's binary_logloss: 0.268193	valid_1's auc: 0.905212	valid_1's binary_logloss: 0.322058
[130]	valid_0's auc: 0.939841	valid_0's binary_logloss: 0.267863	valid_1's auc: 0.905186	valid_1's binary_logloss: 0.322213
[131]	valid_0's auc: 0.940072	valid_0's binary_logloss: 0.267451	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.322357
[132]	valid_0's auc: 0.940194	valid_0's binary_logloss: 0.267148	valid_1's auc: 0.905029	valid_1's binary_logloss: 0.322511
[133]	valid_0's auc: 0.940384	valid_0's binary_logloss: 0.26682	valid_1's auc: 0.905026	valid_1's binary_logloss: 0.322547
[134]	valid_0's auc: 0.940527	valid_0's binary_logloss: 0.266547	valid_1's auc: 0.904954	valid_1's binary_logloss: 0.322715
[135]	valid_0's auc: 0.9408	valid_0's binary_logloss: 0.266096	valid_1's auc: 0.904851	valid_1's binary_logloss: 0.322861
[136]	valid_0's auc: 0.940944	valid_0's binary_logloss: 0.265818	valid_1's auc: 0.904838	valid_1's binary_logloss: 0.322956
[137]	valid_0's auc: 0.941042	valid_0's binary_logloss: 0.265655	valid_1's auc: 0.904725	valid_1's binary_logloss: 0.323172
[138]	valid_0's auc: 0.941142	valid_0's binary_logloss: 0.26546	valid_1's auc: 0.904631	valid_1's binary_logloss: 0.323318
[139]	valid_0's auc: 0.941276	valid_0's binary_logloss: 0.265207	valid_1's auc: 0.904567	valid_1's binary_logloss: 0.323369
[140]	valid_0's auc: 0.941344	valid_0's binary_logloss: 0.265077	valid_1's auc: 0.904518	valid_1's binary_logloss: 0.323465
[141]	valid_0's auc: 0.941525	valid_0's binary_logloss: 0.264758	valid_1's auc: 0.904482	valid_1's binary_logloss: 0.323518
[142]	valid_0's auc: 0.94157	valid_0's binary_logloss: 0.264648	valid_1's auc: 0.904501	valid_1's binary_logloss: 0.323518
[143]	valid_0's auc: 0.941778	valid_0's binary_logloss: 0.264265	valid_1's auc: 0.904507	valid_1's binary_logloss: 0.32351
[144]	valid_0's auc: 0.941938	valid_0's binary_logloss: 0.263953	valid_1's auc: 0.904598	valid_1's binary_logloss: 0.32341
[145]	valid_0's auc: 0.942156	valid_0's binary_logloss: 0.263575	valid_1's auc: 0.904476	valid_1's binary_logloss: 0.323638
[146]	valid_0's auc: 0.942366	valid_0's binary_logloss: 0.26322	valid_1's auc: 0.904441	valid_1's binary_logloss: 0.323734
[147]	valid_0's auc: 0.942592	valid_0's binary_logloss: 0.262827	valid_1's auc: 0.904334	valid_1's binary_logloss: 0.323967
[148]	valid_0's auc: 0.942734	valid_0's binary_logloss: 0.26256	valid_1's auc: 0.904254	valid_1's binary_logloss: 0.32416
[149]	valid_0's auc: 0.942873	valid_0's binary_logloss: 0.26228	valid_1's auc: 0.9043	valid_1's binary_logloss: 0.324144
[150]	valid_0's auc: 0.94318	valid_0's binary_logloss: 0.261724	valid_1's auc: 0.904208	valid_1's binary_logloss: 0.324314
Early stopping, best iteration is:
[50]	valid_0's auc: 0.922718	valid_0's binary_logloss: 0.298922	valid_1's auc: 0.908844	valid_1's binary_logloss: 0.315538
[1]	valid_0's auc: 0.888429	valid_0's binary_logloss: 0.517259	valid_1's auc: 0.89287	valid_1's binary_logloss: 0.508675
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893364	valid_0's binary_logloss: 0.488149	valid_1's auc: 0.898668	valid_1's binary_logloss: 0.478942
[3]	valid_0's auc: 0.89471	valid_0's binary_logloss: 0.465013	valid_1's auc: 0.899211	valid_1's binary_logloss: 0.455077
[4]	valid_0's auc: 0.896499	valid_0's binary_logloss: 0.44573	valid_1's auc: 0.900476	valid_1's binary_logloss: 0.435755
[5]	valid_0's auc: 0.898292	valid_0's binary_logloss: 0.429749	valid_1's auc: 0.902577	valid_1's binary_logloss: 0.419702
[6]	valid_0's auc: 0.899447	valid_0's binary_logloss: 0.416012	valid_1's auc: 0.903628	valid_1's binary_logloss: 0.405945
[7]	valid_0's auc: 0.90016	valid_0's binary_logloss: 0.404313	valid_1's auc: 0.904037	valid_1's binary_logloss: 0.394294
[8]	valid_0's auc: 0.900845	valid_0's binary_logloss: 0.394355	valid_1's auc: 0.90441	valid_1's binary_logloss: 0.384406
[9]	valid_0's auc: 0.901491	valid_0's binary_logloss: 0.385709	valid_1's auc: 0.904431	valid_1's binary_logloss: 0.376154
[10]	valid_0's auc: 0.902463	valid_0's binary_logloss: 0.377832	valid_1's auc: 0.905143	valid_1's binary_logloss: 0.368695
[11]	valid_0's auc: 0.903181	valid_0's binary_logloss: 0.371016	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.362121
[12]	valid_0's auc: 0.904072	valid_0's binary_logloss: 0.36506	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.3563
[13]	valid_0's auc: 0.904711	valid_0's binary_logloss: 0.359719	valid_1's auc: 0.90629	valid_1's binary_logloss: 0.351666
[14]	valid_0's auc: 0.90523	valid_0's binary_logloss: 0.354954	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.347564
[15]	valid_0's auc: 0.906387	valid_0's binary_logloss: 0.350653	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.343895
[16]	valid_0's auc: 0.906883	valid_0's binary_logloss: 0.346912	valid_1's auc: 0.906609	valid_1's binary_logloss: 0.340725
[17]	valid_0's auc: 0.90755	valid_0's binary_logloss: 0.343412	valid_1's auc: 0.907061	valid_1's binary_logloss: 0.337858
[18]	valid_0's auc: 0.908164	valid_0's binary_logloss: 0.340268	valid_1's auc: 0.907267	valid_1's binary_logloss: 0.335306
[19]	valid_0's auc: 0.90889	valid_0's binary_logloss: 0.337258	valid_1's auc: 0.90776	valid_1's binary_logloss: 0.332727
[20]	valid_0's auc: 0.90941	valid_0's binary_logloss: 0.334606	valid_1's auc: 0.908151	valid_1's binary_logloss: 0.330547
[21]	valid_0's auc: 0.909787	valid_0's binary_logloss: 0.332353	valid_1's auc: 0.908241	valid_1's binary_logloss: 0.328858
[22]	valid_0's auc: 0.910425	valid_0's binary_logloss: 0.329976	valid_1's auc: 0.90849	valid_1's binary_logloss: 0.327017
[23]	valid_0's auc: 0.910985	valid_0's binary_logloss: 0.327906	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.325594
[24]	valid_0's auc: 0.911603	valid_0's binary_logloss: 0.325949	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.324322
[25]	valid_0's auc: 0.912176	valid_0's binary_logloss: 0.324138	valid_1's auc: 0.908768	valid_1's binary_logloss: 0.32328
[26]	valid_0's auc: 0.912673	valid_0's binary_logloss: 0.322529	valid_1's auc: 0.908666	valid_1's binary_logloss: 0.322518
[27]	valid_0's auc: 0.913087	valid_0's binary_logloss: 0.320998	valid_1's auc: 0.908551	valid_1's binary_logloss: 0.321904
[28]	valid_0's auc: 0.913654	valid_0's binary_logloss: 0.319369	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.32094
[29]	valid_0's auc: 0.914075	valid_0's binary_logloss: 0.318044	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.320494
[30]	valid_0's auc: 0.914561	valid_0's binary_logloss: 0.316755	valid_1's auc: 0.908679	valid_1's binary_logloss: 0.319887
[31]	valid_0's auc: 0.914972	valid_0's binary_logloss: 0.315593	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.3193
[32]	valid_0's auc: 0.915369	valid_0's binary_logloss: 0.314517	valid_1's auc: 0.909071	valid_1's binary_logloss: 0.318458
[33]	valid_0's auc: 0.915722	valid_0's binary_logloss: 0.313502	valid_1's auc: 0.909186	valid_1's binary_logloss: 0.317908
[34]	valid_0's auc: 0.916139	valid_0's binary_logloss: 0.312384	valid_1's auc: 0.909167	valid_1's binary_logloss: 0.317533
[35]	valid_0's auc: 0.916617	valid_0's binary_logloss: 0.311286	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.317049
[36]	valid_0's auc: 0.917004	valid_0's binary_logloss: 0.310382	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316817
[37]	valid_0's auc: 0.917431	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.316675
[38]	valid_0's auc: 0.917978	valid_0's binary_logloss: 0.308351	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.316474
[39]	valid_0's auc: 0.918388	valid_0's binary_logloss: 0.307376	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.316114
[40]	valid_0's auc: 0.918772	valid_0's binary_logloss: 0.306595	valid_1's auc: 0.909401	valid_1's binary_logloss: 0.315829
[41]	valid_0's auc: 0.919067	valid_0's binary_logloss: 0.305985	valid_1's auc: 0.909408	valid_1's binary_logloss: 0.315635
[42]	valid_0's auc: 0.919366	valid_0's binary_logloss: 0.305357	valid_1's auc: 0.909447	valid_1's binary_logloss: 0.315487
[43]	valid_0's auc: 0.919793	valid_0's binary_logloss: 0.304502	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.315409
[44]	valid_0's auc: 0.920061	valid_0's binary_logloss: 0.303848	valid_1's auc: 0.909353	valid_1's binary_logloss: 0.315367
[45]	valid_0's auc: 0.920352	valid_0's binary_logloss: 0.303271	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.315145
[46]	valid_0's auc: 0.920767	valid_0's binary_logloss: 0.302429	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.31481
[47]	valid_0's auc: 0.921195	valid_0's binary_logloss: 0.301635	valid_1's auc: 0.909638	valid_1's binary_logloss: 0.314662
[48]	valid_0's auc: 0.921536	valid_0's binary_logloss: 0.301019	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.314554
[49]	valid_0's auc: 0.921955	valid_0's binary_logloss: 0.300235	valid_1's auc: 0.909513	valid_1's binary_logloss: 0.314613
[50]	valid_0's auc: 0.922367	valid_0's binary_logloss: 0.299513	valid_1's auc: 0.909641	valid_1's binary_logloss: 0.314373
[51]	valid_0's auc: 0.922638	valid_0's binary_logloss: 0.298961	valid_1's auc: 0.909519	valid_1's binary_logloss: 0.31449
[52]	valid_0's auc: 0.922992	valid_0's binary_logloss: 0.298274	valid_1's auc: 0.909616	valid_1's binary_logloss: 0.314297
[53]	valid_0's auc: 0.923405	valid_0's binary_logloss: 0.297495	valid_1's auc: 0.909624	valid_1's binary_logloss: 0.314252
[54]	valid_0's auc: 0.923739	valid_0's binary_logloss: 0.296861	valid_1's auc: 0.909471	valid_1's binary_logloss: 0.314402
[55]	valid_0's auc: 0.924156	valid_0's binary_logloss: 0.296109	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.314407
[56]	valid_0's auc: 0.924417	valid_0's binary_logloss: 0.295532	valid_1's auc: 0.909403	valid_1's binary_logloss: 0.314513
[57]	valid_0's auc: 0.92463	valid_0's binary_logloss: 0.295137	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.314484
[58]	valid_0's auc: 0.924868	valid_0's binary_logloss: 0.294692	valid_1's auc: 0.909318	valid_1's binary_logloss: 0.314593
[59]	valid_0's auc: 0.925031	valid_0's binary_logloss: 0.294386	valid_1's auc: 0.909254	valid_1's binary_logloss: 0.314697
[60]	valid_0's auc: 0.925403	valid_0's binary_logloss: 0.293762	valid_1's auc: 0.909313	valid_1's binary_logloss: 0.314601
[61]	valid_0's auc: 0.925698	valid_0's binary_logloss: 0.293238	valid_1's auc: 0.909252	valid_1's binary_logloss: 0.314682
[62]	valid_0's auc: 0.925982	valid_0's binary_logloss: 0.292777	valid_1's auc: 0.909049	valid_1's binary_logloss: 0.314987
[63]	valid_0's auc: 0.926263	valid_0's binary_logloss: 0.292241	valid_1's auc: 0.909107	valid_1's binary_logloss: 0.314892
[64]	valid_0's auc: 0.926578	valid_0's binary_logloss: 0.291692	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.314942
[65]	valid_0's auc: 0.926824	valid_0's binary_logloss: 0.29131	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.315184
[66]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.29081	valid_1's auc: 0.908889	valid_1's binary_logloss: 0.315181
[67]	valid_0's auc: 0.927344	valid_0's binary_logloss: 0.290392	valid_1's auc: 0.908937	valid_1's binary_logloss: 0.315107
[68]	valid_0's auc: 0.927469	valid_0's binary_logloss: 0.290161	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315265
[69]	valid_0's auc: 0.927743	valid_0's binary_logloss: 0.289646	valid_1's auc: 0.908691	valid_1's binary_logloss: 0.315519
[70]	valid_0's auc: 0.928012	valid_0's binary_logloss: 0.28916	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.315758
[71]	valid_0's auc: 0.928296	valid_0's binary_logloss: 0.288657	valid_1's auc: 0.908443	valid_1's binary_logloss: 0.315894
[72]	valid_0's auc: 0.928446	valid_0's binary_logloss: 0.288413	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316016
[73]	valid_0's auc: 0.928739	valid_0's binary_logloss: 0.287912	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.316239
[74]	valid_0's auc: 0.929085	valid_0's binary_logloss: 0.287342	valid_1's auc: 0.908153	valid_1's binary_logloss: 0.316294
[75]	valid_0's auc: 0.929309	valid_0's binary_logloss: 0.286904	valid_1's auc: 0.908092	valid_1's binary_logloss: 0.316378
[76]	valid_0's auc: 0.92958	valid_0's binary_logloss: 0.286391	valid_1's auc: 0.908019	valid_1's binary_logloss: 0.316517
[77]	valid_0's auc: 0.929725	valid_0's binary_logloss: 0.286122	valid_1's auc: 0.908042	valid_1's binary_logloss: 0.316509
[78]	valid_0's auc: 0.93001	valid_0's binary_logloss: 0.285657	valid_1's auc: 0.907997	valid_1's binary_logloss: 0.31662
[79]	valid_0's auc: 0.930322	valid_0's binary_logloss: 0.28515	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.316691
[80]	valid_0's auc: 0.930548	valid_0's binary_logloss: 0.284787	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316735
[81]	valid_0's auc: 0.930648	valid_0's binary_logloss: 0.28461	valid_1's auc: 0.907964	valid_1's binary_logloss: 0.316721
[82]	valid_0's auc: 0.930816	valid_0's binary_logloss: 0.284306	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.316751
[83]	valid_0's auc: 0.931041	valid_0's binary_logloss: 0.283839	valid_1's auc: 0.907891	valid_1's binary_logloss: 0.316883
[84]	valid_0's auc: 0.931322	valid_0's binary_logloss: 0.283365	valid_1's auc: 0.907873	valid_1's binary_logloss: 0.316948
[85]	valid_0's auc: 0.931498	valid_0's binary_logloss: 0.283027	valid_1's auc: 0.907722	valid_1's binary_logloss: 0.317235
[86]	valid_0's auc: 0.931754	valid_0's binary_logloss: 0.282594	valid_1's auc: 0.907739	valid_1's binary_logloss: 0.317206
[87]	valid_0's auc: 0.932004	valid_0's binary_logloss: 0.282094	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.317247
[88]	valid_0's auc: 0.93222	valid_0's binary_logloss: 0.281702	valid_1's auc: 0.907748	valid_1's binary_logloss: 0.31727
[89]	valid_0's auc: 0.932374	valid_0's binary_logloss: 0.281433	valid_1's auc: 0.907709	valid_1's binary_logloss: 0.317396
[90]	valid_0's auc: 0.932615	valid_0's binary_logloss: 0.280976	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.317421
[91]	valid_0's auc: 0.932858	valid_0's binary_logloss: 0.280554	valid_1's auc: 0.907628	valid_1's binary_logloss: 0.31751
[92]	valid_0's auc: 0.933112	valid_0's binary_logloss: 0.280053	valid_1's auc: 0.907654	valid_1's binary_logloss: 0.317492
[93]	valid_0's auc: 0.933237	valid_0's binary_logloss: 0.279815	valid_1's auc: 0.907673	valid_1's binary_logloss: 0.317454
[94]	valid_0's auc: 0.933415	valid_0's binary_logloss: 0.279467	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.317575
[95]	valid_0's auc: 0.933681	valid_0's binary_logloss: 0.278992	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317669
[96]	valid_0's auc: 0.934074	valid_0's binary_logloss: 0.278372	valid_1's auc: 0.907517	valid_1's binary_logloss: 0.317795
[97]	valid_0's auc: 0.934276	valid_0's binary_logloss: 0.277993	valid_1's auc: 0.907495	valid_1's binary_logloss: 0.31785
[98]	valid_0's auc: 0.934483	valid_0's binary_logloss: 0.277572	valid_1's auc: 0.907388	valid_1's binary_logloss: 0.318059
[99]	valid_0's auc: 0.934701	valid_0's binary_logloss: 0.277192	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.31821
[100]	valid_0's auc: 0.934904	valid_0's binary_logloss: 0.27682	valid_1's auc: 0.90733	valid_1's binary_logloss: 0.31823
[101]	valid_0's auc: 0.935043	valid_0's binary_logloss: 0.276577	valid_1's auc: 0.907183	valid_1's binary_logloss: 0.318483
[102]	valid_0's auc: 0.935245	valid_0's binary_logloss: 0.276236	valid_1's auc: 0.907181	valid_1's binary_logloss: 0.318481
[103]	valid_0's auc: 0.935368	valid_0's binary_logloss: 0.27599	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.318524
[104]	valid_0's auc: 0.935575	valid_0's binary_logloss: 0.275605	valid_1's auc: 0.9071	valid_1's binary_logloss: 0.318678
[105]	valid_0's auc: 0.935859	valid_0's binary_logloss: 0.275138	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.318694
[106]	valid_0's auc: 0.936102	valid_0's binary_logloss: 0.274749	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.318699
[107]	valid_0's auc: 0.936329	valid_0's binary_logloss: 0.274345	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.31867
[108]	valid_0's auc: 0.936558	valid_0's binary_logloss: 0.273969	valid_1's auc: 0.907092	valid_1's binary_logloss: 0.318754
[109]	valid_0's auc: 0.936804	valid_0's binary_logloss: 0.273586	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318834
[110]	valid_0's auc: 0.936966	valid_0's binary_logloss: 0.273298	valid_1's auc: 0.906977	valid_1's binary_logloss: 0.318941
[111]	valid_0's auc: 0.937206	valid_0's binary_logloss: 0.272868	valid_1's auc: 0.906913	valid_1's binary_logloss: 0.319014
[112]	valid_0's auc: 0.937468	valid_0's binary_logloss: 0.272409	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.319233
[113]	valid_0's auc: 0.937607	valid_0's binary_logloss: 0.272133	valid_1's auc: 0.906704	valid_1's binary_logloss: 0.319419
[114]	valid_0's auc: 0.93777	valid_0's binary_logloss: 0.271825	valid_1's auc: 0.906764	valid_1's binary_logloss: 0.319344
[115]	valid_0's auc: 0.937839	valid_0's binary_logloss: 0.271712	valid_1's auc: 0.906723	valid_1's binary_logloss: 0.319418
[116]	valid_0's auc: 0.938023	valid_0's binary_logloss: 0.27138	valid_1's auc: 0.906741	valid_1's binary_logloss: 0.319423
[117]	valid_0's auc: 0.93816	valid_0's binary_logloss: 0.27112	valid_1's auc: 0.906719	valid_1's binary_logloss: 0.319503
[118]	valid_0's auc: 0.938402	valid_0's binary_logloss: 0.270714	valid_1's auc: 0.906501	valid_1's binary_logloss: 0.319795
[119]	valid_0's auc: 0.938644	valid_0's binary_logloss: 0.27028	valid_1's auc: 0.90641	valid_1's binary_logloss: 0.31996
[120]	valid_0's auc: 0.938869	valid_0's binary_logloss: 0.269859	valid_1's auc: 0.906334	valid_1's binary_logloss: 0.320085
[121]	valid_0's auc: 0.939085	valid_0's binary_logloss: 0.269442	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320392
[122]	valid_0's auc: 0.939216	valid_0's binary_logloss: 0.269181	valid_1's auc: 0.906099	valid_1's binary_logloss: 0.320532
[123]	valid_0's auc: 0.939431	valid_0's binary_logloss: 0.268804	valid_1's auc: 0.906011	valid_1's binary_logloss: 0.320714
[124]	valid_0's auc: 0.939658	valid_0's binary_logloss: 0.268386	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.320852
[125]	valid_0's auc: 0.939745	valid_0's binary_logloss: 0.26819	valid_1's auc: 0.905842	valid_1's binary_logloss: 0.321067
[126]	valid_0's auc: 0.939944	valid_0's binary_logloss: 0.267804	valid_1's auc: 0.90586	valid_1's binary_logloss: 0.321083
[127]	valid_0's auc: 0.940044	valid_0's binary_logloss: 0.26759	valid_1's auc: 0.9059	valid_1's binary_logloss: 0.321048
[128]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267262	valid_1's auc: 0.905781	valid_1's binary_logloss: 0.321202
[129]	valid_0's auc: 0.940271	valid_0's binary_logloss: 0.267158	valid_1's auc: 0.905754	valid_1's binary_logloss: 0.321245
[130]	valid_0's auc: 0.940428	valid_0's binary_logloss: 0.266876	valid_1's auc: 0.905718	valid_1's binary_logloss: 0.321287
[131]	valid_0's auc: 0.940662	valid_0's binary_logloss: 0.266465	valid_1's auc: 0.905657	valid_1's binary_logloss: 0.321419
[132]	valid_0's auc: 0.940808	valid_0's binary_logloss: 0.266163	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.32162
[133]	valid_0's auc: 0.941028	valid_0's binary_logloss: 0.265782	valid_1's auc: 0.905503	valid_1's binary_logloss: 0.321786
[134]	valid_0's auc: 0.941266	valid_0's binary_logloss: 0.265359	valid_1's auc: 0.905457	valid_1's binary_logloss: 0.321929
[135]	valid_0's auc: 0.941462	valid_0's binary_logloss: 0.265008	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.322102
[136]	valid_0's auc: 0.941578	valid_0's binary_logloss: 0.264764	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322247
[137]	valid_0's auc: 0.941727	valid_0's binary_logloss: 0.264491	valid_1's auc: 0.905249	valid_1's binary_logloss: 0.322412
[138]	valid_0's auc: 0.941836	valid_0's binary_logloss: 0.264238	valid_1's auc: 0.905239	valid_1's binary_logloss: 0.322502
[139]	valid_0's auc: 0.942039	valid_0's binary_logloss: 0.263852	valid_1's auc: 0.905174	valid_1's binary_logloss: 0.322597
[140]	valid_0's auc: 0.942214	valid_0's binary_logloss: 0.263512	valid_1's auc: 0.905103	valid_1's binary_logloss: 0.322743
[141]	valid_0's auc: 0.942431	valid_0's binary_logloss: 0.263143	valid_1's auc: 0.904978	valid_1's binary_logloss: 0.322994
[142]	valid_0's auc: 0.942552	valid_0's binary_logloss: 0.262922	valid_1's auc: 0.904954	valid_1's binary_logloss: 0.323034
[143]	valid_0's auc: 0.942712	valid_0's binary_logloss: 0.262576	valid_1's auc: 0.904982	valid_1's binary_logloss: 0.323027
[144]	valid_0's auc: 0.94288	valid_0's binary_logloss: 0.262269	valid_1's auc: 0.904939	valid_1's binary_logloss: 0.323169
[145]	valid_0's auc: 0.943033	valid_0's binary_logloss: 0.26196	valid_1's auc: 0.905	valid_1's binary_logloss: 0.323105
[146]	valid_0's auc: 0.943224	valid_0's binary_logloss: 0.261627	valid_1's auc: 0.904949	valid_1's binary_logloss: 0.32318
[147]	valid_0's auc: 0.943429	valid_0's binary_logloss: 0.261296	valid_1's auc: 0.904973	valid_1's binary_logloss: 0.323148
[148]	valid_0's auc: 0.943558	valid_0's binary_logloss: 0.261013	valid_1's auc: 0.904971	valid_1's binary_logloss: 0.323197
[149]	valid_0's auc: 0.943756	valid_0's binary_logloss: 0.260688	valid_1's auc: 0.90494	valid_1's binary_logloss: 0.323276
[150]	valid_0's auc: 0.943989	valid_0's binary_logloss: 0.260262	valid_1's auc: 0.904844	valid_1's binary_logloss: 0.323457
Early stopping, best iteration is:
[50]	valid_0's auc: 0.922367	valid_0's binary_logloss: 0.299513	valid_1's auc: 0.909641	valid_1's binary_logloss: 0.314373
[1]	valid_0's auc: 0.88862	valid_0's binary_logloss: 0.517559	valid_1's auc: 0.895216	valid_1's binary_logloss: 0.508462
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891685	valid_0's binary_logloss: 0.488823	valid_1's auc: 0.897251	valid_1's binary_logloss: 0.479045
[3]	valid_0's auc: 0.89535	valid_0's binary_logloss: 0.465318	valid_1's auc: 0.900709	valid_1's binary_logloss: 0.454958
[4]	valid_0's auc: 0.897143	valid_0's binary_logloss: 0.445958	valid_1's auc: 0.901126	valid_1's binary_logloss: 0.435898
[5]	valid_0's auc: 0.897936	valid_0's binary_logloss: 0.429982	valid_1's auc: 0.900752	valid_1's binary_logloss: 0.420148
[6]	valid_0's auc: 0.898453	valid_0's binary_logloss: 0.416378	valid_1's auc: 0.900947	valid_1's binary_logloss: 0.406481
[7]	valid_0's auc: 0.899579	valid_0's binary_logloss: 0.404589	valid_1's auc: 0.903086	valid_1's binary_logloss: 0.394663
[8]	valid_0's auc: 0.900549	valid_0's binary_logloss: 0.394529	valid_1's auc: 0.904172	valid_1's binary_logloss: 0.384427
[9]	valid_0's auc: 0.901078	valid_0's binary_logloss: 0.385787	valid_1's auc: 0.904166	valid_1's binary_logloss: 0.376075
[10]	valid_0's auc: 0.901717	valid_0's binary_logloss: 0.378226	valid_1's auc: 0.903991	valid_1's binary_logloss: 0.368931
[11]	valid_0's auc: 0.902526	valid_0's binary_logloss: 0.371393	valid_1's auc: 0.904364	valid_1's binary_logloss: 0.362505
[12]	valid_0's auc: 0.903143	valid_0's binary_logloss: 0.36552	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.356834
[13]	valid_0's auc: 0.903994	valid_0's binary_logloss: 0.360206	valid_1's auc: 0.905684	valid_1's binary_logloss: 0.352023
[14]	valid_0's auc: 0.904587	valid_0's binary_logloss: 0.355569	valid_1's auc: 0.906016	valid_1's binary_logloss: 0.347746
[15]	valid_0's auc: 0.9054	valid_0's binary_logloss: 0.351301	valid_1's auc: 0.906315	valid_1's binary_logloss: 0.343932
[16]	valid_0's auc: 0.905978	valid_0's binary_logloss: 0.347447	valid_1's auc: 0.906464	valid_1's binary_logloss: 0.340751
[17]	valid_0's auc: 0.90637	valid_0's binary_logloss: 0.344146	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.337835
[18]	valid_0's auc: 0.907012	valid_0's binary_logloss: 0.34113	valid_1's auc: 0.907124	valid_1's binary_logloss: 0.335133
[19]	valid_0's auc: 0.907575	valid_0's binary_logloss: 0.338369	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.333063
[20]	valid_0's auc: 0.908083	valid_0's binary_logloss: 0.335808	valid_1's auc: 0.90734	valid_1's binary_logloss: 0.330934
[21]	valid_0's auc: 0.908935	valid_0's binary_logloss: 0.333309	valid_1's auc: 0.907671	valid_1's binary_logloss: 0.329015
[22]	valid_0's auc: 0.909579	valid_0's binary_logloss: 0.331027	valid_1's auc: 0.907832	valid_1's binary_logloss: 0.3273
[23]	valid_0's auc: 0.910166	valid_0's binary_logloss: 0.328944	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.325891
[24]	valid_0's auc: 0.910648	valid_0's binary_logloss: 0.326994	valid_1's auc: 0.908071	valid_1's binary_logloss: 0.324484
[25]	valid_0's auc: 0.911167	valid_0's binary_logloss: 0.325209	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.323336
[26]	valid_0's auc: 0.911793	valid_0's binary_logloss: 0.3234	valid_1's auc: 0.908344	valid_1's binary_logloss: 0.322211
[27]	valid_0's auc: 0.912343	valid_0's binary_logloss: 0.321816	valid_1's auc: 0.908461	valid_1's binary_logloss: 0.321367
[28]	valid_0's auc: 0.912823	valid_0's binary_logloss: 0.320473	valid_1's auc: 0.908591	valid_1's binary_logloss: 0.32059
[29]	valid_0's auc: 0.913392	valid_0's binary_logloss: 0.31905	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.320199
[30]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.317803	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.319699
[31]	valid_0's auc: 0.914299	valid_0's binary_logloss: 0.316516	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.319061
[32]	valid_0's auc: 0.91474	valid_0's binary_logloss: 0.31538	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.31856
[33]	valid_0's auc: 0.915288	valid_0's binary_logloss: 0.314177	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.318255
[34]	valid_0's auc: 0.915715	valid_0's binary_logloss: 0.313181	valid_1's auc: 0.908632	valid_1's binary_logloss: 0.317799
[35]	valid_0's auc: 0.9161	valid_0's binary_logloss: 0.312164	valid_1's auc: 0.908764	valid_1's binary_logloss: 0.317349
[36]	valid_0's auc: 0.916425	valid_0's binary_logloss: 0.311339	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.31695
[37]	valid_0's auc: 0.916845	valid_0's binary_logloss: 0.310432	valid_1's auc: 0.908969	valid_1's binary_logloss: 0.316533
[38]	valid_0's auc: 0.917237	valid_0's binary_logloss: 0.309561	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.316221
[39]	valid_0's auc: 0.917669	valid_0's binary_logloss: 0.308602	valid_1's auc: 0.909163	valid_1's binary_logloss: 0.315781
[40]	valid_0's auc: 0.918179	valid_0's binary_logloss: 0.307636	valid_1's auc: 0.909047	valid_1's binary_logloss: 0.315717
[41]	valid_0's auc: 0.918577	valid_0's binary_logloss: 0.30689	valid_1's auc: 0.909046	valid_1's binary_logloss: 0.315612
[42]	valid_0's auc: 0.918755	valid_0's binary_logloss: 0.306455	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.315502
[43]	valid_0's auc: 0.919205	valid_0's binary_logloss: 0.305561	valid_1's auc: 0.90899	valid_1's binary_logloss: 0.315422
[44]	valid_0's auc: 0.919622	valid_0's binary_logloss: 0.304748	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.315353
[45]	valid_0's auc: 0.920027	valid_0's binary_logloss: 0.303928	valid_1's auc: 0.909017	valid_1's binary_logloss: 0.315198
[46]	valid_0's auc: 0.920432	valid_0's binary_logloss: 0.303174	valid_1's auc: 0.908933	valid_1's binary_logloss: 0.315189
[47]	valid_0's auc: 0.920849	valid_0's binary_logloss: 0.302442	valid_1's auc: 0.908971	valid_1's binary_logloss: 0.315111
[48]	valid_0's auc: 0.921409	valid_0's binary_logloss: 0.301489	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.314986
[49]	valid_0's auc: 0.921715	valid_0's binary_logloss: 0.300878	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.314863
[50]	valid_0's auc: 0.922034	valid_0's binary_logloss: 0.300275	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.314831
[51]	valid_0's auc: 0.9224	valid_0's binary_logloss: 0.299547	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.314717
[52]	valid_0's auc: 0.922692	valid_0's binary_logloss: 0.298997	valid_1's auc: 0.908923	valid_1's binary_logloss: 0.314803
[53]	valid_0's auc: 0.923019	valid_0's binary_logloss: 0.298347	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.314544
[54]	valid_0's auc: 0.92336	valid_0's binary_logloss: 0.297748	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.314504
[55]	valid_0's auc: 0.923639	valid_0's binary_logloss: 0.29719	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.314323
[56]	valid_0's auc: 0.923999	valid_0's binary_logloss: 0.296552	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.314269
[57]	valid_0's auc: 0.924344	valid_0's binary_logloss: 0.295942	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.314281
[58]	valid_0's auc: 0.924564	valid_0's binary_logloss: 0.295517	valid_1's auc: 0.909147	valid_1's binary_logloss: 0.314254
[59]	valid_0's auc: 0.924814	valid_0's binary_logloss: 0.295033	valid_1's auc: 0.90902	valid_1's binary_logloss: 0.314378
[60]	valid_0's auc: 0.925184	valid_0's binary_logloss: 0.294379	valid_1's auc: 0.909002	valid_1's binary_logloss: 0.314372
[61]	valid_0's auc: 0.925428	valid_0's binary_logloss: 0.293944	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.314346
[62]	valid_0's auc: 0.925667	valid_0's binary_logloss: 0.293427	valid_1's auc: 0.908909	valid_1's binary_logloss: 0.314423
[63]	valid_0's auc: 0.925996	valid_0's binary_logloss: 0.292878	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.31447
[64]	valid_0's auc: 0.926222	valid_0's binary_logloss: 0.292382	valid_1's auc: 0.908875	valid_1's binary_logloss: 0.314407
[65]	valid_0's auc: 0.926482	valid_0's binary_logloss: 0.291895	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.314397
[66]	valid_0's auc: 0.926725	valid_0's binary_logloss: 0.291464	valid_1's auc: 0.908826	valid_1's binary_logloss: 0.314453
[67]	valid_0's auc: 0.92696	valid_0's binary_logloss: 0.291004	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.314418
[68]	valid_0's auc: 0.927209	valid_0's binary_logloss: 0.290539	valid_1's auc: 0.908793	valid_1's binary_logloss: 0.314518
[69]	valid_0's auc: 0.92753	valid_0's binary_logloss: 0.290003	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.314824
[70]	valid_0's auc: 0.927758	valid_0's binary_logloss: 0.289565	valid_1's auc: 0.908556	valid_1's binary_logloss: 0.31484
[71]	valid_0's auc: 0.928008	valid_0's binary_logloss: 0.289084	valid_1's auc: 0.908522	valid_1's binary_logloss: 0.314872
[72]	valid_0's auc: 0.928203	valid_0's binary_logloss: 0.288755	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.314879
[73]	valid_0's auc: 0.928438	valid_0's binary_logloss: 0.288347	valid_1's auc: 0.90851	valid_1's binary_logloss: 0.314864
[74]	valid_0's auc: 0.928774	valid_0's binary_logloss: 0.287737	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.314957
[75]	valid_0's auc: 0.928862	valid_0's binary_logloss: 0.287563	valid_1's auc: 0.908459	valid_1's binary_logloss: 0.314956
[76]	valid_0's auc: 0.929142	valid_0's binary_logloss: 0.287076	valid_1's auc: 0.908395	valid_1's binary_logloss: 0.315029
[77]	valid_0's auc: 0.929407	valid_0's binary_logloss: 0.286613	valid_1's auc: 0.90835	valid_1's binary_logloss: 0.315127
[78]	valid_0's auc: 0.929552	valid_0's binary_logloss: 0.286381	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.315166
[79]	valid_0's auc: 0.929798	valid_0's binary_logloss: 0.28593	valid_1's auc: 0.908256	valid_1's binary_logloss: 0.315335
[80]	valid_0's auc: 0.929995	valid_0's binary_logloss: 0.285577	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.315515
[81]	valid_0's auc: 0.930165	valid_0's binary_logloss: 0.285294	valid_1's auc: 0.908103	valid_1's binary_logloss: 0.3156
[82]	valid_0's auc: 0.9304	valid_0's binary_logloss: 0.284896	valid_1's auc: 0.90815	valid_1's binary_logloss: 0.315556
[83]	valid_0's auc: 0.930624	valid_0's binary_logloss: 0.284465	valid_1's auc: 0.908238	valid_1's binary_logloss: 0.315451
[84]	valid_0's auc: 0.930826	valid_0's binary_logloss: 0.284076	valid_1's auc: 0.908101	valid_1's binary_logloss: 0.315717
[85]	valid_0's auc: 0.93117	valid_0's binary_logloss: 0.283493	valid_1's auc: 0.908034	valid_1's binary_logloss: 0.315812
[86]	valid_0's auc: 0.931416	valid_0's binary_logloss: 0.283041	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.315913
[87]	valid_0's auc: 0.931605	valid_0's binary_logloss: 0.282724	valid_1's auc: 0.907896	valid_1's binary_logloss: 0.316044
[88]	valid_0's auc: 0.931715	valid_0's binary_logloss: 0.282556	valid_1's auc: 0.907856	valid_1's binary_logloss: 0.316113
[89]	valid_0's auc: 0.931992	valid_0's binary_logloss: 0.282102	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.31618
[90]	valid_0's auc: 0.93223	valid_0's binary_logloss: 0.281669	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.31632
[91]	valid_0's auc: 0.932531	valid_0's binary_logloss: 0.281184	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.316653
[92]	valid_0's auc: 0.932673	valid_0's binary_logloss: 0.280819	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.316863
[93]	valid_0's auc: 0.932916	valid_0's binary_logloss: 0.280403	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.317108
[94]	valid_0's auc: 0.933116	valid_0's binary_logloss: 0.28003	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.317135
[95]	valid_0's auc: 0.933326	valid_0's binary_logloss: 0.279648	valid_1's auc: 0.907274	valid_1's binary_logloss: 0.317099
[96]	valid_0's auc: 0.933386	valid_0's binary_logloss: 0.279528	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.317148
[97]	valid_0's auc: 0.933536	valid_0's binary_logloss: 0.279258	valid_1's auc: 0.907211	valid_1's binary_logloss: 0.317271
[98]	valid_0's auc: 0.933803	valid_0's binary_logloss: 0.278734	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.317344
[99]	valid_0's auc: 0.934009	valid_0's binary_logloss: 0.278361	valid_1's auc: 0.907171	valid_1's binary_logloss: 0.317475
[100]	valid_0's auc: 0.934166	valid_0's binary_logloss: 0.278061	valid_1's auc: 0.907056	valid_1's binary_logloss: 0.31771
[101]	valid_0's auc: 0.934364	valid_0's binary_logloss: 0.277693	valid_1's auc: 0.906999	valid_1's binary_logloss: 0.317807
[102]	valid_0's auc: 0.934539	valid_0's binary_logloss: 0.27737	valid_1's auc: 0.907043	valid_1's binary_logloss: 0.317724
[103]	valid_0's auc: 0.934885	valid_0's binary_logloss: 0.276834	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.317614
[104]	valid_0's auc: 0.935079	valid_0's binary_logloss: 0.276475	valid_1's auc: 0.907063	valid_1's binary_logloss: 0.317724
[105]	valid_0's auc: 0.935347	valid_0's binary_logloss: 0.276009	valid_1's auc: 0.907193	valid_1's binary_logloss: 0.317555
[106]	valid_0's auc: 0.935599	valid_0's binary_logloss: 0.275522	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.317615
[107]	valid_0's auc: 0.935806	valid_0's binary_logloss: 0.275167	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.317811
[108]	valid_0's auc: 0.935959	valid_0's binary_logloss: 0.274905	valid_1's auc: 0.907016	valid_1's binary_logloss: 0.317888
[109]	valid_0's auc: 0.936196	valid_0's binary_logloss: 0.274505	valid_1's auc: 0.906963	valid_1's binary_logloss: 0.317999
[110]	valid_0's auc: 0.936392	valid_0's binary_logloss: 0.27414	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318048
[111]	valid_0's auc: 0.93661	valid_0's binary_logloss: 0.273757	valid_1's auc: 0.90687	valid_1's binary_logloss: 0.318233
[112]	valid_0's auc: 0.936781	valid_0's binary_logloss: 0.273429	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.318199
[113]	valid_0's auc: 0.936975	valid_0's binary_logloss: 0.273086	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.317949
[114]	valid_0's auc: 0.93716	valid_0's binary_logloss: 0.272753	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.318002
[115]	valid_0's auc: 0.937341	valid_0's binary_logloss: 0.27244	valid_1's auc: 0.90704	valid_1's binary_logloss: 0.318104
[116]	valid_0's auc: 0.937502	valid_0's binary_logloss: 0.272148	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318063
[117]	valid_0's auc: 0.9376	valid_0's binary_logloss: 0.271972	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.318223
[118]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.271783	valid_1's auc: 0.906942	valid_1's binary_logloss: 0.318312
[119]	valid_0's auc: 0.937767	valid_0's binary_logloss: 0.271675	valid_1's auc: 0.906918	valid_1's binary_logloss: 0.31835
[120]	valid_0's auc: 0.937901	valid_0's binary_logloss: 0.271427	valid_1's auc: 0.906913	valid_1's binary_logloss: 0.318384
[121]	valid_0's auc: 0.938139	valid_0's binary_logloss: 0.271001	valid_1's auc: 0.90696	valid_1's binary_logloss: 0.318385
[122]	valid_0's auc: 0.938291	valid_0's binary_logloss: 0.270745	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.318413
[123]	valid_0's auc: 0.938433	valid_0's binary_logloss: 0.270483	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.318496
[124]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.270222	valid_1's auc: 0.906875	valid_1's binary_logloss: 0.318566
[125]	valid_0's auc: 0.938683	valid_0's binary_logloss: 0.269992	valid_1's auc: 0.9069	valid_1's binary_logloss: 0.318551
[126]	valid_0's auc: 0.938887	valid_0's binary_logloss: 0.26965	valid_1's auc: 0.90685	valid_1's binary_logloss: 0.318645
[127]	valid_0's auc: 0.938994	valid_0's binary_logloss: 0.269391	valid_1's auc: 0.906859	valid_1's binary_logloss: 0.318667
[128]	valid_0's auc: 0.939173	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.318908
[129]	valid_0's auc: 0.939432	valid_0's binary_logloss: 0.268601	valid_1's auc: 0.906849	valid_1's binary_logloss: 0.318696
[130]	valid_0's auc: 0.939638	valid_0's binary_logloss: 0.268221	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.318817
[131]	valid_0's auc: 0.939786	valid_0's binary_logloss: 0.267956	valid_1's auc: 0.90673	valid_1's binary_logloss: 0.318959
[132]	valid_0's auc: 0.940027	valid_0's binary_logloss: 0.267552	valid_1's auc: 0.906614	valid_1's binary_logloss: 0.319133
[133]	valid_0's auc: 0.940227	valid_0's binary_logloss: 0.267185	valid_1's auc: 0.906567	valid_1's binary_logloss: 0.319237
[134]	valid_0's auc: 0.940329	valid_0's binary_logloss: 0.266997	valid_1's auc: 0.906575	valid_1's binary_logloss: 0.319333
[135]	valid_0's auc: 0.940532	valid_0's binary_logloss: 0.266634	valid_1's auc: 0.906603	valid_1's binary_logloss: 0.319358
[136]	valid_0's auc: 0.940696	valid_0's binary_logloss: 0.26632	valid_1's auc: 0.906522	valid_1's binary_logloss: 0.319537
[137]	valid_0's auc: 0.940889	valid_0's binary_logloss: 0.265947	valid_1's auc: 0.906387	valid_1's binary_logloss: 0.319788
[138]	valid_0's auc: 0.940963	valid_0's binary_logloss: 0.265791	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.319791
[139]	valid_0's auc: 0.941217	valid_0's binary_logloss: 0.265342	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.319993
[140]	valid_0's auc: 0.941362	valid_0's binary_logloss: 0.265059	valid_1's auc: 0.90624	valid_1's binary_logloss: 0.320087
[141]	valid_0's auc: 0.941468	valid_0's binary_logloss: 0.26486	valid_1's auc: 0.906128	valid_1's binary_logloss: 0.320288
[142]	valid_0's auc: 0.941614	valid_0's binary_logloss: 0.264566	valid_1's auc: 0.906025	valid_1's binary_logloss: 0.320515
[143]	valid_0's auc: 0.941739	valid_0's binary_logloss: 0.264323	valid_1's auc: 0.905944	valid_1's binary_logloss: 0.320684
[144]	valid_0's auc: 0.941944	valid_0's binary_logloss: 0.263955	valid_1's auc: 0.905822	valid_1's binary_logloss: 0.320915
[145]	valid_0's auc: 0.942136	valid_0's binary_logloss: 0.263569	valid_1's auc: 0.905748	valid_1's binary_logloss: 0.321061
[146]	valid_0's auc: 0.942312	valid_0's binary_logloss: 0.263196	valid_1's auc: 0.905691	valid_1's binary_logloss: 0.321189
[147]	valid_0's auc: 0.942489	valid_0's binary_logloss: 0.262897	valid_1's auc: 0.905657	valid_1's binary_logloss: 0.321295
[148]	valid_0's auc: 0.94266	valid_0's binary_logloss: 0.262569	valid_1's auc: 0.905523	valid_1's binary_logloss: 0.321516
[149]	valid_0's auc: 0.942884	valid_0's binary_logloss: 0.262177	valid_1's auc: 0.905403	valid_1's binary_logloss: 0.321759
[150]	valid_0's auc: 0.94307	valid_0's binary_logloss: 0.261803	valid_1's auc: 0.905336	valid_1's binary_logloss: 0.321881
[151]	valid_0's auc: 0.943142	valid_0's binary_logloss: 0.261649	valid_1's auc: 0.905196	valid_1's binary_logloss: 0.322075
[152]	valid_0's auc: 0.943333	valid_0's binary_logloss: 0.26132	valid_1's auc: 0.905221	valid_1's binary_logloss: 0.322054
[153]	valid_0's auc: 0.943484	valid_0's binary_logloss: 0.261045	valid_1's auc: 0.905133	valid_1's binary_logloss: 0.322201
[154]	valid_0's auc: 0.943625	valid_0's binary_logloss: 0.260773	valid_1's auc: 0.905127	valid_1's binary_logloss: 0.322292
[155]	valid_0's auc: 0.943803	valid_0's binary_logloss: 0.260451	valid_1's auc: 0.905017	valid_1's binary_logloss: 0.322437
[156]	valid_0's auc: 0.943973	valid_0's binary_logloss: 0.260147	valid_1's auc: 0.904931	valid_1's binary_logloss: 0.322598
Early stopping, best iteration is:
[56]	valid_0's auc: 0.923999	valid_0's binary_logloss: 0.296552	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.314269
[1]	valid_0's auc: 0.887968	valid_0's binary_logloss: 0.516768	valid_1's auc: 0.895544	valid_1's binary_logloss: 0.50753
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891765	valid_0's binary_logloss: 0.487735	valid_1's auc: 0.899568	valid_1's binary_logloss: 0.477309
[3]	valid_0's auc: 0.892862	valid_0's binary_logloss: 0.46446	valid_1's auc: 0.901473	valid_1's binary_logloss: 0.453476
[4]	valid_0's auc: 0.894319	valid_0's binary_logloss: 0.445017	valid_1's auc: 0.900978	valid_1's binary_logloss: 0.434504
[5]	valid_0's auc: 0.894429	valid_0's binary_logloss: 0.429143	valid_1's auc: 0.901054	valid_1's binary_logloss: 0.418425
[6]	valid_0's auc: 0.895715	valid_0's binary_logloss: 0.415531	valid_1's auc: 0.902036	valid_1's binary_logloss: 0.404972
[7]	valid_0's auc: 0.899511	valid_0's binary_logloss: 0.403934	valid_1's auc: 0.90367	valid_1's binary_logloss: 0.393802
[8]	valid_0's auc: 0.900147	valid_0's binary_logloss: 0.39396	valid_1's auc: 0.903745	valid_1's binary_logloss: 0.384144
[9]	valid_0's auc: 0.901231	valid_0's binary_logloss: 0.385144	valid_1's auc: 0.904038	valid_1's binary_logloss: 0.375981
[10]	valid_0's auc: 0.901867	valid_0's binary_logloss: 0.377458	valid_1's auc: 0.904795	valid_1's binary_logloss: 0.368387
[11]	valid_0's auc: 0.902896	valid_0's binary_logloss: 0.370583	valid_1's auc: 0.905303	valid_1's binary_logloss: 0.361999
[12]	valid_0's auc: 0.903488	valid_0's binary_logloss: 0.36458	valid_1's auc: 0.905294	valid_1's binary_logloss: 0.356463
[13]	valid_0's auc: 0.904282	valid_0's binary_logloss: 0.359323	valid_1's auc: 0.90556	valid_1's binary_logloss: 0.351759
[14]	valid_0's auc: 0.905024	valid_0's binary_logloss: 0.354518	valid_1's auc: 0.905903	valid_1's binary_logloss: 0.347369
[15]	valid_0's auc: 0.905556	valid_0's binary_logloss: 0.350322	valid_1's auc: 0.905957	valid_1's binary_logloss: 0.343715
[16]	valid_0's auc: 0.906568	valid_0's binary_logloss: 0.346519	valid_1's auc: 0.906095	valid_1's binary_logloss: 0.340861
[17]	valid_0's auc: 0.907157	valid_0's binary_logloss: 0.343169	valid_1's auc: 0.906578	valid_1's binary_logloss: 0.337949
[18]	valid_0's auc: 0.907969	valid_0's binary_logloss: 0.339887	valid_1's auc: 0.906723	valid_1's binary_logloss: 0.335404
[19]	valid_0's auc: 0.908662	valid_0's binary_logloss: 0.336987	valid_1's auc: 0.907216	valid_1's binary_logloss: 0.33297
[20]	valid_0's auc: 0.909672	valid_0's binary_logloss: 0.334088	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.330837
[21]	valid_0's auc: 0.910329	valid_0's binary_logloss: 0.331571	valid_1's auc: 0.907727	valid_1's binary_logloss: 0.329005
[22]	valid_0's auc: 0.910853	valid_0's binary_logloss: 0.329318	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.326895
[23]	valid_0's auc: 0.911516	valid_0's binary_logloss: 0.327129	valid_1's auc: 0.908399	valid_1's binary_logloss: 0.325605
[24]	valid_0's auc: 0.912071	valid_0's binary_logloss: 0.325197	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.324533
[25]	valid_0's auc: 0.912565	valid_0's binary_logloss: 0.32346	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.323367
[26]	valid_0's auc: 0.913085	valid_0's binary_logloss: 0.321718	valid_1's auc: 0.908727	valid_1's binary_logloss: 0.32235
[27]	valid_0's auc: 0.913463	valid_0's binary_logloss: 0.320353	valid_1's auc: 0.908852	valid_1's binary_logloss: 0.321517
[28]	valid_0's auc: 0.914088	valid_0's binary_logloss: 0.318707	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.320658
[29]	valid_0's auc: 0.914559	valid_0's binary_logloss: 0.317334	valid_1's auc: 0.909145	valid_1's binary_logloss: 0.319981
[30]	valid_0's auc: 0.915013	valid_0's binary_logloss: 0.316039	valid_1's auc: 0.909088	valid_1's binary_logloss: 0.319471
[31]	valid_0's auc: 0.91547	valid_0's binary_logloss: 0.314866	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.318967
[32]	valid_0's auc: 0.915905	valid_0's binary_logloss: 0.313722	valid_1's auc: 0.909153	valid_1's binary_logloss: 0.318498
[33]	valid_0's auc: 0.916402	valid_0's binary_logloss: 0.312547	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.317857
[34]	valid_0's auc: 0.916782	valid_0's binary_logloss: 0.31151	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.317474
[35]	valid_0's auc: 0.917186	valid_0's binary_logloss: 0.310488	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.317096
[36]	valid_0's auc: 0.917615	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.316717
[37]	valid_0's auc: 0.917959	valid_0's binary_logloss: 0.308601	valid_1's auc: 0.909527	valid_1's binary_logloss: 0.31637
[38]	valid_0's auc: 0.91833	valid_0's binary_logloss: 0.307708	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.316097
[39]	valid_0's auc: 0.918721	valid_0's binary_logloss: 0.306879	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315931
[40]	valid_0's auc: 0.919214	valid_0's binary_logloss: 0.305938	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.315667
[41]	valid_0's auc: 0.919596	valid_0's binary_logloss: 0.305087	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.315512
[42]	valid_0's auc: 0.919962	valid_0's binary_logloss: 0.304323	valid_1's auc: 0.909634	valid_1's binary_logloss: 0.315282
[43]	valid_0's auc: 0.920261	valid_0's binary_logloss: 0.303672	valid_1's auc: 0.909642	valid_1's binary_logloss: 0.315116
[44]	valid_0's auc: 0.920662	valid_0's binary_logloss: 0.302854	valid_1's auc: 0.909586	valid_1's binary_logloss: 0.315123
[45]	valid_0's auc: 0.921081	valid_0's binary_logloss: 0.301985	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314883
[46]	valid_0's auc: 0.92143	valid_0's binary_logloss: 0.301287	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.314969
[47]	valid_0's auc: 0.92185	valid_0's binary_logloss: 0.300487	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314862
[48]	valid_0's auc: 0.922167	valid_0's binary_logloss: 0.299817	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.314899
[49]	valid_0's auc: 0.922499	valid_0's binary_logloss: 0.299188	valid_1's auc: 0.909412	valid_1's binary_logloss: 0.314948
[50]	valid_0's auc: 0.922769	valid_0's binary_logloss: 0.298591	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.31487
[51]	valid_0's auc: 0.923028	valid_0's binary_logloss: 0.298016	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.314789
[52]	valid_0's auc: 0.92325	valid_0's binary_logloss: 0.297525	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.314792
[53]	valid_0's auc: 0.923583	valid_0's binary_logloss: 0.296929	valid_1's auc: 0.909322	valid_1's binary_logloss: 0.314853
[54]	valid_0's auc: 0.923883	valid_0's binary_logloss: 0.29637	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314759
[55]	valid_0's auc: 0.924151	valid_0's binary_logloss: 0.295834	valid_1's auc: 0.909512	valid_1's binary_logloss: 0.314504
[56]	valid_0's auc: 0.924447	valid_0's binary_logloss: 0.295236	valid_1's auc: 0.909387	valid_1's binary_logloss: 0.314599
[57]	valid_0's auc: 0.92469	valid_0's binary_logloss: 0.294835	valid_1's auc: 0.909312	valid_1's binary_logloss: 0.314692
[58]	valid_0's auc: 0.924978	valid_0's binary_logloss: 0.294298	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314614
[59]	valid_0's auc: 0.92525	valid_0's binary_logloss: 0.293785	valid_1's auc: 0.909413	valid_1's binary_logloss: 0.314573
[60]	valid_0's auc: 0.925491	valid_0's binary_logloss: 0.293351	valid_1's auc: 0.909277	valid_1's binary_logloss: 0.314769
[61]	valid_0's auc: 0.925811	valid_0's binary_logloss: 0.292779	valid_1's auc: 0.909305	valid_1's binary_logloss: 0.31473
[62]	valid_0's auc: 0.926232	valid_0's binary_logloss: 0.292119	valid_1's auc: 0.909224	valid_1's binary_logloss: 0.314874
[63]	valid_0's auc: 0.926507	valid_0's binary_logloss: 0.291604	valid_1's auc: 0.909282	valid_1's binary_logloss: 0.314801
[64]	valid_0's auc: 0.926781	valid_0's binary_logloss: 0.29112	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.31489
[65]	valid_0's auc: 0.927027	valid_0's binary_logloss: 0.290641	valid_1's auc: 0.909225	valid_1's binary_logloss: 0.314843
[66]	valid_0's auc: 0.927268	valid_0's binary_logloss: 0.290255	valid_1's auc: 0.909174	valid_1's binary_logloss: 0.314955
[67]	valid_0's auc: 0.927615	valid_0's binary_logloss: 0.289645	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.314967
[68]	valid_0's auc: 0.927841	valid_0's binary_logloss: 0.289156	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.314937
[69]	valid_0's auc: 0.928156	valid_0's binary_logloss: 0.288614	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315212
[70]	valid_0's auc: 0.928588	valid_0's binary_logloss: 0.287949	valid_1's auc: 0.90916	valid_1's binary_logloss: 0.314991
[71]	valid_0's auc: 0.928892	valid_0's binary_logloss: 0.287442	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.315088
[72]	valid_0's auc: 0.929023	valid_0's binary_logloss: 0.287193	valid_1's auc: 0.909078	valid_1's binary_logloss: 0.315107
[73]	valid_0's auc: 0.929329	valid_0's binary_logloss: 0.286701	valid_1's auc: 0.909084	valid_1's binary_logloss: 0.315099
[74]	valid_0's auc: 0.929556	valid_0's binary_logloss: 0.286232	valid_1's auc: 0.909048	valid_1's binary_logloss: 0.3152
[75]	valid_0's auc: 0.929861	valid_0's binary_logloss: 0.285673	valid_1's auc: 0.908986	valid_1's binary_logloss: 0.31532
[76]	valid_0's auc: 0.930189	valid_0's binary_logloss: 0.285142	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.315571
[77]	valid_0's auc: 0.930399	valid_0's binary_logloss: 0.284728	valid_1's auc: 0.908845	valid_1's binary_logloss: 0.315576
[78]	valid_0's auc: 0.930645	valid_0's binary_logloss: 0.284312	valid_1's auc: 0.908951	valid_1's binary_logloss: 0.315348
[79]	valid_0's auc: 0.930901	valid_0's binary_logloss: 0.283869	valid_1's auc: 0.908812	valid_1's binary_logloss: 0.315599
[80]	valid_0's auc: 0.931126	valid_0's binary_logloss: 0.283444	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.315577
[81]	valid_0's auc: 0.931394	valid_0's binary_logloss: 0.283008	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.315525
[82]	valid_0's auc: 0.931579	valid_0's binary_logloss: 0.282706	valid_1's auc: 0.908879	valid_1's binary_logloss: 0.315528
[83]	valid_0's auc: 0.931844	valid_0's binary_logloss: 0.282301	valid_1's auc: 0.908808	valid_1's binary_logloss: 0.315657
[84]	valid_0's auc: 0.932088	valid_0's binary_logloss: 0.281844	valid_1's auc: 0.908769	valid_1's binary_logloss: 0.315693
[85]	valid_0's auc: 0.932298	valid_0's binary_logloss: 0.281441	valid_1's auc: 0.908795	valid_1's binary_logloss: 0.315703
[86]	valid_0's auc: 0.93247	valid_0's binary_logloss: 0.281108	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.315849
[87]	valid_0's auc: 0.932719	valid_0's binary_logloss: 0.28065	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.315878
[88]	valid_0's auc: 0.932935	valid_0's binary_logloss: 0.280274	valid_1's auc: 0.908701	valid_1's binary_logloss: 0.315917
[89]	valid_0's auc: 0.933082	valid_0's binary_logloss: 0.279995	valid_1's auc: 0.908618	valid_1's binary_logloss: 0.316062
[90]	valid_0's auc: 0.933344	valid_0's binary_logloss: 0.279565	valid_1's auc: 0.908424	valid_1's binary_logloss: 0.316377
[91]	valid_0's auc: 0.933567	valid_0's binary_logloss: 0.279171	valid_1's auc: 0.908394	valid_1's binary_logloss: 0.316424
[92]	valid_0's auc: 0.933817	valid_0's binary_logloss: 0.27875	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316582
[93]	valid_0's auc: 0.934051	valid_0's binary_logloss: 0.278319	valid_1's auc: 0.908201	valid_1's binary_logloss: 0.316733
[94]	valid_0's auc: 0.934234	valid_0's binary_logloss: 0.278004	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.316673
[95]	valid_0's auc: 0.9344	valid_0's binary_logloss: 0.277691	valid_1's auc: 0.908146	valid_1's binary_logloss: 0.31691
[96]	valid_0's auc: 0.934601	valid_0's binary_logloss: 0.277328	valid_1's auc: 0.908034	valid_1's binary_logloss: 0.317106
[97]	valid_0's auc: 0.934782	valid_0's binary_logloss: 0.276996	valid_1's auc: 0.907954	valid_1's binary_logloss: 0.317305
[98]	valid_0's auc: 0.934929	valid_0's binary_logloss: 0.276705	valid_1's auc: 0.907881	valid_1's binary_logloss: 0.31743
[99]	valid_0's auc: 0.935076	valid_0's binary_logloss: 0.276401	valid_1's auc: 0.907856	valid_1's binary_logloss: 0.31754
[100]	valid_0's auc: 0.935297	valid_0's binary_logloss: 0.276022	valid_1's auc: 0.907719	valid_1's binary_logloss: 0.317787
[101]	valid_0's auc: 0.935483	valid_0's binary_logloss: 0.275687	valid_1's auc: 0.90776	valid_1's binary_logloss: 0.317757
[102]	valid_0's auc: 0.935739	valid_0's binary_logloss: 0.27526	valid_1's auc: 0.907729	valid_1's binary_logloss: 0.317832
[103]	valid_0's auc: 0.935939	valid_0's binary_logloss: 0.274892	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318103
[104]	valid_0's auc: 0.936021	valid_0's binary_logloss: 0.274727	valid_1's auc: 0.907529	valid_1's binary_logloss: 0.31818
[105]	valid_0's auc: 0.93623	valid_0's binary_logloss: 0.274383	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.318173
[106]	valid_0's auc: 0.936313	valid_0's binary_logloss: 0.274222	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318255
[107]	valid_0's auc: 0.936538	valid_0's binary_logloss: 0.273849	valid_1's auc: 0.907395	valid_1's binary_logloss: 0.318435
[108]	valid_0's auc: 0.936728	valid_0's binary_logloss: 0.273515	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.31856
[109]	valid_0's auc: 0.936842	valid_0's binary_logloss: 0.273321	valid_1's auc: 0.907341	valid_1's binary_logloss: 0.318588
[110]	valid_0's auc: 0.937006	valid_0's binary_logloss: 0.27302	valid_1's auc: 0.907319	valid_1's binary_logloss: 0.318684
[111]	valid_0's auc: 0.93726	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.907362	valid_1's binary_logloss: 0.318587
[112]	valid_0's auc: 0.937335	valid_0's binary_logloss: 0.272447	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318566
[113]	valid_0's auc: 0.937435	valid_0's binary_logloss: 0.272272	valid_1's auc: 0.90733	valid_1's binary_logloss: 0.318674
[114]	valid_0's auc: 0.937647	valid_0's binary_logloss: 0.271865	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318784
[115]	valid_0's auc: 0.937904	valid_0's binary_logloss: 0.271417	valid_1's auc: 0.907286	valid_1's binary_logloss: 0.318768
[116]	valid_0's auc: 0.938114	valid_0's binary_logloss: 0.271029	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.318884
[117]	valid_0's auc: 0.93827	valid_0's binary_logloss: 0.27072	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.319005
[118]	valid_0's auc: 0.938429	valid_0's binary_logloss: 0.270421	valid_1's auc: 0.907194	valid_1's binary_logloss: 0.31903
[119]	valid_0's auc: 0.938578	valid_0's binary_logloss: 0.27014	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.319181
[120]	valid_0's auc: 0.938728	valid_0's binary_logloss: 0.269851	valid_1's auc: 0.907129	valid_1's binary_logloss: 0.319193
[121]	valid_0's auc: 0.938883	valid_0's binary_logloss: 0.269553	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.319384
[122]	valid_0's auc: 0.939092	valid_0's binary_logloss: 0.269189	valid_1's auc: 0.906872	valid_1's binary_logloss: 0.31964
[123]	valid_0's auc: 0.939239	valid_0's binary_logloss: 0.26892	valid_1's auc: 0.906922	valid_1's binary_logloss: 0.319588
[124]	valid_0's auc: 0.939435	valid_0's binary_logloss: 0.268585	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.319846
[125]	valid_0's auc: 0.939643	valid_0's binary_logloss: 0.268179	valid_1's auc: 0.906724	valid_1's binary_logloss: 0.319991
[126]	valid_0's auc: 0.939878	valid_0's binary_logloss: 0.267727	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.32017
[127]	valid_0's auc: 0.940041	valid_0's binary_logloss: 0.267408	valid_1's auc: 0.906565	valid_1's binary_logloss: 0.320258
[128]	valid_0's auc: 0.940213	valid_0's binary_logloss: 0.267094	valid_1's auc: 0.906408	valid_1's binary_logloss: 0.320551
[129]	valid_0's auc: 0.940472	valid_0's binary_logloss: 0.266673	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.320736
[130]	valid_0's auc: 0.940599	valid_0's binary_logloss: 0.266403	valid_1's auc: 0.906308	valid_1's binary_logloss: 0.320749
[131]	valid_0's auc: 0.9408	valid_0's binary_logloss: 0.266038	valid_1's auc: 0.90625	valid_1's binary_logloss: 0.320875
[132]	valid_0's auc: 0.941025	valid_0's binary_logloss: 0.265635	valid_1's auc: 0.906104	valid_1's binary_logloss: 0.321131
[133]	valid_0's auc: 0.941163	valid_0's binary_logloss: 0.265371	valid_1's auc: 0.906053	valid_1's binary_logloss: 0.321214
[134]	valid_0's auc: 0.941274	valid_0's binary_logloss: 0.265178	valid_1's auc: 0.906033	valid_1's binary_logloss: 0.321227
[135]	valid_0's auc: 0.94145	valid_0's binary_logloss: 0.264854	valid_1's auc: 0.905954	valid_1's binary_logloss: 0.321423
[136]	valid_0's auc: 0.941626	valid_0's binary_logloss: 0.264555	valid_1's auc: 0.905913	valid_1's binary_logloss: 0.321526
[137]	valid_0's auc: 0.941764	valid_0's binary_logloss: 0.264298	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.321587
[138]	valid_0's auc: 0.941998	valid_0's binary_logloss: 0.263905	valid_1's auc: 0.905741	valid_1's binary_logloss: 0.321798
[139]	valid_0's auc: 0.942137	valid_0's binary_logloss: 0.263585	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.321806
[140]	valid_0's auc: 0.942314	valid_0's binary_logloss: 0.263261	valid_1's auc: 0.905664	valid_1's binary_logloss: 0.322003
[141]	valid_0's auc: 0.942483	valid_0's binary_logloss: 0.262973	valid_1's auc: 0.905598	valid_1's binary_logloss: 0.322157
[142]	valid_0's auc: 0.942616	valid_0's binary_logloss: 0.262687	valid_1's auc: 0.905692	valid_1's binary_logloss: 0.32203
[143]	valid_0's auc: 0.942767	valid_0's binary_logloss: 0.2624	valid_1's auc: 0.905667	valid_1's binary_logloss: 0.322112
[144]	valid_0's auc: 0.942937	valid_0's binary_logloss: 0.262058	valid_1's auc: 0.90561	valid_1's binary_logloss: 0.322264
[145]	valid_0's auc: 0.943116	valid_0's binary_logloss: 0.261722	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.322285
Early stopping, best iteration is:
[45]	valid_0's auc: 0.921081	valid_0's binary_logloss: 0.301985	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314883
[1]	valid_0's auc: 0.886951	valid_0's binary_logloss: 0.517075	valid_1's auc: 0.893067	valid_1's binary_logloss: 0.508488
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.88938	valid_0's binary_logloss: 0.488106	valid_1's auc: 0.896263	valid_1's binary_logloss: 0.478809
[3]	valid_0's auc: 0.891182	valid_0's binary_logloss: 0.464886	valid_1's auc: 0.896152	valid_1's binary_logloss: 0.455599
[4]	valid_0's auc: 0.895894	valid_0's binary_logloss: 0.44539	valid_1's auc: 0.900075	valid_1's binary_logloss: 0.43602
[5]	valid_0's auc: 0.896739	valid_0's binary_logloss: 0.42935	valid_1's auc: 0.901125	valid_1's binary_logloss: 0.419645
[6]	valid_0's auc: 0.897966	valid_0's binary_logloss: 0.415626	valid_1's auc: 0.901221	valid_1's binary_logloss: 0.406434
[7]	valid_0's auc: 0.899512	valid_0's binary_logloss: 0.403958	valid_1's auc: 0.90233	valid_1's binary_logloss: 0.394936
[8]	valid_0's auc: 0.900274	valid_0's binary_logloss: 0.393933	valid_1's auc: 0.902651	valid_1's binary_logloss: 0.385157
[9]	valid_0's auc: 0.900676	valid_0's binary_logloss: 0.385299	valid_1's auc: 0.902871	valid_1's binary_logloss: 0.376891
[10]	valid_0's auc: 0.901657	valid_0's binary_logloss: 0.377584	valid_1's auc: 0.903325	valid_1's binary_logloss: 0.369694
[11]	valid_0's auc: 0.902313	valid_0's binary_logloss: 0.370878	valid_1's auc: 0.903737	valid_1's binary_logloss: 0.363398
[12]	valid_0's auc: 0.903472	valid_0's binary_logloss: 0.364884	valid_1's auc: 0.90419	valid_1's binary_logloss: 0.35792
[13]	valid_0's auc: 0.904409	valid_0's binary_logloss: 0.359658	valid_1's auc: 0.904295	valid_1's binary_logloss: 0.353429
[14]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.35487	valid_1's auc: 0.904454	valid_1's binary_logloss: 0.349213
[15]	valid_0's auc: 0.906051	valid_0's binary_logloss: 0.350515	valid_1's auc: 0.904685	valid_1's binary_logloss: 0.345556
[16]	valid_0's auc: 0.906807	valid_0's binary_logloss: 0.346706	valid_1's auc: 0.905496	valid_1's binary_logloss: 0.342213
[17]	valid_0's auc: 0.907328	valid_0's binary_logloss: 0.343289	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.339192
[18]	valid_0's auc: 0.908084	valid_0's binary_logloss: 0.340079	valid_1's auc: 0.906207	valid_1's binary_logloss: 0.336494
[19]	valid_0's auc: 0.908583	valid_0's binary_logloss: 0.337307	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.334217
[20]	valid_0's auc: 0.909297	valid_0's binary_logloss: 0.334607	valid_1's auc: 0.906821	valid_1's binary_logloss: 0.332118
[21]	valid_0's auc: 0.909973	valid_0's binary_logloss: 0.332045	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.329869
[22]	valid_0's auc: 0.910689	valid_0's binary_logloss: 0.329736	valid_1's auc: 0.907445	valid_1's binary_logloss: 0.328419
[23]	valid_0's auc: 0.91125	valid_0's binary_logloss: 0.32772	valid_1's auc: 0.907486	valid_1's binary_logloss: 0.327031
[24]	valid_0's auc: 0.911734	valid_0's binary_logloss: 0.325914	valid_1's auc: 0.907401	valid_1's binary_logloss: 0.326007
[25]	valid_0's auc: 0.912237	valid_0's binary_logloss: 0.324151	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.32492
[26]	valid_0's auc: 0.912855	valid_0's binary_logloss: 0.322348	valid_1's auc: 0.907706	valid_1's binary_logloss: 0.323853
[27]	valid_0's auc: 0.913351	valid_0's binary_logloss: 0.320751	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.322916
[28]	valid_0's auc: 0.913918	valid_0's binary_logloss: 0.319267	valid_1's auc: 0.908082	valid_1's binary_logloss: 0.322092
[29]	valid_0's auc: 0.914317	valid_0's binary_logloss: 0.317929	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.321585
[30]	valid_0's auc: 0.914775	valid_0's binary_logloss: 0.316624	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.321139
[31]	valid_0's auc: 0.915234	valid_0's binary_logloss: 0.315369	valid_1's auc: 0.907906	valid_1's binary_logloss: 0.320746
[32]	valid_0's auc: 0.915573	valid_0's binary_logloss: 0.314259	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.320417
[33]	valid_0's auc: 0.916083	valid_0's binary_logloss: 0.31316	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.320248
[34]	valid_0's auc: 0.91653	valid_0's binary_logloss: 0.312094	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.319838
[35]	valid_0's auc: 0.916919	valid_0's binary_logloss: 0.311069	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.319583
[36]	valid_0's auc: 0.917504	valid_0's binary_logloss: 0.30988	valid_1's auc: 0.907767	valid_1's binary_logloss: 0.319455
[37]	valid_0's auc: 0.917825	valid_0's binary_logloss: 0.309029	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.319415
[38]	valid_0's auc: 0.91823	valid_0's binary_logloss: 0.308097	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.318928
[39]	valid_0's auc: 0.918545	valid_0's binary_logloss: 0.307294	valid_1's auc: 0.907692	valid_1's binary_logloss: 0.318778
[40]	valid_0's auc: 0.918951	valid_0's binary_logloss: 0.306507	valid_1's auc: 0.907562	valid_1's binary_logloss: 0.318828
[41]	valid_0's auc: 0.91937	valid_0's binary_logloss: 0.305627	valid_1's auc: 0.907605	valid_1's binary_logloss: 0.318644
[42]	valid_0's auc: 0.91976	valid_0's binary_logloss: 0.304849	valid_1's auc: 0.907597	valid_1's binary_logloss: 0.318495
[43]	valid_0's auc: 0.920154	valid_0's binary_logloss: 0.304024	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.318365
[44]	valid_0's auc: 0.920458	valid_0's binary_logloss: 0.303364	valid_1's auc: 0.90767	valid_1's binary_logloss: 0.318163
[45]	valid_0's auc: 0.920846	valid_0's binary_logloss: 0.30255	valid_1's auc: 0.907536	valid_1's binary_logloss: 0.318234
[46]	valid_0's auc: 0.921388	valid_0's binary_logloss: 0.301605	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318168
[47]	valid_0's auc: 0.921741	valid_0's binary_logloss: 0.300956	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.318087
[48]	valid_0's auc: 0.922021	valid_0's binary_logloss: 0.300339	valid_1's auc: 0.907561	valid_1's binary_logloss: 0.31805
[49]	valid_0's auc: 0.922277	valid_0's binary_logloss: 0.299855	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.318021
[50]	valid_0's auc: 0.922684	valid_0's binary_logloss: 0.299075	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.317961
[51]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.298476	valid_1's auc: 0.907465	valid_1's binary_logloss: 0.318069
[52]	valid_0's auc: 0.923311	valid_0's binary_logloss: 0.297877	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318093
[53]	valid_0's auc: 0.923717	valid_0's binary_logloss: 0.297146	valid_1's auc: 0.907276	valid_1's binary_logloss: 0.318175
[54]	valid_0's auc: 0.924003	valid_0's binary_logloss: 0.296561	valid_1's auc: 0.907393	valid_1's binary_logloss: 0.317938
[55]	valid_0's auc: 0.924273	valid_0's binary_logloss: 0.296048	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.317744
[56]	valid_0's auc: 0.924676	valid_0's binary_logloss: 0.295318	valid_1's auc: 0.907332	valid_1's binary_logloss: 0.317946
[57]	valid_0's auc: 0.925001	valid_0's binary_logloss: 0.294707	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.31797
[58]	valid_0's auc: 0.925375	valid_0's binary_logloss: 0.29402	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.317819
[59]	valid_0's auc: 0.9255	valid_0's binary_logloss: 0.293748	valid_1's auc: 0.907358	valid_1's binary_logloss: 0.317821
[60]	valid_0's auc: 0.925749	valid_0's binary_logloss: 0.293257	valid_1's auc: 0.907292	valid_1's binary_logloss: 0.317946
[61]	valid_0's auc: 0.926047	valid_0's binary_logloss: 0.292679	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318037
[62]	valid_0's auc: 0.926356	valid_0's binary_logloss: 0.292127	valid_1's auc: 0.907077	valid_1's binary_logloss: 0.318312
[63]	valid_0's auc: 0.92673	valid_0's binary_logloss: 0.291498	valid_1's auc: 0.907058	valid_1's binary_logloss: 0.318411
[64]	valid_0's auc: 0.927044	valid_0's binary_logloss: 0.290942	valid_1's auc: 0.907104	valid_1's binary_logloss: 0.318327
[65]	valid_0's auc: 0.927314	valid_0's binary_logloss: 0.29045	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.318339
[66]	valid_0's auc: 0.927579	valid_0's binary_logloss: 0.289948	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318207
[67]	valid_0's auc: 0.927724	valid_0's binary_logloss: 0.289678	valid_1's auc: 0.90717	valid_1's binary_logloss: 0.318213
[68]	valid_0's auc: 0.927985	valid_0's binary_logloss: 0.289184	valid_1's auc: 0.90715	valid_1's binary_logloss: 0.318251
[69]	valid_0's auc: 0.928262	valid_0's binary_logloss: 0.288694	valid_1's auc: 0.907036	valid_1's binary_logloss: 0.318459
[70]	valid_0's auc: 0.928557	valid_0's binary_logloss: 0.288165	valid_1's auc: 0.906969	valid_1's binary_logloss: 0.318587
[71]	valid_0's auc: 0.92888	valid_0's binary_logloss: 0.287556	valid_1's auc: 0.906954	valid_1's binary_logloss: 0.318587
[72]	valid_0's auc: 0.929098	valid_0's binary_logloss: 0.287164	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.318951
[73]	valid_0's auc: 0.929326	valid_0's binary_logloss: 0.28681	valid_1's auc: 0.906637	valid_1's binary_logloss: 0.319137
[74]	valid_0's auc: 0.929678	valid_0's binary_logloss: 0.286225	valid_1's auc: 0.9066	valid_1's binary_logloss: 0.319176
[75]	valid_0's auc: 0.929863	valid_0's binary_logloss: 0.285857	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.319288
[76]	valid_0's auc: 0.930125	valid_0's binary_logloss: 0.285387	valid_1's auc: 0.906526	valid_1's binary_logloss: 0.319259
[77]	valid_0's auc: 0.930301	valid_0's binary_logloss: 0.285025	valid_1's auc: 0.906532	valid_1's binary_logloss: 0.3193
[78]	valid_0's auc: 0.930523	valid_0's binary_logloss: 0.284607	valid_1's auc: 0.906509	valid_1's binary_logloss: 0.319352
[79]	valid_0's auc: 0.930735	valid_0's binary_logloss: 0.284177	valid_1's auc: 0.906489	valid_1's binary_logloss: 0.319369
[80]	valid_0's auc: 0.931025	valid_0's binary_logloss: 0.28366	valid_1's auc: 0.906547	valid_1's binary_logloss: 0.319296
[81]	valid_0's auc: 0.931243	valid_0's binary_logloss: 0.283253	valid_1's auc: 0.906463	valid_1's binary_logloss: 0.319448
[82]	valid_0's auc: 0.931538	valid_0's binary_logloss: 0.282767	valid_1's auc: 0.906358	valid_1's binary_logloss: 0.319596
[83]	valid_0's auc: 0.931777	valid_0's binary_logloss: 0.282346	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.319515
[84]	valid_0's auc: 0.932063	valid_0's binary_logloss: 0.281831	valid_1's auc: 0.906407	valid_1's binary_logloss: 0.31957
[85]	valid_0's auc: 0.932357	valid_0's binary_logloss: 0.281361	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.319759
[86]	valid_0's auc: 0.932545	valid_0's binary_logloss: 0.28101	valid_1's auc: 0.906405	valid_1's binary_logloss: 0.31961
[87]	valid_0's auc: 0.932641	valid_0's binary_logloss: 0.280824	valid_1's auc: 0.906367	valid_1's binary_logloss: 0.319719
[88]	valid_0's auc: 0.932884	valid_0's binary_logloss: 0.280387	valid_1's auc: 0.906275	valid_1's binary_logloss: 0.319916
[89]	valid_0's auc: 0.93302	valid_0's binary_logloss: 0.280147	valid_1's auc: 0.906105	valid_1's binary_logloss: 0.320216
[90]	valid_0's auc: 0.93325	valid_0's binary_logloss: 0.279732	valid_1's auc: 0.906073	valid_1's binary_logloss: 0.320288
[91]	valid_0's auc: 0.933481	valid_0's binary_logloss: 0.279311	valid_1's auc: 0.906095	valid_1's binary_logloss: 0.32029
[92]	valid_0's auc: 0.9337	valid_0's binary_logloss: 0.278931	valid_1's auc: 0.906092	valid_1's binary_logloss: 0.320357
[93]	valid_0's auc: 0.933885	valid_0's binary_logloss: 0.27861	valid_1's auc: 0.906003	valid_1's binary_logloss: 0.320577
[94]	valid_0's auc: 0.934064	valid_0's binary_logloss: 0.278253	valid_1's auc: 0.906067	valid_1's binary_logloss: 0.320527
[95]	valid_0's auc: 0.934218	valid_0's binary_logloss: 0.277965	valid_1's auc: 0.905971	valid_1's binary_logloss: 0.320689
[96]	valid_0's auc: 0.934431	valid_0's binary_logloss: 0.277541	valid_1's auc: 0.905837	valid_1's binary_logloss: 0.320955
[97]	valid_0's auc: 0.934697	valid_0's binary_logloss: 0.277085	valid_1's auc: 0.905817	valid_1's binary_logloss: 0.320998
[98]	valid_0's auc: 0.934809	valid_0's binary_logloss: 0.276898	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.321142
[99]	valid_0's auc: 0.934967	valid_0's binary_logloss: 0.276635	valid_1's auc: 0.905753	valid_1's binary_logloss: 0.321125
[100]	valid_0's auc: 0.935137	valid_0's binary_logloss: 0.276325	valid_1's auc: 0.905682	valid_1's binary_logloss: 0.321256
[101]	valid_0's auc: 0.935382	valid_0's binary_logloss: 0.275869	valid_1's auc: 0.905617	valid_1's binary_logloss: 0.321467
[102]	valid_0's auc: 0.93553	valid_0's binary_logloss: 0.275564	valid_1's auc: 0.905524	valid_1's binary_logloss: 0.321629
[103]	valid_0's auc: 0.93571	valid_0's binary_logloss: 0.275264	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.321751
[104]	valid_0's auc: 0.935965	valid_0's binary_logloss: 0.274845	valid_1's auc: 0.905473	valid_1's binary_logloss: 0.321725
[105]	valid_0's auc: 0.936135	valid_0's binary_logloss: 0.27451	valid_1's auc: 0.90527	valid_1's binary_logloss: 0.32205
[106]	valid_0's auc: 0.936342	valid_0's binary_logloss: 0.274145	valid_1's auc: 0.905326	valid_1's binary_logloss: 0.322028
[107]	valid_0's auc: 0.9364	valid_0's binary_logloss: 0.274043	valid_1's auc: 0.905226	valid_1's binary_logloss: 0.322186
[108]	valid_0's auc: 0.936593	valid_0's binary_logloss: 0.273682	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.322071
[109]	valid_0's auc: 0.936751	valid_0's binary_logloss: 0.273424	valid_1's auc: 0.905275	valid_1's binary_logloss: 0.322088
[110]	valid_0's auc: 0.936973	valid_0's binary_logloss: 0.273036	valid_1's auc: 0.905225	valid_1's binary_logloss: 0.322155
[111]	valid_0's auc: 0.937234	valid_0's binary_logloss: 0.272568	valid_1's auc: 0.905107	valid_1's binary_logloss: 0.322427
[112]	valid_0's auc: 0.937531	valid_0's binary_logloss: 0.272014	valid_1's auc: 0.905065	valid_1's binary_logloss: 0.322537
[113]	valid_0's auc: 0.937727	valid_0's binary_logloss: 0.271664	valid_1's auc: 0.904945	valid_1's binary_logloss: 0.322785
[114]	valid_0's auc: 0.937932	valid_0's binary_logloss: 0.271266	valid_1's auc: 0.904823	valid_1's binary_logloss: 0.322972
[115]	valid_0's auc: 0.938108	valid_0's binary_logloss: 0.270938	valid_1's auc: 0.904743	valid_1's binary_logloss: 0.323147
[116]	valid_0's auc: 0.938294	valid_0's binary_logloss: 0.270575	valid_1's auc: 0.904833	valid_1's binary_logloss: 0.323066
[117]	valid_0's auc: 0.938361	valid_0's binary_logloss: 0.270433	valid_1's auc: 0.904784	valid_1's binary_logloss: 0.323155
[118]	valid_0's auc: 0.938572	valid_0's binary_logloss: 0.270047	valid_1's auc: 0.904765	valid_1's binary_logloss: 0.323208
[119]	valid_0's auc: 0.938786	valid_0's binary_logloss: 0.269671	valid_1's auc: 0.904648	valid_1's binary_logloss: 0.323345
[120]	valid_0's auc: 0.938956	valid_0's binary_logloss: 0.269353	valid_1's auc: 0.904628	valid_1's binary_logloss: 0.323428
[121]	valid_0's auc: 0.939069	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.904585	valid_1's binary_logloss: 0.323517
[122]	valid_0's auc: 0.939228	valid_0's binary_logloss: 0.268855	valid_1's auc: 0.904603	valid_1's binary_logloss: 0.323459
[123]	valid_0's auc: 0.939371	valid_0's binary_logloss: 0.268571	valid_1's auc: 0.904602	valid_1's binary_logloss: 0.323494
[124]	valid_0's auc: 0.939597	valid_0's binary_logloss: 0.268186	valid_1's auc: 0.904542	valid_1's binary_logloss: 0.323636
[125]	valid_0's auc: 0.93966	valid_0's binary_logloss: 0.268064	valid_1's auc: 0.904485	valid_1's binary_logloss: 0.323754
[126]	valid_0's auc: 0.939885	valid_0's binary_logloss: 0.267653	valid_1's auc: 0.90437	valid_1's binary_logloss: 0.323973
[127]	valid_0's auc: 0.94009	valid_0's binary_logloss: 0.267311	valid_1's auc: 0.904285	valid_1's binary_logloss: 0.324156
[128]	valid_0's auc: 0.940268	valid_0's binary_logloss: 0.266948	valid_1's auc: 0.904328	valid_1's binary_logloss: 0.324122
Early stopping, best iteration is:
[28]	valid_0's auc: 0.913918	valid_0's binary_logloss: 0.319267	valid_1's auc: 0.908082	valid_1's binary_logloss: 0.322092
[1]	valid_0's auc: 0.887462	valid_0's binary_logloss: 0.51703	valid_1's auc: 0.894485	valid_1's binary_logloss: 0.508323
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891154	valid_0's binary_logloss: 0.488204	valid_1's auc: 0.897176	valid_1's binary_logloss: 0.478744
[3]	valid_0's auc: 0.891804	valid_0's binary_logloss: 0.465194	valid_1's auc: 0.89747	valid_1's binary_logloss: 0.455444
[4]	valid_0's auc: 0.894831	valid_0's binary_logloss: 0.446304	valid_1's auc: 0.89973	valid_1's binary_logloss: 0.436459
[5]	valid_0's auc: 0.896638	valid_0's binary_logloss: 0.430189	valid_1's auc: 0.901137	valid_1's binary_logloss: 0.420345
[6]	valid_0's auc: 0.897554	valid_0's binary_logloss: 0.416605	valid_1's auc: 0.901277	valid_1's binary_logloss: 0.406735
[7]	valid_0's auc: 0.898818	valid_0's binary_logloss: 0.404965	valid_1's auc: 0.902495	valid_1's binary_logloss: 0.395091
[8]	valid_0's auc: 0.899599	valid_0's binary_logloss: 0.394892	valid_1's auc: 0.902897	valid_1's binary_logloss: 0.384982
[9]	valid_0's auc: 0.900002	valid_0's binary_logloss: 0.386213	valid_1's auc: 0.903464	valid_1's binary_logloss: 0.376485
[10]	valid_0's auc: 0.90114	valid_0's binary_logloss: 0.378489	valid_1's auc: 0.904002	valid_1's binary_logloss: 0.369393
[11]	valid_0's auc: 0.902141	valid_0's binary_logloss: 0.371758	valid_1's auc: 0.90444	valid_1's binary_logloss: 0.362989
[12]	valid_0's auc: 0.903312	valid_0's binary_logloss: 0.365802	valid_1's auc: 0.905002	valid_1's binary_logloss: 0.357566
[13]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.360438	valid_1's auc: 0.9049	valid_1's binary_logloss: 0.352735
[14]	valid_0's auc: 0.904872	valid_0's binary_logloss: 0.355607	valid_1's auc: 0.905732	valid_1's binary_logloss: 0.348375
[15]	valid_0's auc: 0.905862	valid_0's binary_logloss: 0.351052	valid_1's auc: 0.905976	valid_1's binary_logloss: 0.344517
[16]	valid_0's auc: 0.906477	valid_0's binary_logloss: 0.347207	valid_1's auc: 0.906222	valid_1's binary_logloss: 0.341397
[17]	valid_0's auc: 0.907078	valid_0's binary_logloss: 0.343688	valid_1's auc: 0.906537	valid_1's binary_logloss: 0.338437
[18]	valid_0's auc: 0.90752	valid_0's binary_logloss: 0.340684	valid_1's auc: 0.906709	valid_1's binary_logloss: 0.335981
[19]	valid_0's auc: 0.908432	valid_0's binary_logloss: 0.337645	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.333599
[20]	valid_0's auc: 0.908981	valid_0's binary_logloss: 0.335146	valid_1's auc: 0.907099	valid_1's binary_logloss: 0.331801
[21]	valid_0's auc: 0.909679	valid_0's binary_logloss: 0.332538	valid_1's auc: 0.907277	valid_1's binary_logloss: 0.330028
[22]	valid_0's auc: 0.910393	valid_0's binary_logloss: 0.330279	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.328314
[23]	valid_0's auc: 0.910924	valid_0's binary_logloss: 0.328261	valid_1's auc: 0.90754	valid_1's binary_logloss: 0.326981
[24]	valid_0's auc: 0.911443	valid_0's binary_logloss: 0.326385	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.325796
[25]	valid_0's auc: 0.912077	valid_0's binary_logloss: 0.324538	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.32473
[26]	valid_0's auc: 0.912576	valid_0's binary_logloss: 0.322893	valid_1's auc: 0.907637	valid_1's binary_logloss: 0.323819
[27]	valid_0's auc: 0.913175	valid_0's binary_logloss: 0.321194	valid_1's auc: 0.907828	valid_1's binary_logloss: 0.322828
[28]	valid_0's auc: 0.913644	valid_0's binary_logloss: 0.31979	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.322042
[29]	valid_0's auc: 0.914118	valid_0's binary_logloss: 0.318401	valid_1's auc: 0.908115	valid_1's binary_logloss: 0.321181
[30]	valid_0's auc: 0.914589	valid_0's binary_logloss: 0.317022	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.32041
[31]	valid_0's auc: 0.91499	valid_0's binary_logloss: 0.315844	valid_1's auc: 0.908545	valid_1's binary_logloss: 0.319662
[32]	valid_0's auc: 0.915507	valid_0's binary_logloss: 0.314533	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.319046
[33]	valid_0's auc: 0.915824	valid_0's binary_logloss: 0.313594	valid_1's auc: 0.908668	valid_1's binary_logloss: 0.318595
[34]	valid_0's auc: 0.91636	valid_0's binary_logloss: 0.312316	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.318074
[35]	valid_0's auc: 0.916909	valid_0's binary_logloss: 0.311113	valid_1's auc: 0.908705	valid_1's binary_logloss: 0.317806
[36]	valid_0's auc: 0.91738	valid_0's binary_logloss: 0.310061	valid_1's auc: 0.90869	valid_1's binary_logloss: 0.317615
[37]	valid_0's auc: 0.917622	valid_0's binary_logloss: 0.309353	valid_1's auc: 0.908669	valid_1's binary_logloss: 0.317339
[38]	valid_0's auc: 0.918138	valid_0's binary_logloss: 0.308206	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.317113
[39]	valid_0's auc: 0.918442	valid_0's binary_logloss: 0.30749	valid_1's auc: 0.908623	valid_1's binary_logloss: 0.316968
[40]	valid_0's auc: 0.91882	valid_0's binary_logloss: 0.306644	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.316715
[41]	valid_0's auc: 0.91923	valid_0's binary_logloss: 0.305816	valid_1's auc: 0.908718	valid_1's binary_logloss: 0.316525
[42]	valid_0's auc: 0.919663	valid_0's binary_logloss: 0.304901	valid_1's auc: 0.90869	valid_1's binary_logloss: 0.316399
[43]	valid_0's auc: 0.920176	valid_0's binary_logloss: 0.303959	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.316434
[44]	valid_0's auc: 0.920583	valid_0's binary_logloss: 0.303137	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.31641
[45]	valid_0's auc: 0.920931	valid_0's binary_logloss: 0.302411	valid_1's auc: 0.908537	valid_1's binary_logloss: 0.316298
[46]	valid_0's auc: 0.921312	valid_0's binary_logloss: 0.301733	valid_1's auc: 0.908563	valid_1's binary_logloss: 0.316212
[47]	valid_0's auc: 0.921661	valid_0's binary_logloss: 0.301001	valid_1's auc: 0.908668	valid_1's binary_logloss: 0.316022
[48]	valid_0's auc: 0.921971	valid_0's binary_logloss: 0.300378	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.31605
[49]	valid_0's auc: 0.922377	valid_0's binary_logloss: 0.299607	valid_1's auc: 0.908723	valid_1's binary_logloss: 0.315742
[50]	valid_0's auc: 0.922718	valid_0's binary_logloss: 0.298922	valid_1's auc: 0.908844	valid_1's binary_logloss: 0.315538
[51]	valid_0's auc: 0.922958	valid_0's binary_logloss: 0.298409	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.315673
[52]	valid_0's auc: 0.923253	valid_0's binary_logloss: 0.297769	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.315405
[53]	valid_0's auc: 0.92357	valid_0's binary_logloss: 0.297153	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.315423
[54]	valid_0's auc: 0.92373	valid_0's binary_logloss: 0.296878	valid_1's auc: 0.908793	valid_1's binary_logloss: 0.315419
[55]	valid_0's auc: 0.924118	valid_0's binary_logloss: 0.296128	valid_1's auc: 0.908734	valid_1's binary_logloss: 0.315493
[56]	valid_0's auc: 0.924481	valid_0's binary_logloss: 0.295466	valid_1's auc: 0.908694	valid_1's binary_logloss: 0.315526
[57]	valid_0's auc: 0.924679	valid_0's binary_logloss: 0.295084	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.315669
[58]	valid_0's auc: 0.925005	valid_0's binary_logloss: 0.294523	valid_1's auc: 0.908414	valid_1's binary_logloss: 0.315865
[59]	valid_0's auc: 0.925247	valid_0's binary_logloss: 0.294043	valid_1's auc: 0.908459	valid_1's binary_logloss: 0.31584
[60]	valid_0's auc: 0.925304	valid_0's binary_logloss: 0.293893	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.315821
[61]	valid_0's auc: 0.925643	valid_0's binary_logloss: 0.293274	valid_1's auc: 0.908486	valid_1's binary_logloss: 0.315766
[62]	valid_0's auc: 0.925914	valid_0's binary_logloss: 0.292825	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.315835
[63]	valid_0's auc: 0.926266	valid_0's binary_logloss: 0.292204	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.31586
[64]	valid_0's auc: 0.92647	valid_0's binary_logloss: 0.29185	valid_1's auc: 0.908326	valid_1's binary_logloss: 0.315951
[65]	valid_0's auc: 0.926728	valid_0's binary_logloss: 0.29134	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.315936
[66]	valid_0's auc: 0.927039	valid_0's binary_logloss: 0.290834	valid_1's auc: 0.908265	valid_1's binary_logloss: 0.316049
[67]	valid_0's auc: 0.927346	valid_0's binary_logloss: 0.290278	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.316258
[68]	valid_0's auc: 0.927684	valid_0's binary_logloss: 0.289728	valid_1's auc: 0.908104	valid_1's binary_logloss: 0.316346
[69]	valid_0's auc: 0.92795	valid_0's binary_logloss: 0.289263	valid_1's auc: 0.908083	valid_1's binary_logloss: 0.316347
[70]	valid_0's auc: 0.928141	valid_0's binary_logloss: 0.288886	valid_1's auc: 0.908047	valid_1's binary_logloss: 0.31635
[71]	valid_0's auc: 0.928451	valid_0's binary_logloss: 0.288392	valid_1's auc: 0.908057	valid_1's binary_logloss: 0.316344
[72]	valid_0's auc: 0.928747	valid_0's binary_logloss: 0.287861	valid_1's auc: 0.908051	valid_1's binary_logloss: 0.316399
[73]	valid_0's auc: 0.928844	valid_0's binary_logloss: 0.287703	valid_1's auc: 0.908023	valid_1's binary_logloss: 0.316456
[74]	valid_0's auc: 0.92919	valid_0's binary_logloss: 0.287153	valid_1's auc: 0.907997	valid_1's binary_logloss: 0.316547
[75]	valid_0's auc: 0.929364	valid_0's binary_logloss: 0.286793	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.316585
[76]	valid_0's auc: 0.929792	valid_0's binary_logloss: 0.286109	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.316731
[77]	valid_0's auc: 0.930014	valid_0's binary_logloss: 0.285734	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.316886
[78]	valid_0's auc: 0.930291	valid_0's binary_logloss: 0.285207	valid_1's auc: 0.907621	valid_1's binary_logloss: 0.317062
[79]	valid_0's auc: 0.930405	valid_0's binary_logloss: 0.285025	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317203
[80]	valid_0's auc: 0.930652	valid_0's binary_logloss: 0.284602	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.31735
[81]	valid_0's auc: 0.930942	valid_0's binary_logloss: 0.284097	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.317428
[82]	valid_0's auc: 0.931213	valid_0's binary_logloss: 0.2836	valid_1's auc: 0.907323	valid_1's binary_logloss: 0.317519
[83]	valid_0's auc: 0.931474	valid_0's binary_logloss: 0.283122	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.317635
[84]	valid_0's auc: 0.931711	valid_0's binary_logloss: 0.282702	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.317717
[85]	valid_0's auc: 0.931859	valid_0's binary_logloss: 0.282439	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.317854
[86]	valid_0's auc: 0.932056	valid_0's binary_logloss: 0.282089	valid_1's auc: 0.90721	valid_1's binary_logloss: 0.317876
[87]	valid_0's auc: 0.932326	valid_0's binary_logloss: 0.281665	valid_1's auc: 0.907193	valid_1's binary_logloss: 0.317908
[88]	valid_0's auc: 0.932537	valid_0's binary_logloss: 0.281286	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318008
[89]	valid_0's auc: 0.932781	valid_0's binary_logloss: 0.280858	valid_1's auc: 0.907118	valid_1's binary_logloss: 0.318071
[90]	valid_0's auc: 0.932865	valid_0's binary_logloss: 0.280715	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318249
[91]	valid_0's auc: 0.933094	valid_0's binary_logloss: 0.280277	valid_1's auc: 0.906882	valid_1's binary_logloss: 0.318489
[92]	valid_0's auc: 0.933364	valid_0's binary_logloss: 0.279795	valid_1's auc: 0.90685	valid_1's binary_logloss: 0.318564
[93]	valid_0's auc: 0.933635	valid_0's binary_logloss: 0.279308	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.318646
[94]	valid_0's auc: 0.933756	valid_0's binary_logloss: 0.279094	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.318653
[95]	valid_0's auc: 0.933989	valid_0's binary_logloss: 0.278712	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.318867
[96]	valid_0's auc: 0.93427	valid_0's binary_logloss: 0.278242	valid_1's auc: 0.906628	valid_1's binary_logloss: 0.318963
[97]	valid_0's auc: 0.934445	valid_0's binary_logloss: 0.27793	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319072
[98]	valid_0's auc: 0.934563	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.906574	valid_1's binary_logloss: 0.319093
[99]	valid_0's auc: 0.93468	valid_0's binary_logloss: 0.27748	valid_1's auc: 0.906524	valid_1's binary_logloss: 0.31919
[100]	valid_0's auc: 0.93487	valid_0's binary_logloss: 0.277133	valid_1's auc: 0.906498	valid_1's binary_logloss: 0.319209
[101]	valid_0's auc: 0.935074	valid_0's binary_logloss: 0.276752	valid_1's auc: 0.906391	valid_1's binary_logloss: 0.319466
[102]	valid_0's auc: 0.935328	valid_0's binary_logloss: 0.276325	valid_1's auc: 0.906288	valid_1's binary_logloss: 0.319622
[103]	valid_0's auc: 0.935529	valid_0's binary_logloss: 0.275918	valid_1's auc: 0.906225	valid_1's binary_logloss: 0.319762
[104]	valid_0's auc: 0.935735	valid_0's binary_logloss: 0.275514	valid_1's auc: 0.906215	valid_1's binary_logloss: 0.319775
[105]	valid_0's auc: 0.935896	valid_0's binary_logloss: 0.275222	valid_1's auc: 0.906251	valid_1's binary_logloss: 0.319758
[106]	valid_0's auc: 0.936121	valid_0's binary_logloss: 0.274847	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.319791
[107]	valid_0's auc: 0.936357	valid_0's binary_logloss: 0.27444	valid_1's auc: 0.906127	valid_1's binary_logloss: 0.320039
[108]	valid_0's auc: 0.93656	valid_0's binary_logloss: 0.274051	valid_1's auc: 0.906135	valid_1's binary_logloss: 0.320029
[109]	valid_0's auc: 0.936749	valid_0's binary_logloss: 0.273691	valid_1's auc: 0.906016	valid_1's binary_logloss: 0.320246
[110]	valid_0's auc: 0.936876	valid_0's binary_logloss: 0.273436	valid_1's auc: 0.906046	valid_1's binary_logloss: 0.320193
[111]	valid_0's auc: 0.937038	valid_0's binary_logloss: 0.27311	valid_1's auc: 0.905961	valid_1's binary_logloss: 0.320384
[112]	valid_0's auc: 0.937218	valid_0's binary_logloss: 0.272753	valid_1's auc: 0.90595	valid_1's binary_logloss: 0.320386
[113]	valid_0's auc: 0.937456	valid_0's binary_logloss: 0.272344	valid_1's auc: 0.905862	valid_1's binary_logloss: 0.320581
[114]	valid_0's auc: 0.937628	valid_0's binary_logloss: 0.272054	valid_1's auc: 0.905758	valid_1's binary_logloss: 0.320733
[115]	valid_0's auc: 0.937872	valid_0's binary_logloss: 0.271641	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320608
[116]	valid_0's auc: 0.938059	valid_0's binary_logloss: 0.271324	valid_1's auc: 0.905822	valid_1's binary_logloss: 0.320713
[117]	valid_0's auc: 0.938117	valid_0's binary_logloss: 0.271214	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.32077
[118]	valid_0's auc: 0.938249	valid_0's binary_logloss: 0.270922	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.320943
[119]	valid_0's auc: 0.938352	valid_0's binary_logloss: 0.270666	valid_1's auc: 0.905798	valid_1's binary_logloss: 0.320893
[120]	valid_0's auc: 0.938471	valid_0's binary_logloss: 0.270449	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.320929
[121]	valid_0's auc: 0.938605	valid_0's binary_logloss: 0.270174	valid_1's auc: 0.905806	valid_1's binary_logloss: 0.320922
[122]	valid_0's auc: 0.938704	valid_0's binary_logloss: 0.269949	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.321135
[123]	valid_0's auc: 0.938915	valid_0's binary_logloss: 0.269555	valid_1's auc: 0.905659	valid_1's binary_logloss: 0.321218
[124]	valid_0's auc: 0.939044	valid_0's binary_logloss: 0.269295	valid_1's auc: 0.905488	valid_1's binary_logloss: 0.321515
[125]	valid_0's auc: 0.939113	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.905458	valid_1's binary_logloss: 0.321587
[126]	valid_0's auc: 0.939285	valid_0's binary_logloss: 0.268875	valid_1's auc: 0.905381	valid_1's binary_logloss: 0.321725
[127]	valid_0's auc: 0.939443	valid_0's binary_logloss: 0.268588	valid_1's auc: 0.905335	valid_1's binary_logloss: 0.321828
[128]	valid_0's auc: 0.939595	valid_0's binary_logloss: 0.268319	valid_1's auc: 0.905252	valid_1's binary_logloss: 0.321979
[129]	valid_0's auc: 0.939662	valid_0's binary_logloss: 0.268193	valid_1's auc: 0.905212	valid_1's binary_logloss: 0.322058
[130]	valid_0's auc: 0.939841	valid_0's binary_logloss: 0.267863	valid_1's auc: 0.905186	valid_1's binary_logloss: 0.322213
[131]	valid_0's auc: 0.940072	valid_0's binary_logloss: 0.267451	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.322357
[132]	valid_0's auc: 0.940194	valid_0's binary_logloss: 0.267148	valid_1's auc: 0.905029	valid_1's binary_logloss: 0.322511
[133]	valid_0's auc: 0.940384	valid_0's binary_logloss: 0.26682	valid_1's auc: 0.905026	valid_1's binary_logloss: 0.322547
[134]	valid_0's auc: 0.940527	valid_0's binary_logloss: 0.266547	valid_1's auc: 0.904954	valid_1's binary_logloss: 0.322715
[135]	valid_0's auc: 0.9408	valid_0's binary_logloss: 0.266096	valid_1's auc: 0.904851	valid_1's binary_logloss: 0.322861
[136]	valid_0's auc: 0.940944	valid_0's binary_logloss: 0.265818	valid_1's auc: 0.904838	valid_1's binary_logloss: 0.322956
[137]	valid_0's auc: 0.941042	valid_0's binary_logloss: 0.265655	valid_1's auc: 0.904725	valid_1's binary_logloss: 0.323172
[138]	valid_0's auc: 0.941142	valid_0's binary_logloss: 0.26546	valid_1's auc: 0.904631	valid_1's binary_logloss: 0.323318
[139]	valid_0's auc: 0.941276	valid_0's binary_logloss: 0.265207	valid_1's auc: 0.904567	valid_1's binary_logloss: 0.323369
[140]	valid_0's auc: 0.941344	valid_0's binary_logloss: 0.265077	valid_1's auc: 0.904518	valid_1's binary_logloss: 0.323465
[141]	valid_0's auc: 0.941525	valid_0's binary_logloss: 0.264758	valid_1's auc: 0.904482	valid_1's binary_logloss: 0.323518
[142]	valid_0's auc: 0.94157	valid_0's binary_logloss: 0.264648	valid_1's auc: 0.904501	valid_1's binary_logloss: 0.323518
[143]	valid_0's auc: 0.941778	valid_0's binary_logloss: 0.264265	valid_1's auc: 0.904507	valid_1's binary_logloss: 0.32351
[144]	valid_0's auc: 0.941938	valid_0's binary_logloss: 0.263953	valid_1's auc: 0.904598	valid_1's binary_logloss: 0.32341
[145]	valid_0's auc: 0.942156	valid_0's binary_logloss: 0.263575	valid_1's auc: 0.904476	valid_1's binary_logloss: 0.323638
[146]	valid_0's auc: 0.942366	valid_0's binary_logloss: 0.26322	valid_1's auc: 0.904441	valid_1's binary_logloss: 0.323734
[147]	valid_0's auc: 0.942592	valid_0's binary_logloss: 0.262827	valid_1's auc: 0.904334	valid_1's binary_logloss: 0.323967
[148]	valid_0's auc: 0.942734	valid_0's binary_logloss: 0.26256	valid_1's auc: 0.904254	valid_1's binary_logloss: 0.32416
[149]	valid_0's auc: 0.942873	valid_0's binary_logloss: 0.26228	valid_1's auc: 0.9043	valid_1's binary_logloss: 0.324144
[150]	valid_0's auc: 0.94318	valid_0's binary_logloss: 0.261724	valid_1's auc: 0.904208	valid_1's binary_logloss: 0.324314
Early stopping, best iteration is:
[50]	valid_0's auc: 0.922718	valid_0's binary_logloss: 0.298922	valid_1's auc: 0.908844	valid_1's binary_logloss: 0.315538
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892925	valid_0's binary_logloss: 0.488849	valid_1's auc: 0.898619	valid_1's binary_logloss: 0.479345
[3]	valid_0's auc: 0.893551	valid_0's binary_logloss: 0.465882	valid_1's auc: 0.898638	valid_1's binary_logloss: 0.456011
[4]	valid_0's auc: 0.896053	valid_0's binary_logloss: 0.446354	valid_1's auc: 0.900446	valid_1's binary_logloss: 0.436516
[5]	valid_0's auc: 0.897119	valid_0's binary_logloss: 0.430499	valid_1's auc: 0.902176	valid_1's binary_logloss: 0.420287
[6]	valid_0's auc: 0.898588	valid_0's binary_logloss: 0.416679	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.40622
[7]	valid_0's auc: 0.899529	valid_0's binary_logloss: 0.405006	valid_1's auc: 0.904367	valid_1's binary_logloss: 0.394504
[8]	valid_0's auc: 0.90018	valid_0's binary_logloss: 0.394978	valid_1's auc: 0.904583	valid_1's binary_logloss: 0.384716
[9]	valid_0's auc: 0.900614	valid_0's binary_logloss: 0.386464	valid_1's auc: 0.904763	valid_1's binary_logloss: 0.376092
[10]	valid_0's auc: 0.901576	valid_0's binary_logloss: 0.378593	valid_1's auc: 0.905018	valid_1's binary_logloss: 0.368746
[11]	valid_0's auc: 0.902508	valid_0's binary_logloss: 0.371898	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.362418
[12]	valid_0's auc: 0.903079	valid_0's binary_logloss: 0.366032	valid_1's auc: 0.905353	valid_1's binary_logloss: 0.357073
[13]	valid_0's auc: 0.903656	valid_0's binary_logloss: 0.360699	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.352261
[14]	valid_0's auc: 0.904849	valid_0's binary_logloss: 0.355873	valid_1's auc: 0.906208	valid_1's binary_logloss: 0.347838
[15]	valid_0's auc: 0.905393	valid_0's binary_logloss: 0.351643	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.344199
[16]	valid_0's auc: 0.906008	valid_0's binary_logloss: 0.347815	valid_1's auc: 0.906843	valid_1's binary_logloss: 0.340819
[17]	valid_0's auc: 0.906554	valid_0's binary_logloss: 0.344379	valid_1's auc: 0.907228	valid_1's binary_logloss: 0.337716
[18]	valid_0's auc: 0.906982	valid_0's binary_logloss: 0.341387	valid_1's auc: 0.907447	valid_1's binary_logloss: 0.33513
[19]	valid_0's auc: 0.907602	valid_0's binary_logloss: 0.338525	valid_1's auc: 0.907563	valid_1's binary_logloss: 0.3329
[20]	valid_0's auc: 0.908251	valid_0's binary_logloss: 0.335882	valid_1's auc: 0.908	valid_1's binary_logloss: 0.330635
[21]	valid_0's auc: 0.908814	valid_0's binary_logloss: 0.333475	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.328872
[22]	valid_0's auc: 0.909375	valid_0's binary_logloss: 0.331353	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.327327
[23]	valid_0's auc: 0.909824	valid_0's binary_logloss: 0.329416	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.326051
[24]	valid_0's auc: 0.910349	valid_0's binary_logloss: 0.327532	valid_1's auc: 0.908316	valid_1's binary_logloss: 0.324722
[25]	valid_0's auc: 0.910802	valid_0's binary_logloss: 0.325869	valid_1's auc: 0.908417	valid_1's binary_logloss: 0.323584
[26]	valid_0's auc: 0.911366	valid_0's binary_logloss: 0.324182	valid_1's auc: 0.908676	valid_1's binary_logloss: 0.322558
[27]	valid_0's auc: 0.911868	valid_0's binary_logloss: 0.322633	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.321658
[28]	valid_0's auc: 0.912292	valid_0's binary_logloss: 0.321241	valid_1's auc: 0.908852	valid_1's binary_logloss: 0.320952
[29]	valid_0's auc: 0.912815	valid_0's binary_logloss: 0.319774	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.320199
[30]	valid_0's auc: 0.913219	valid_0's binary_logloss: 0.318584	valid_1's auc: 0.908901	valid_1's binary_logloss: 0.319623
[31]	valid_0's auc: 0.91371	valid_0's binary_logloss: 0.317324	valid_1's auc: 0.909002	valid_1's binary_logloss: 0.31901
[32]	valid_0's auc: 0.914161	valid_0's binary_logloss: 0.316196	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.318452
[33]	valid_0's auc: 0.914556	valid_0's binary_logloss: 0.315144	valid_1's auc: 0.909196	valid_1's binary_logloss: 0.318068
[34]	valid_0's auc: 0.914912	valid_0's binary_logloss: 0.314282	valid_1's auc: 0.909218	valid_1's binary_logloss: 0.317693
[35]	valid_0's auc: 0.915356	valid_0's binary_logloss: 0.313219	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.317196
[36]	valid_0's auc: 0.915711	valid_0's binary_logloss: 0.312335	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.316845
[37]	valid_0's auc: 0.916164	valid_0's binary_logloss: 0.311283	valid_1's auc: 0.909516	valid_1's binary_logloss: 0.316478
[38]	valid_0's auc: 0.916614	valid_0's binary_logloss: 0.310332	valid_1's auc: 0.909388	valid_1's binary_logloss: 0.316423
[39]	valid_0's auc: 0.917012	valid_0's binary_logloss: 0.309457	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.316247
[40]	valid_0's auc: 0.917337	valid_0's binary_logloss: 0.30869	valid_1's auc: 0.909312	valid_1's binary_logloss: 0.316132
[41]	valid_0's auc: 0.917742	valid_0's binary_logloss: 0.307901	valid_1's auc: 0.909457	valid_1's binary_logloss: 0.315739
[42]	valid_0's auc: 0.918016	valid_0's binary_logloss: 0.307323	valid_1's auc: 0.909611	valid_1's binary_logloss: 0.315448
[43]	valid_0's auc: 0.918383	valid_0's binary_logloss: 0.306602	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.315283
[44]	valid_0's auc: 0.918737	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.909473	valid_1's binary_logloss: 0.315318
[45]	valid_0's auc: 0.919024	valid_0's binary_logloss: 0.305277	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.315376
[46]	valid_0's auc: 0.919333	valid_0's binary_logloss: 0.304644	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.315235
[47]	valid_0's auc: 0.919719	valid_0's binary_logloss: 0.303862	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.315087
[48]	valid_0's auc: 0.919976	valid_0's binary_logloss: 0.303367	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.315082
[49]	valid_0's auc: 0.920318	valid_0's binary_logloss: 0.302766	valid_1's auc: 0.909495	valid_1's binary_logloss: 0.314933
[50]	valid_0's auc: 0.920734	valid_0's binary_logloss: 0.302008	valid_1's auc: 0.90947	valid_1's binary_logloss: 0.31489
[51]	valid_0's auc: 0.921015	valid_0's binary_logloss: 0.30141	valid_1's auc: 0.90939	valid_1's binary_logloss: 0.314906
[52]	valid_0's auc: 0.921243	valid_0's binary_logloss: 0.300971	valid_1's auc: 0.909356	valid_1's binary_logloss: 0.314883
[53]	valid_0's auc: 0.921592	valid_0's binary_logloss: 0.300296	valid_1's auc: 0.909392	valid_1's binary_logloss: 0.314765
[54]	valid_0's auc: 0.921815	valid_0's binary_logloss: 0.299798	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.314686
[55]	valid_0's auc: 0.922089	valid_0's binary_logloss: 0.299287	valid_1's auc: 0.909407	valid_1's binary_logloss: 0.314581
[56]	valid_0's auc: 0.922299	valid_0's binary_logloss: 0.298883	valid_1's auc: 0.909489	valid_1's binary_logloss: 0.314388
[57]	valid_0's auc: 0.922529	valid_0's binary_logloss: 0.298462	valid_1's auc: 0.909514	valid_1's binary_logloss: 0.314347
[58]	valid_0's auc: 0.922719	valid_0's binary_logloss: 0.298049	valid_1's auc: 0.909537	valid_1's binary_logloss: 0.314294
[59]	valid_0's auc: 0.922985	valid_0's binary_logloss: 0.297603	valid_1's auc: 0.909582	valid_1's binary_logloss: 0.314226
[60]	valid_0's auc: 0.923266	valid_0's binary_logloss: 0.297065	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.314302
[61]	valid_0's auc: 0.923571	valid_0's binary_logloss: 0.296486	valid_1's auc: 0.909602	valid_1's binary_logloss: 0.314171
[62]	valid_0's auc: 0.923789	valid_0's binary_logloss: 0.296086	valid_1's auc: 0.909535	valid_1's binary_logloss: 0.314229
[63]	valid_0's auc: 0.924076	valid_0's binary_logloss: 0.295537	valid_1's auc: 0.909491	valid_1's binary_logloss: 0.314237
[64]	valid_0's auc: 0.924409	valid_0's binary_logloss: 0.294963	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.314358
[65]	valid_0's auc: 0.924668	valid_0's binary_logloss: 0.294489	valid_1's auc: 0.909396	valid_1's binary_logloss: 0.314357
[66]	valid_0's auc: 0.924902	valid_0's binary_logloss: 0.294087	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.314423
[67]	valid_0's auc: 0.925083	valid_0's binary_logloss: 0.293767	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.314426
[68]	valid_0's auc: 0.925243	valid_0's binary_logloss: 0.293473	valid_1's auc: 0.909218	valid_1's binary_logloss: 0.314566
[69]	valid_0's auc: 0.925585	valid_0's binary_logloss: 0.292894	valid_1's auc: 0.909163	valid_1's binary_logloss: 0.314653
[70]	valid_0's auc: 0.925693	valid_0's binary_logloss: 0.292698	valid_1's auc: 0.909162	valid_1's binary_logloss: 0.314627
[71]	valid_0's auc: 0.925966	valid_0's binary_logloss: 0.292203	valid_1's auc: 0.909273	valid_1's binary_logloss: 0.314467
[72]	valid_0's auc: 0.92619	valid_0's binary_logloss: 0.291818	valid_1's auc: 0.909184	valid_1's binary_logloss: 0.31455
[73]	valid_0's auc: 0.926456	valid_0's binary_logloss: 0.291316	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.314457
[74]	valid_0's auc: 0.92671	valid_0's binary_logloss: 0.29091	valid_1's auc: 0.909165	valid_1's binary_logloss: 0.314532
[75]	valid_0's auc: 0.927182	valid_0's binary_logloss: 0.290169	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314728
[76]	valid_0's auc: 0.927371	valid_0's binary_logloss: 0.289822	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314767
[77]	valid_0's auc: 0.927774	valid_0's binary_logloss: 0.289175	valid_1's auc: 0.909019	valid_1's binary_logloss: 0.314897
[78]	valid_0's auc: 0.928021	valid_0's binary_logloss: 0.288698	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314811
[79]	valid_0's auc: 0.928232	valid_0's binary_logloss: 0.288378	valid_1's auc: 0.909044	valid_1's binary_logloss: 0.314845
[80]	valid_0's auc: 0.928472	valid_0's binary_logloss: 0.287919	valid_1's auc: 0.909078	valid_1's binary_logloss: 0.314808
[81]	valid_0's auc: 0.928687	valid_0's binary_logloss: 0.287553	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.314849
[82]	valid_0's auc: 0.92894	valid_0's binary_logloss: 0.287155	valid_1's auc: 0.909044	valid_1's binary_logloss: 0.314928
[83]	valid_0's auc: 0.929101	valid_0's binary_logloss: 0.286879	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.314921
[84]	valid_0's auc: 0.929247	valid_0's binary_logloss: 0.28659	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.315092
[85]	valid_0's auc: 0.929467	valid_0's binary_logloss: 0.286244	valid_1's auc: 0.908982	valid_1's binary_logloss: 0.315083
[86]	valid_0's auc: 0.929681	valid_0's binary_logloss: 0.285813	valid_1's auc: 0.908913	valid_1's binary_logloss: 0.315199
[87]	valid_0's auc: 0.929894	valid_0's binary_logloss: 0.285461	valid_1's auc: 0.908821	valid_1's binary_logloss: 0.315332
[88]	valid_0's auc: 0.930174	valid_0's binary_logloss: 0.284959	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.315384
[89]	valid_0's auc: 0.930331	valid_0's binary_logloss: 0.284691	valid_1's auc: 0.908715	valid_1's binary_logloss: 0.315484
[90]	valid_0's auc: 0.930562	valid_0's binary_logloss: 0.284279	valid_1's auc: 0.908696	valid_1's binary_logloss: 0.315558
[91]	valid_0's auc: 0.930763	valid_0's binary_logloss: 0.283887	valid_1's auc: 0.908676	valid_1's binary_logloss: 0.315615
[92]	valid_0's auc: 0.930955	valid_0's binary_logloss: 0.283524	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.315708
[93]	valid_0's auc: 0.931237	valid_0's binary_logloss: 0.283051	valid_1's auc: 0.908572	valid_1's binary_logloss: 0.315778
[94]	valid_0's auc: 0.931514	valid_0's binary_logloss: 0.282516	valid_1's auc: 0.908475	valid_1's binary_logloss: 0.315879
[95]	valid_0's auc: 0.931746	valid_0's binary_logloss: 0.282115	valid_1's auc: 0.908431	valid_1's binary_logloss: 0.316001
[96]	valid_0's auc: 0.932023	valid_0's binary_logloss: 0.281639	valid_1's auc: 0.908462	valid_1's binary_logloss: 0.315948
[97]	valid_0's auc: 0.932176	valid_0's binary_logloss: 0.281385	valid_1's auc: 0.908409	valid_1's binary_logloss: 0.316008
[98]	valid_0's auc: 0.932348	valid_0's binary_logloss: 0.281097	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.31589
[99]	valid_0's auc: 0.932612	valid_0's binary_logloss: 0.280647	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.31592
[100]	valid_0's auc: 0.932849	valid_0's binary_logloss: 0.280228	valid_1's auc: 0.908455	valid_1's binary_logloss: 0.315971
[101]	valid_0's auc: 0.933046	valid_0's binary_logloss: 0.279928	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.315985
[102]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.279607	valid_1's auc: 0.908475	valid_1's binary_logloss: 0.316016
[103]	valid_0's auc: 0.933454	valid_0's binary_logloss: 0.279224	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.316167
[104]	valid_0's auc: 0.933718	valid_0's binary_logloss: 0.278809	valid_1's auc: 0.908255	valid_1's binary_logloss: 0.316312
[105]	valid_0's auc: 0.93388	valid_0's binary_logloss: 0.278543	valid_1's auc: 0.908123	valid_1's binary_logloss: 0.31651
[106]	valid_0's auc: 0.934049	valid_0's binary_logloss: 0.278266	valid_1's auc: 0.908049	valid_1's binary_logloss: 0.316664
[107]	valid_0's auc: 0.934185	valid_0's binary_logloss: 0.278009	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.316857
[108]	valid_0's auc: 0.934355	valid_0's binary_logloss: 0.277745	valid_1's auc: 0.907908	valid_1's binary_logloss: 0.316924
[109]	valid_0's auc: 0.934557	valid_0's binary_logloss: 0.277395	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316874
[110]	valid_0's auc: 0.93471	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317003
[111]	valid_0's auc: 0.934879	valid_0's binary_logloss: 0.276828	valid_1's auc: 0.907823	valid_1's binary_logloss: 0.317077
[112]	valid_0's auc: 0.93498	valid_0's binary_logloss: 0.276675	valid_1's auc: 0.907753	valid_1's binary_logloss: 0.317181
[113]	valid_0's auc: 0.935217	valid_0's binary_logloss: 0.276271	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.31716
[114]	valid_0's auc: 0.93543	valid_0's binary_logloss: 0.275908	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317215
[115]	valid_0's auc: 0.935533	valid_0's binary_logloss: 0.275738	valid_1's auc: 0.907694	valid_1's binary_logloss: 0.317442
[116]	valid_0's auc: 0.935729	valid_0's binary_logloss: 0.275388	valid_1's auc: 0.907663	valid_1's binary_logloss: 0.31749
[117]	valid_0's auc: 0.935945	valid_0's binary_logloss: 0.275021	valid_1's auc: 0.907606	valid_1's binary_logloss: 0.317606
[118]	valid_0's auc: 0.93615	valid_0's binary_logloss: 0.274648	valid_1's auc: 0.907524	valid_1's binary_logloss: 0.317765
[119]	valid_0's auc: 0.936369	valid_0's binary_logloss: 0.274303	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317927
[120]	valid_0's auc: 0.936534	valid_0's binary_logloss: 0.273991	valid_1's auc: 0.907271	valid_1's binary_logloss: 0.318141
[121]	valid_0's auc: 0.936728	valid_0's binary_logloss: 0.27367	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318188
[122]	valid_0's auc: 0.936915	valid_0's binary_logloss: 0.273328	valid_1's auc: 0.907247	valid_1's binary_logloss: 0.318202
[123]	valid_0's auc: 0.937124	valid_0's binary_logloss: 0.272961	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.318323
[124]	valid_0's auc: 0.937328	valid_0's binary_logloss: 0.272542	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.318575
[125]	valid_0's auc: 0.937475	valid_0's binary_logloss: 0.272248	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318608
[126]	valid_0's auc: 0.937665	valid_0's binary_logloss: 0.271889	valid_1's auc: 0.906995	valid_1's binary_logloss: 0.318789
[127]	valid_0's auc: 0.937849	valid_0's binary_logloss: 0.271574	valid_1's auc: 0.906896	valid_1's binary_logloss: 0.319007
[128]	valid_0's auc: 0.938125	valid_0's binary_logloss: 0.271128	valid_1's auc: 0.906854	valid_1's binary_logloss: 0.319107
[129]	valid_0's auc: 0.938297	valid_0's binary_logloss: 0.270818	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.319251
[130]	valid_0's auc: 0.938493	valid_0's binary_logloss: 0.270447	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.31939
[131]	valid_0's auc: 0.938703	valid_0's binary_logloss: 0.270079	valid_1's auc: 0.906559	valid_1's binary_logloss: 0.319704
[132]	valid_0's auc: 0.938843	valid_0's binary_logloss: 0.269824	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.319766
[133]	valid_0's auc: 0.939022	valid_0's binary_logloss: 0.269512	valid_1's auc: 0.906383	valid_1's binary_logloss: 0.319975
[134]	valid_0's auc: 0.939109	valid_0's binary_logloss: 0.269339	valid_1's auc: 0.906336	valid_1's binary_logloss: 0.320098
[135]	valid_0's auc: 0.939345	valid_0's binary_logloss: 0.268912	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.320102
[136]	valid_0's auc: 0.939511	valid_0's binary_logloss: 0.268649	valid_1's auc: 0.906262	valid_1's binary_logloss: 0.320252
[137]	valid_0's auc: 0.939636	valid_0's binary_logloss: 0.268381	valid_1's auc: 0.906274	valid_1's binary_logloss: 0.320322
[138]	valid_0's auc: 0.939738	valid_0's binary_logloss: 0.268171	valid_1's auc: 0.906242	valid_1's binary_logloss: 0.320352
[139]	valid_0's auc: 0.939855	valid_0's binary_logloss: 0.267915	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.320212
[140]	valid_0's auc: 0.939971	valid_0's binary_logloss: 0.267672	valid_1's auc: 0.90636	valid_1's binary_logloss: 0.320241
[141]	valid_0's auc: 0.940133	valid_0's binary_logloss: 0.267364	valid_1's auc: 0.906308	valid_1's binary_logloss: 0.32033
[142]	valid_0's auc: 0.940292	valid_0's binary_logloss: 0.267012	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320542
[143]	valid_0's auc: 0.94052	valid_0's binary_logloss: 0.266591	valid_1's auc: 0.906156	valid_1's binary_logloss: 0.320688
Early stopping, best iteration is:
[43]	valid_0's auc: 0.918383	valid_0's binary_logloss: 0.306602	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.315283
[1]	valid_0's auc: 0.888136	valid_0's binary_logloss: 0.517854	valid_1's auc: 0.89393	valid_1's binary_logloss: 0.508854
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891446	valid_0's binary_logloss: 0.489299	valid_1's auc: 0.894892	valid_1's binary_logloss: 0.479913
[3]	valid_0's auc: 0.894038	valid_0's binary_logloss: 0.466006	valid_1's auc: 0.897301	valid_1's binary_logloss: 0.456282
[4]	valid_0's auc: 0.895358	valid_0's binary_logloss: 0.446806	valid_1's auc: 0.898891	valid_1's binary_logloss: 0.437001
[5]	valid_0's auc: 0.897062	valid_0's binary_logloss: 0.43042	valid_1's auc: 0.900121	valid_1's binary_logloss: 0.42066
[6]	valid_0's auc: 0.897753	valid_0's binary_logloss: 0.416973	valid_1's auc: 0.901305	valid_1's binary_logloss: 0.407041
[7]	valid_0's auc: 0.898496	valid_0's binary_logloss: 0.405285	valid_1's auc: 0.90152	valid_1's binary_logloss: 0.395542
[8]	valid_0's auc: 0.899601	valid_0's binary_logloss: 0.395018	valid_1's auc: 0.902834	valid_1's binary_logloss: 0.385161
[9]	valid_0's auc: 0.900309	valid_0's binary_logloss: 0.38628	valid_1's auc: 0.903314	valid_1's binary_logloss: 0.376468
[10]	valid_0's auc: 0.900879	valid_0's binary_logloss: 0.378683	valid_1's auc: 0.903486	valid_1's binary_logloss: 0.369189
[11]	valid_0's auc: 0.901314	valid_0's binary_logloss: 0.372179	valid_1's auc: 0.903545	valid_1's binary_logloss: 0.363044
[12]	valid_0's auc: 0.902019	valid_0's binary_logloss: 0.366218	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.357307
[13]	valid_0's auc: 0.902768	valid_0's binary_logloss: 0.360999	valid_1's auc: 0.904527	valid_1's binary_logloss: 0.352542
[14]	valid_0's auc: 0.903581	valid_0's binary_logloss: 0.356267	valid_1's auc: 0.90534	valid_1's binary_logloss: 0.347981
[15]	valid_0's auc: 0.904279	valid_0's binary_logloss: 0.352021	valid_1's auc: 0.905796	valid_1's binary_logloss: 0.344233
[16]	valid_0's auc: 0.904859	valid_0's binary_logloss: 0.348325	valid_1's auc: 0.906107	valid_1's binary_logloss: 0.340942
[17]	valid_0's auc: 0.905675	valid_0's binary_logloss: 0.344855	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.337985
[18]	valid_0's auc: 0.906509	valid_0's binary_logloss: 0.341622	valid_1's auc: 0.906774	valid_1's binary_logloss: 0.335609
[19]	valid_0's auc: 0.907097	valid_0's binary_logloss: 0.338785	valid_1's auc: 0.907143	valid_1's binary_logloss: 0.333283
[20]	valid_0's auc: 0.907558	valid_0's binary_logloss: 0.336305	valid_1's auc: 0.907354	valid_1's binary_logloss: 0.331148
[21]	valid_0's auc: 0.908378	valid_0's binary_logloss: 0.333814	valid_1's auc: 0.90764	valid_1's binary_logloss: 0.329295
[22]	valid_0's auc: 0.908958	valid_0's binary_logloss: 0.331572	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.327415
[23]	valid_0's auc: 0.909526	valid_0's binary_logloss: 0.329478	valid_1's auc: 0.908289	valid_1's binary_logloss: 0.325685
[24]	valid_0's auc: 0.910203	valid_0's binary_logloss: 0.32749	valid_1's auc: 0.908433	valid_1's binary_logloss: 0.324457
[25]	valid_0's auc: 0.910766	valid_0's binary_logloss: 0.325706	valid_1's auc: 0.90871	valid_1's binary_logloss: 0.323222
[26]	valid_0's auc: 0.911103	valid_0's binary_logloss: 0.324349	valid_1's auc: 0.908774	valid_1's binary_logloss: 0.322294
[27]	valid_0's auc: 0.911523	valid_0's binary_logloss: 0.32284	valid_1's auc: 0.908903	valid_1's binary_logloss: 0.321285
[28]	valid_0's auc: 0.912053	valid_0's binary_logloss: 0.32133	valid_1's auc: 0.908994	valid_1's binary_logloss: 0.32044
[29]	valid_0's auc: 0.91256	valid_0's binary_logloss: 0.319935	valid_1's auc: 0.909003	valid_1's binary_logloss: 0.319741
[30]	valid_0's auc: 0.91302	valid_0's binary_logloss: 0.318651	valid_1's auc: 0.909113	valid_1's binary_logloss: 0.319024
[31]	valid_0's auc: 0.913531	valid_0's binary_logloss: 0.317382	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.31846
[32]	valid_0's auc: 0.913959	valid_0's binary_logloss: 0.316199	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.31792
[33]	valid_0's auc: 0.914338	valid_0's binary_logloss: 0.315227	valid_1's auc: 0.909213	valid_1's binary_logloss: 0.317438
[34]	valid_0's auc: 0.914701	valid_0's binary_logloss: 0.314299	valid_1's auc: 0.909325	valid_1's binary_logloss: 0.317016
[35]	valid_0's auc: 0.915078	valid_0's binary_logloss: 0.313349	valid_1's auc: 0.909279	valid_1's binary_logloss: 0.316728
[36]	valid_0's auc: 0.915465	valid_0's binary_logloss: 0.312396	valid_1's auc: 0.909381	valid_1's binary_logloss: 0.316332
[37]	valid_0's auc: 0.91574	valid_0's binary_logloss: 0.311714	valid_1's auc: 0.909368	valid_1's binary_logloss: 0.316152
[38]	valid_0's auc: 0.916223	valid_0's binary_logloss: 0.310741	valid_1's auc: 0.909384	valid_1's binary_logloss: 0.315786
[39]	valid_0's auc: 0.916477	valid_0's binary_logloss: 0.310122	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.315443
[40]	valid_0's auc: 0.916817	valid_0's binary_logloss: 0.309372	valid_1's auc: 0.909603	valid_1's binary_logloss: 0.315066
[41]	valid_0's auc: 0.917162	valid_0's binary_logloss: 0.308604	valid_1's auc: 0.909639	valid_1's binary_logloss: 0.3149
[42]	valid_0's auc: 0.917493	valid_0's binary_logloss: 0.307907	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.314861
[43]	valid_0's auc: 0.917837	valid_0's binary_logloss: 0.307162	valid_1's auc: 0.90957	valid_1's binary_logloss: 0.314733
[44]	valid_0's auc: 0.918167	valid_0's binary_logloss: 0.306487	valid_1's auc: 0.909621	valid_1's binary_logloss: 0.31455
[45]	valid_0's auc: 0.918333	valid_0's binary_logloss: 0.306105	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.314526
[46]	valid_0's auc: 0.918655	valid_0's binary_logloss: 0.305424	valid_1's auc: 0.909539	valid_1's binary_logloss: 0.314427
[47]	valid_0's auc: 0.918985	valid_0's binary_logloss: 0.304742	valid_1's auc: 0.909456	valid_1's binary_logloss: 0.314424
[48]	valid_0's auc: 0.91939	valid_0's binary_logloss: 0.304018	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.314384
[49]	valid_0's auc: 0.91975	valid_0's binary_logloss: 0.303358	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314159
[50]	valid_0's auc: 0.920083	valid_0's binary_logloss: 0.30273	valid_1's auc: 0.90957	valid_1's binary_logloss: 0.314176
[51]	valid_0's auc: 0.920397	valid_0's binary_logloss: 0.302171	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314126
[52]	valid_0's auc: 0.920643	valid_0's binary_logloss: 0.301737	valid_1's auc: 0.909555	valid_1's binary_logloss: 0.314108
[53]	valid_0's auc: 0.92103	valid_0's binary_logloss: 0.301055	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.314161
[54]	valid_0's auc: 0.921355	valid_0's binary_logloss: 0.300483	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.3142
[55]	valid_0's auc: 0.921795	valid_0's binary_logloss: 0.299702	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.314181
[56]	valid_0's auc: 0.922088	valid_0's binary_logloss: 0.29912	valid_1's auc: 0.909452	valid_1's binary_logloss: 0.314208
[57]	valid_0's auc: 0.922427	valid_0's binary_logloss: 0.298476	valid_1's auc: 0.909426	valid_1's binary_logloss: 0.314258
[58]	valid_0's auc: 0.922606	valid_0's binary_logloss: 0.298081	valid_1's auc: 0.909423	valid_1's binary_logloss: 0.314268
[59]	valid_0's auc: 0.922862	valid_0's binary_logloss: 0.297566	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.314353
[60]	valid_0's auc: 0.923163	valid_0's binary_logloss: 0.297038	valid_1's auc: 0.909243	valid_1's binary_logloss: 0.314481
[61]	valid_0's auc: 0.923316	valid_0's binary_logloss: 0.296708	valid_1's auc: 0.909211	valid_1's binary_logloss: 0.314471
[62]	valid_0's auc: 0.923645	valid_0's binary_logloss: 0.29619	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.314658
[63]	valid_0's auc: 0.923866	valid_0's binary_logloss: 0.295798	valid_1's auc: 0.909084	valid_1's binary_logloss: 0.314661
[64]	valid_0's auc: 0.9242	valid_0's binary_logloss: 0.295235	valid_1's auc: 0.908959	valid_1's binary_logloss: 0.314867
[65]	valid_0's auc: 0.924464	valid_0's binary_logloss: 0.294731	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.314948
[66]	valid_0's auc: 0.924677	valid_0's binary_logloss: 0.294344	valid_1's auc: 0.9088	valid_1's binary_logloss: 0.315026
[67]	valid_0's auc: 0.925025	valid_0's binary_logloss: 0.293773	valid_1's auc: 0.908749	valid_1's binary_logloss: 0.315115
[68]	valid_0's auc: 0.92518	valid_0's binary_logloss: 0.293496	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.315227
[69]	valid_0's auc: 0.925456	valid_0's binary_logloss: 0.293047	valid_1's auc: 0.90862	valid_1's binary_logloss: 0.315335
[70]	valid_0's auc: 0.925634	valid_0's binary_logloss: 0.29272	valid_1's auc: 0.908646	valid_1's binary_logloss: 0.315359
[71]	valid_0's auc: 0.925872	valid_0's binary_logloss: 0.292262	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.315263
[72]	valid_0's auc: 0.926065	valid_0's binary_logloss: 0.291939	valid_1's auc: 0.908616	valid_1's binary_logloss: 0.315408
[73]	valid_0's auc: 0.926426	valid_0's binary_logloss: 0.291351	valid_1's auc: 0.908659	valid_1's binary_logloss: 0.315366
[74]	valid_0's auc: 0.926622	valid_0's binary_logloss: 0.290995	valid_1's auc: 0.908647	valid_1's binary_logloss: 0.315374
[75]	valid_0's auc: 0.92691	valid_0's binary_logloss: 0.290504	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.315337
[76]	valid_0's auc: 0.927022	valid_0's binary_logloss: 0.290284	valid_1's auc: 0.90854	valid_1's binary_logloss: 0.315519
[77]	valid_0's auc: 0.927277	valid_0's binary_logloss: 0.289798	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.315637
[78]	valid_0's auc: 0.927536	valid_0's binary_logloss: 0.289357	valid_1's auc: 0.908396	valid_1's binary_logloss: 0.315793
[79]	valid_0's auc: 0.927812	valid_0's binary_logloss: 0.288851	valid_1's auc: 0.908282	valid_1's binary_logloss: 0.316022
[80]	valid_0's auc: 0.928044	valid_0's binary_logloss: 0.28844	valid_1's auc: 0.908214	valid_1's binary_logloss: 0.316115
[81]	valid_0's auc: 0.928205	valid_0's binary_logloss: 0.288111	valid_1's auc: 0.908118	valid_1's binary_logloss: 0.316254
[82]	valid_0's auc: 0.928396	valid_0's binary_logloss: 0.287727	valid_1's auc: 0.90802	valid_1's binary_logloss: 0.316449
[83]	valid_0's auc: 0.928605	valid_0's binary_logloss: 0.287366	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.316466
[84]	valid_0's auc: 0.928839	valid_0's binary_logloss: 0.286971	valid_1's auc: 0.907933	valid_1's binary_logloss: 0.31662
[85]	valid_0's auc: 0.928915	valid_0's binary_logloss: 0.2868	valid_1's auc: 0.907916	valid_1's binary_logloss: 0.316654
[86]	valid_0's auc: 0.929181	valid_0's binary_logloss: 0.286319	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.316728
[87]	valid_0's auc: 0.929371	valid_0's binary_logloss: 0.285994	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.316765
[88]	valid_0's auc: 0.929502	valid_0's binary_logloss: 0.285761	valid_1's auc: 0.907916	valid_1's binary_logloss: 0.316743
[89]	valid_0's auc: 0.929659	valid_0's binary_logloss: 0.285429	valid_1's auc: 0.907961	valid_1's binary_logloss: 0.316672
[90]	valid_0's auc: 0.929931	valid_0's binary_logloss: 0.284982	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.316773
[91]	valid_0's auc: 0.93015	valid_0's binary_logloss: 0.2846	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.316769
[92]	valid_0's auc: 0.930368	valid_0's binary_logloss: 0.284197	valid_1's auc: 0.907787	valid_1's binary_logloss: 0.317005
[93]	valid_0's auc: 0.930583	valid_0's binary_logloss: 0.283829	valid_1's auc: 0.907746	valid_1's binary_logloss: 0.317083
[94]	valid_0's auc: 0.930804	valid_0's binary_logloss: 0.283453	valid_1's auc: 0.907833	valid_1's binary_logloss: 0.316959
[95]	valid_0's auc: 0.930997	valid_0's binary_logloss: 0.283092	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.31709
[96]	valid_0's auc: 0.931191	valid_0's binary_logloss: 0.282729	valid_1's auc: 0.907659	valid_1's binary_logloss: 0.317264
[97]	valid_0's auc: 0.931372	valid_0's binary_logloss: 0.282436	valid_1's auc: 0.907629	valid_1's binary_logloss: 0.317278
[98]	valid_0's auc: 0.931553	valid_0's binary_logloss: 0.282131	valid_1's auc: 0.907633	valid_1's binary_logloss: 0.317264
[99]	valid_0's auc: 0.931774	valid_0's binary_logloss: 0.281744	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.317429
[100]	valid_0's auc: 0.931904	valid_0's binary_logloss: 0.281482	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317349
[101]	valid_0's auc: 0.932084	valid_0's binary_logloss: 0.281156	valid_1's auc: 0.90758	valid_1's binary_logloss: 0.317376
[102]	valid_0's auc: 0.932305	valid_0's binary_logloss: 0.280757	valid_1's auc: 0.907474	valid_1's binary_logloss: 0.317591
[103]	valid_0's auc: 0.932607	valid_0's binary_logloss: 0.280266	valid_1's auc: 0.907353	valid_1's binary_logloss: 0.317736
[104]	valid_0's auc: 0.932796	valid_0's binary_logloss: 0.279974	valid_1's auc: 0.90731	valid_1's binary_logloss: 0.317816
[105]	valid_0's auc: 0.932951	valid_0's binary_logloss: 0.279695	valid_1's auc: 0.907265	valid_1's binary_logloss: 0.31795
[106]	valid_0's auc: 0.933104	valid_0's binary_logloss: 0.279431	valid_1's auc: 0.907172	valid_1's binary_logloss: 0.318088
[107]	valid_0's auc: 0.933257	valid_0's binary_logloss: 0.279174	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318058
[108]	valid_0's auc: 0.93343	valid_0's binary_logloss: 0.278857	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.318236
[109]	valid_0's auc: 0.933558	valid_0's binary_logloss: 0.278626	valid_1's auc: 0.907023	valid_1's binary_logloss: 0.318332
[110]	valid_0's auc: 0.933732	valid_0's binary_logloss: 0.278322	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318478
[111]	valid_0's auc: 0.933953	valid_0's binary_logloss: 0.277947	valid_1's auc: 0.906897	valid_1's binary_logloss: 0.318553
[112]	valid_0's auc: 0.934012	valid_0's binary_logloss: 0.277813	valid_1's auc: 0.906878	valid_1's binary_logloss: 0.318612
[113]	valid_0's auc: 0.934274	valid_0's binary_logloss: 0.27736	valid_1's auc: 0.906806	valid_1's binary_logloss: 0.318723
[114]	valid_0's auc: 0.934468	valid_0's binary_logloss: 0.277018	valid_1's auc: 0.906638	valid_1's binary_logloss: 0.319016
[115]	valid_0's auc: 0.934638	valid_0's binary_logloss: 0.27676	valid_1's auc: 0.906613	valid_1's binary_logloss: 0.319048
[116]	valid_0's auc: 0.934859	valid_0's binary_logloss: 0.276382	valid_1's auc: 0.906575	valid_1's binary_logloss: 0.31909
[117]	valid_0's auc: 0.934925	valid_0's binary_logloss: 0.276253	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.319189
[118]	valid_0's auc: 0.935133	valid_0's binary_logloss: 0.275888	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.319235
[119]	valid_0's auc: 0.935308	valid_0's binary_logloss: 0.275562	valid_1's auc: 0.906449	valid_1's binary_logloss: 0.319398
[120]	valid_0's auc: 0.935468	valid_0's binary_logloss: 0.275277	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.31929
[121]	valid_0's auc: 0.935668	valid_0's binary_logloss: 0.274917	valid_1's auc: 0.906467	valid_1's binary_logloss: 0.31938
[122]	valid_0's auc: 0.935807	valid_0's binary_logloss: 0.274678	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.319463
[123]	valid_0's auc: 0.936005	valid_0's binary_logloss: 0.2743	valid_1's auc: 0.906462	valid_1's binary_logloss: 0.319443
[124]	valid_0's auc: 0.936173	valid_0's binary_logloss: 0.273982	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319597
[125]	valid_0's auc: 0.936376	valid_0's binary_logloss: 0.273627	valid_1's auc: 0.906473	valid_1's binary_logloss: 0.319552
[126]	valid_0's auc: 0.936551	valid_0's binary_logloss: 0.273322	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.319885
[127]	valid_0's auc: 0.936745	valid_0's binary_logloss: 0.272991	valid_1's auc: 0.906121	valid_1's binary_logloss: 0.32011
[128]	valid_0's auc: 0.93691	valid_0's binary_logloss: 0.272682	valid_1's auc: 0.906086	valid_1's binary_logloss: 0.320223
[129]	valid_0's auc: 0.937074	valid_0's binary_logloss: 0.272395	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.320087
[130]	valid_0's auc: 0.937206	valid_0's binary_logloss: 0.272148	valid_1's auc: 0.906151	valid_1's binary_logloss: 0.32007
[131]	valid_0's auc: 0.93742	valid_0's binary_logloss: 0.271797	valid_1's auc: 0.906127	valid_1's binary_logloss: 0.320121
[132]	valid_0's auc: 0.937542	valid_0's binary_logloss: 0.271551	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.320187
[133]	valid_0's auc: 0.9377	valid_0's binary_logloss: 0.271277	valid_1's auc: 0.90604	valid_1's binary_logloss: 0.320381
[134]	valid_0's auc: 0.937735	valid_0's binary_logloss: 0.271221	valid_1's auc: 0.90598	valid_1's binary_logloss: 0.320479
[135]	valid_0's auc: 0.937769	valid_0's binary_logloss: 0.271166	valid_1's auc: 0.905914	valid_1's binary_logloss: 0.320599
[136]	valid_0's auc: 0.937933	valid_0's binary_logloss: 0.270894	valid_1's auc: 0.905932	valid_1's binary_logloss: 0.320674
[137]	valid_0's auc: 0.938118	valid_0's binary_logloss: 0.270562	valid_1's auc: 0.905833	valid_1's binary_logloss: 0.320836
[138]	valid_0's auc: 0.938331	valid_0's binary_logloss: 0.270171	valid_1's auc: 0.905794	valid_1's binary_logloss: 0.320872
[139]	valid_0's auc: 0.938497	valid_0's binary_logloss: 0.269823	valid_1's auc: 0.905847	valid_1's binary_logloss: 0.320815
[140]	valid_0's auc: 0.938624	valid_0's binary_logloss: 0.269606	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320907
[141]	valid_0's auc: 0.938678	valid_0's binary_logloss: 0.269487	valid_1's auc: 0.905873	valid_1's binary_logloss: 0.320891
Early stopping, best iteration is:
[41]	valid_0's auc: 0.917162	valid_0's binary_logloss: 0.308604	valid_1's auc: 0.909639	valid_1's binary_logloss: 0.3149
[1]	valid_0's auc: 0.886809	valid_0's binary_logloss: 0.517145	valid_1's auc: 0.89313	valid_1's binary_logloss: 0.508294
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89216	valid_0's binary_logloss: 0.488453	valid_1's auc: 0.898763	valid_1's binary_logloss: 0.478697
[3]	valid_0's auc: 0.893142	valid_0's binary_logloss: 0.465421	valid_1's auc: 0.900417	valid_1's binary_logloss: 0.455027
[4]	valid_0's auc: 0.894664	valid_0's binary_logloss: 0.446357	valid_1's auc: 0.90081	valid_1's binary_logloss: 0.435946
[5]	valid_0's auc: 0.896153	valid_0's binary_logloss: 0.430079	valid_1's auc: 0.901764	valid_1's binary_logloss: 0.419975
[6]	valid_0's auc: 0.897206	valid_0's binary_logloss: 0.416532	valid_1's auc: 0.902251	valid_1's binary_logloss: 0.40638
[7]	valid_0's auc: 0.898567	valid_0's binary_logloss: 0.404826	valid_1's auc: 0.903033	valid_1's binary_logloss: 0.394778
[8]	valid_0's auc: 0.899448	valid_0's binary_logloss: 0.394776	valid_1's auc: 0.903927	valid_1's binary_logloss: 0.384847
[9]	valid_0's auc: 0.900088	valid_0's binary_logloss: 0.386104	valid_1's auc: 0.904161	valid_1's binary_logloss: 0.37639
[10]	valid_0's auc: 0.901027	valid_0's binary_logloss: 0.378192	valid_1's auc: 0.904446	valid_1's binary_logloss: 0.369001
[11]	valid_0's auc: 0.901764	valid_0's binary_logloss: 0.371436	valid_1's auc: 0.904953	valid_1's binary_logloss: 0.362451
[12]	valid_0's auc: 0.902489	valid_0's binary_logloss: 0.365439	valid_1's auc: 0.904959	valid_1's binary_logloss: 0.357082
[13]	valid_0's auc: 0.903502	valid_0's binary_logloss: 0.360046	valid_1's auc: 0.905536	valid_1's binary_logloss: 0.352049
[14]	valid_0's auc: 0.904396	valid_0's binary_logloss: 0.355398	valid_1's auc: 0.905823	valid_1's binary_logloss: 0.34774
[15]	valid_0's auc: 0.904934	valid_0's binary_logloss: 0.351206	valid_1's auc: 0.906022	valid_1's binary_logloss: 0.344043
[16]	valid_0's auc: 0.905569	valid_0's binary_logloss: 0.347535	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.340724
[17]	valid_0's auc: 0.906055	valid_0's binary_logloss: 0.344217	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.337671
[18]	valid_0's auc: 0.906551	valid_0's binary_logloss: 0.341209	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.334811
[19]	valid_0's auc: 0.907641	valid_0's binary_logloss: 0.338006	valid_1's auc: 0.907893	valid_1's binary_logloss: 0.332332
[20]	valid_0's auc: 0.90819	valid_0's binary_logloss: 0.335486	valid_1's auc: 0.908373	valid_1's binary_logloss: 0.329934
[21]	valid_0's auc: 0.908964	valid_0's binary_logloss: 0.332971	valid_1's auc: 0.90855	valid_1's binary_logloss: 0.32818
[22]	valid_0's auc: 0.909547	valid_0's binary_logloss: 0.330718	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.326522
[23]	valid_0's auc: 0.910058	valid_0's binary_logloss: 0.328697	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.325272
[24]	valid_0's auc: 0.910606	valid_0's binary_logloss: 0.326753	valid_1's auc: 0.908869	valid_1's binary_logloss: 0.323869
[25]	valid_0's auc: 0.911109	valid_0's binary_logloss: 0.324964	valid_1's auc: 0.909069	valid_1's binary_logloss: 0.322625
[26]	valid_0's auc: 0.911732	valid_0's binary_logloss: 0.323322	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.321654
[27]	valid_0's auc: 0.912288	valid_0's binary_logloss: 0.321716	valid_1's auc: 0.909162	valid_1's binary_logloss: 0.321004
[28]	valid_0's auc: 0.912703	valid_0's binary_logloss: 0.320322	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.320072
[29]	valid_0's auc: 0.913164	valid_0's binary_logloss: 0.318981	valid_1's auc: 0.90934	valid_1's binary_logloss: 0.319466
[30]	valid_0's auc: 0.913641	valid_0's binary_logloss: 0.317667	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.318834
[31]	valid_0's auc: 0.914029	valid_0's binary_logloss: 0.316637	valid_1's auc: 0.909567	valid_1's binary_logloss: 0.318209
[32]	valid_0's auc: 0.914472	valid_0's binary_logloss: 0.31551	valid_1's auc: 0.909657	valid_1's binary_logloss: 0.317686
[33]	valid_0's auc: 0.914852	valid_0's binary_logloss: 0.314576	valid_1's auc: 0.909778	valid_1's binary_logloss: 0.317205
[34]	valid_0's auc: 0.915237	valid_0's binary_logloss: 0.31355	valid_1's auc: 0.909801	valid_1's binary_logloss: 0.316731
[35]	valid_0's auc: 0.915653	valid_0's binary_logloss: 0.312657	valid_1's auc: 0.909855	valid_1's binary_logloss: 0.316376
[36]	valid_0's auc: 0.915976	valid_0's binary_logloss: 0.311797	valid_1's auc: 0.90981	valid_1's binary_logloss: 0.316174
[37]	valid_0's auc: 0.916279	valid_0's binary_logloss: 0.311071	valid_1's auc: 0.909893	valid_1's binary_logloss: 0.315847
[38]	valid_0's auc: 0.916637	valid_0's binary_logloss: 0.310222	valid_1's auc: 0.909867	valid_1's binary_logloss: 0.315592
[39]	valid_0's auc: 0.917042	valid_0's binary_logloss: 0.309337	valid_1's auc: 0.909799	valid_1's binary_logloss: 0.315496
[40]	valid_0's auc: 0.917355	valid_0's binary_logloss: 0.308607	valid_1's auc: 0.909819	valid_1's binary_logloss: 0.315243
[41]	valid_0's auc: 0.917701	valid_0's binary_logloss: 0.307828	valid_1's auc: 0.909946	valid_1's binary_logloss: 0.314876
[42]	valid_0's auc: 0.91791	valid_0's binary_logloss: 0.307312	valid_1's auc: 0.909868	valid_1's binary_logloss: 0.314873
[43]	valid_0's auc: 0.918213	valid_0's binary_logloss: 0.306626	valid_1's auc: 0.909911	valid_1's binary_logloss: 0.314674
[44]	valid_0's auc: 0.918685	valid_0's binary_logloss: 0.305763	valid_1's auc: 0.910019	valid_1's binary_logloss: 0.314403
[45]	valid_0's auc: 0.919016	valid_0's binary_logloss: 0.305061	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.314482
[46]	valid_0's auc: 0.919317	valid_0's binary_logloss: 0.304415	valid_1's auc: 0.90993	valid_1's binary_logloss: 0.314315
[47]	valid_0's auc: 0.919643	valid_0's binary_logloss: 0.303774	valid_1's auc: 0.91001	valid_1's binary_logloss: 0.314116
[48]	valid_0's auc: 0.919876	valid_0's binary_logloss: 0.303313	valid_1's auc: 0.910168	valid_1's binary_logloss: 0.313836
[49]	valid_0's auc: 0.920177	valid_0's binary_logloss: 0.302649	valid_1's auc: 0.91025	valid_1's binary_logloss: 0.3136
[50]	valid_0's auc: 0.920349	valid_0's binary_logloss: 0.302246	valid_1's auc: 0.910222	valid_1's binary_logloss: 0.313564
[51]	valid_0's auc: 0.920706	valid_0's binary_logloss: 0.301598	valid_1's auc: 0.910294	valid_1's binary_logloss: 0.313402
[52]	valid_0's auc: 0.920921	valid_0's binary_logloss: 0.301137	valid_1's auc: 0.910263	valid_1's binary_logloss: 0.31342
[53]	valid_0's auc: 0.921298	valid_0's binary_logloss: 0.300471	valid_1's auc: 0.910231	valid_1's binary_logloss: 0.313349
[54]	valid_0's auc: 0.921585	valid_0's binary_logloss: 0.299963	valid_1's auc: 0.910234	valid_1's binary_logloss: 0.313302
[55]	valid_0's auc: 0.921697	valid_0's binary_logloss: 0.299732	valid_1's auc: 0.910245	valid_1's binary_logloss: 0.313266
[56]	valid_0's auc: 0.922057	valid_0's binary_logloss: 0.299048	valid_1's auc: 0.91021	valid_1's binary_logloss: 0.313286
[57]	valid_0's auc: 0.922272	valid_0's binary_logloss: 0.298589	valid_1's auc: 0.910227	valid_1's binary_logloss: 0.313215
[58]	valid_0's auc: 0.922627	valid_0's binary_logloss: 0.297913	valid_1's auc: 0.910163	valid_1's binary_logloss: 0.31331
[59]	valid_0's auc: 0.922844	valid_0's binary_logloss: 0.297475	valid_1's auc: 0.910196	valid_1's binary_logloss: 0.313274
[60]	valid_0's auc: 0.923142	valid_0's binary_logloss: 0.296931	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.313461
[61]	valid_0's auc: 0.923408	valid_0's binary_logloss: 0.29645	valid_1's auc: 0.909899	valid_1's binary_logloss: 0.313659
[62]	valid_0's auc: 0.923753	valid_0's binary_logloss: 0.295876	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.313769
[63]	valid_0's auc: 0.923918	valid_0's binary_logloss: 0.295573	valid_1's auc: 0.909839	valid_1's binary_logloss: 0.313806
[64]	valid_0's auc: 0.924058	valid_0's binary_logloss: 0.295292	valid_1's auc: 0.909802	valid_1's binary_logloss: 0.313854
[65]	valid_0's auc: 0.924295	valid_0's binary_logloss: 0.294827	valid_1's auc: 0.909754	valid_1's binary_logloss: 0.31389
[66]	valid_0's auc: 0.924591	valid_0's binary_logloss: 0.294336	valid_1's auc: 0.909557	valid_1's binary_logloss: 0.314177
[67]	valid_0's auc: 0.924695	valid_0's binary_logloss: 0.294118	valid_1's auc: 0.909637	valid_1's binary_logloss: 0.314063
[68]	valid_0's auc: 0.92506	valid_0's binary_logloss: 0.293509	valid_1's auc: 0.90968	valid_1's binary_logloss: 0.314033
[69]	valid_0's auc: 0.925381	valid_0's binary_logloss: 0.292937	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.314218
[70]	valid_0's auc: 0.925704	valid_0's binary_logloss: 0.292351	valid_1's auc: 0.909505	valid_1's binary_logloss: 0.314355
[71]	valid_0's auc: 0.926066	valid_0's binary_logloss: 0.291815	valid_1's auc: 0.909454	valid_1's binary_logloss: 0.314434
[72]	valid_0's auc: 0.926392	valid_0's binary_logloss: 0.291233	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.314452
[73]	valid_0's auc: 0.926687	valid_0's binary_logloss: 0.290731	valid_1's auc: 0.909389	valid_1's binary_logloss: 0.314558
[74]	valid_0's auc: 0.926863	valid_0's binary_logloss: 0.290417	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.314633
[75]	valid_0's auc: 0.927058	valid_0's binary_logloss: 0.290045	valid_1's auc: 0.909244	valid_1's binary_logloss: 0.314776
[76]	valid_0's auc: 0.927263	valid_0's binary_logloss: 0.289688	valid_1's auc: 0.909167	valid_1's binary_logloss: 0.314921
[77]	valid_0's auc: 0.927689	valid_0's binary_logloss: 0.288981	valid_1's auc: 0.909179	valid_1's binary_logloss: 0.314832
[78]	valid_0's auc: 0.927919	valid_0's binary_logloss: 0.288578	valid_1's auc: 0.909109	valid_1's binary_logloss: 0.314948
[79]	valid_0's auc: 0.928059	valid_0's binary_logloss: 0.288347	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.315034
[80]	valid_0's auc: 0.928365	valid_0's binary_logloss: 0.287803	valid_1's auc: 0.909176	valid_1's binary_logloss: 0.314929
[81]	valid_0's auc: 0.928568	valid_0's binary_logloss: 0.287417	valid_1's auc: 0.909032	valid_1's binary_logloss: 0.315136
[82]	valid_0's auc: 0.92872	valid_0's binary_logloss: 0.28717	valid_1's auc: 0.909108	valid_1's binary_logloss: 0.315059
[83]	valid_0's auc: 0.92888	valid_0's binary_logloss: 0.286886	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.31514
[84]	valid_0's auc: 0.929183	valid_0's binary_logloss: 0.286369	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.315224
[85]	valid_0's auc: 0.929482	valid_0's binary_logloss: 0.285895	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.315277
[86]	valid_0's auc: 0.929739	valid_0's binary_logloss: 0.285461	valid_1's auc: 0.90904	valid_1's binary_logloss: 0.315297
[87]	valid_0's auc: 0.929925	valid_0's binary_logloss: 0.285139	valid_1's auc: 0.908926	valid_1's binary_logloss: 0.315499
[88]	valid_0's auc: 0.930169	valid_0's binary_logloss: 0.2847	valid_1's auc: 0.908899	valid_1's binary_logloss: 0.315544
[89]	valid_0's auc: 0.930365	valid_0's binary_logloss: 0.284347	valid_1's auc: 0.908884	valid_1's binary_logloss: 0.315591
[90]	valid_0's auc: 0.930587	valid_0's binary_logloss: 0.283946	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.315658
[91]	valid_0's auc: 0.93075	valid_0's binary_logloss: 0.283696	valid_1's auc: 0.908728	valid_1's binary_logloss: 0.315867
[92]	valid_0's auc: 0.930981	valid_0's binary_logloss: 0.283342	valid_1's auc: 0.908746	valid_1's binary_logloss: 0.315862
[93]	valid_0's auc: 0.931177	valid_0's binary_logloss: 0.28298	valid_1's auc: 0.908636	valid_1's binary_logloss: 0.316031
[94]	valid_0's auc: 0.93136	valid_0's binary_logloss: 0.282631	valid_1's auc: 0.908576	valid_1's binary_logloss: 0.316121
[95]	valid_0's auc: 0.931666	valid_0's binary_logloss: 0.28212	valid_1's auc: 0.908527	valid_1's binary_logloss: 0.316188
[96]	valid_0's auc: 0.931787	valid_0's binary_logloss: 0.281858	valid_1's auc: 0.908518	valid_1's binary_logloss: 0.316223
[97]	valid_0's auc: 0.931907	valid_0's binary_logloss: 0.281655	valid_1's auc: 0.908519	valid_1's binary_logloss: 0.316246
[98]	valid_0's auc: 0.9321	valid_0's binary_logloss: 0.281286	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.316424
[99]	valid_0's auc: 0.932193	valid_0's binary_logloss: 0.281118	valid_1's auc: 0.908408	valid_1's binary_logloss: 0.316464
[100]	valid_0's auc: 0.932369	valid_0's binary_logloss: 0.280841	valid_1's auc: 0.908268	valid_1's binary_logloss: 0.316661
[101]	valid_0's auc: 0.932661	valid_0's binary_logloss: 0.28034	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.316955
[102]	valid_0's auc: 0.932826	valid_0's binary_logloss: 0.280049	valid_1's auc: 0.908069	valid_1's binary_logloss: 0.317018
[103]	valid_0's auc: 0.933014	valid_0's binary_logloss: 0.279725	valid_1's auc: 0.908021	valid_1's binary_logloss: 0.317085
[104]	valid_0's auc: 0.933166	valid_0's binary_logloss: 0.279473	valid_1's auc: 0.907929	valid_1's binary_logloss: 0.317241
[105]	valid_0's auc: 0.933321	valid_0's binary_logloss: 0.279207	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.31726
[106]	valid_0's auc: 0.933581	valid_0's binary_logloss: 0.278748	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.317267
[107]	valid_0's auc: 0.933698	valid_0's binary_logloss: 0.278542	valid_1's auc: 0.90794	valid_1's binary_logloss: 0.317308
[108]	valid_0's auc: 0.933821	valid_0's binary_logloss: 0.278321	valid_1's auc: 0.907919	valid_1's binary_logloss: 0.317375
[109]	valid_0's auc: 0.933888	valid_0's binary_logloss: 0.27822	valid_1's auc: 0.907898	valid_1's binary_logloss: 0.317388
[110]	valid_0's auc: 0.934064	valid_0's binary_logloss: 0.277874	valid_1's auc: 0.907812	valid_1's binary_logloss: 0.317555
[111]	valid_0's auc: 0.934327	valid_0's binary_logloss: 0.277437	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.317713
[112]	valid_0's auc: 0.934544	valid_0's binary_logloss: 0.277065	valid_1's auc: 0.907635	valid_1's binary_logloss: 0.317884
[113]	valid_0's auc: 0.934611	valid_0's binary_logloss: 0.276948	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317942
[114]	valid_0's auc: 0.934754	valid_0's binary_logloss: 0.276625	valid_1's auc: 0.907642	valid_1's binary_logloss: 0.317983
[115]	valid_0's auc: 0.934975	valid_0's binary_logloss: 0.276261	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.318194
[116]	valid_0's auc: 0.935169	valid_0's binary_logloss: 0.275939	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.318353
[117]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.275729	valid_1's auc: 0.907339	valid_1's binary_logloss: 0.318545
[118]	valid_0's auc: 0.935438	valid_0's binary_logloss: 0.275487	valid_1's auc: 0.907353	valid_1's binary_logloss: 0.318587
[119]	valid_0's auc: 0.935658	valid_0's binary_logloss: 0.27512	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.318633
[120]	valid_0's auc: 0.935802	valid_0's binary_logloss: 0.274844	valid_1's auc: 0.907275	valid_1's binary_logloss: 0.318715
[121]	valid_0's auc: 0.936013	valid_0's binary_logloss: 0.274488	valid_1's auc: 0.907205	valid_1's binary_logloss: 0.318872
[122]	valid_0's auc: 0.936204	valid_0's binary_logloss: 0.274157	valid_1's auc: 0.907177	valid_1's binary_logloss: 0.318962
[123]	valid_0's auc: 0.936337	valid_0's binary_logloss: 0.273926	valid_1's auc: 0.907094	valid_1's binary_logloss: 0.319126
[124]	valid_0's auc: 0.936498	valid_0's binary_logloss: 0.273636	valid_1's auc: 0.907081	valid_1's binary_logloss: 0.319178
[125]	valid_0's auc: 0.936675	valid_0's binary_logloss: 0.273302	valid_1's auc: 0.906984	valid_1's binary_logloss: 0.319317
[126]	valid_0's auc: 0.936776	valid_0's binary_logloss: 0.273149	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.319331
[127]	valid_0's auc: 0.93689	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.319368
[128]	valid_0's auc: 0.937077	valid_0's binary_logloss: 0.272605	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.319397
[129]	valid_0's auc: 0.937324	valid_0's binary_logloss: 0.272162	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.319597
[130]	valid_0's auc: 0.93747	valid_0's binary_logloss: 0.271892	valid_1's auc: 0.90684	valid_1's binary_logloss: 0.319663
[131]	valid_0's auc: 0.937649	valid_0's binary_logloss: 0.271597	valid_1's auc: 0.90672	valid_1's binary_logloss: 0.319891
[132]	valid_0's auc: 0.937821	valid_0's binary_logloss: 0.271277	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.319871
[133]	valid_0's auc: 0.937978	valid_0's binary_logloss: 0.270996	valid_1's auc: 0.906701	valid_1's binary_logloss: 0.319963
[134]	valid_0's auc: 0.938099	valid_0's binary_logloss: 0.270759	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.319974
[135]	valid_0's auc: 0.938254	valid_0's binary_logloss: 0.270458	valid_1's auc: 0.906758	valid_1's binary_logloss: 0.319938
[136]	valid_0's auc: 0.938492	valid_0's binary_logloss: 0.270064	valid_1's auc: 0.906781	valid_1's binary_logloss: 0.319962
[137]	valid_0's auc: 0.938675	valid_0's binary_logloss: 0.269735	valid_1's auc: 0.906837	valid_1's binary_logloss: 0.319855
[138]	valid_0's auc: 0.938811	valid_0's binary_logloss: 0.269492	valid_1's auc: 0.906887	valid_1's binary_logloss: 0.319759
[139]	valid_0's auc: 0.939007	valid_0's binary_logloss: 0.269148	valid_1's auc: 0.906784	valid_1's binary_logloss: 0.319974
[140]	valid_0's auc: 0.939196	valid_0's binary_logloss: 0.268795	valid_1's auc: 0.906671	valid_1's binary_logloss: 0.320188
[141]	valid_0's auc: 0.939263	valid_0's binary_logloss: 0.268669	valid_1's auc: 0.906668	valid_1's binary_logloss: 0.320225
[142]	valid_0's auc: 0.939523	valid_0's binary_logloss: 0.268238	valid_1's auc: 0.906601	valid_1's binary_logloss: 0.320365
[143]	valid_0's auc: 0.939667	valid_0's binary_logloss: 0.267985	valid_1's auc: 0.906498	valid_1's binary_logloss: 0.320565
[144]	valid_0's auc: 0.93981	valid_0's binary_logloss: 0.267715	valid_1's auc: 0.906369	valid_1's binary_logloss: 0.32077
[145]	valid_0's auc: 0.939975	valid_0's binary_logloss: 0.267408	valid_1's auc: 0.906251	valid_1's binary_logloss: 0.320988
[146]	valid_0's auc: 0.940066	valid_0's binary_logloss: 0.267248	valid_1's auc: 0.906272	valid_1's binary_logloss: 0.320964
[147]	valid_0's auc: 0.940152	valid_0's binary_logloss: 0.26711	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.320942
[148]	valid_0's auc: 0.940358	valid_0's binary_logloss: 0.266717	valid_1's auc: 0.906162	valid_1's binary_logloss: 0.321257
[149]	valid_0's auc: 0.940566	valid_0's binary_logloss: 0.266371	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321599
[150]	valid_0's auc: 0.940659	valid_0's binary_logloss: 0.266164	valid_1's auc: 0.905894	valid_1's binary_logloss: 0.321786
[151]	valid_0's auc: 0.94085	valid_0's binary_logloss: 0.265815	valid_1's auc: 0.905868	valid_1's binary_logloss: 0.321815
Early stopping, best iteration is:
[51]	valid_0's auc: 0.920706	valid_0's binary_logloss: 0.301598	valid_1's auc: 0.910294	valid_1's binary_logloss: 0.313402
[1]	valid_0's auc: 0.886366	valid_0's binary_logloss: 0.517423	valid_1's auc: 0.892799	valid_1's binary_logloss: 0.508777
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.888759	valid_0's binary_logloss: 0.488556	valid_1's auc: 0.895152	valid_1's binary_logloss: 0.479361
[3]	valid_0's auc: 0.892643	valid_0's binary_logloss: 0.465454	valid_1's auc: 0.896898	valid_1's binary_logloss: 0.456014
[4]	valid_0's auc: 0.895125	valid_0's binary_logloss: 0.446087	valid_1's auc: 0.898809	valid_1's binary_logloss: 0.436623
[5]	valid_0's auc: 0.896757	valid_0's binary_logloss: 0.429967	valid_1's auc: 0.900346	valid_1's binary_logloss: 0.420554
[6]	valid_0's auc: 0.897595	valid_0's binary_logloss: 0.416415	valid_1's auc: 0.90118	valid_1's binary_logloss: 0.406888
[7]	valid_0's auc: 0.898389	valid_0's binary_logloss: 0.404783	valid_1's auc: 0.902115	valid_1's binary_logloss: 0.395137
[8]	valid_0's auc: 0.899254	valid_0's binary_logloss: 0.39474	valid_1's auc: 0.90328	valid_1's binary_logloss: 0.384959
[9]	valid_0's auc: 0.900112	valid_0's binary_logloss: 0.386002	valid_1's auc: 0.903808	valid_1's binary_logloss: 0.376579
[10]	valid_0's auc: 0.900897	valid_0's binary_logloss: 0.378409	valid_1's auc: 0.903466	valid_1's binary_logloss: 0.36976
[11]	valid_0's auc: 0.901567	valid_0's binary_logloss: 0.371769	valid_1's auc: 0.903577	valid_1's binary_logloss: 0.363767
[12]	valid_0's auc: 0.90237	valid_0's binary_logloss: 0.365834	valid_1's auc: 0.903726	valid_1's binary_logloss: 0.358346
[13]	valid_0's auc: 0.903362	valid_0's binary_logloss: 0.360672	valid_1's auc: 0.90434	valid_1's binary_logloss: 0.353454
[14]	valid_0's auc: 0.904131	valid_0's binary_logloss: 0.355963	valid_1's auc: 0.904464	valid_1's binary_logloss: 0.349327
[15]	valid_0's auc: 0.904883	valid_0's binary_logloss: 0.351582	valid_1's auc: 0.904861	valid_1's binary_logloss: 0.345397
[16]	valid_0's auc: 0.905702	valid_0's binary_logloss: 0.34777	valid_1's auc: 0.905292	valid_1's binary_logloss: 0.342089
[17]	valid_0's auc: 0.906274	valid_0's binary_logloss: 0.34436	valid_1's auc: 0.905994	valid_1's binary_logloss: 0.339027
[18]	valid_0's auc: 0.906857	valid_0's binary_logloss: 0.341298	valid_1's auc: 0.906403	valid_1's binary_logloss: 0.336268
[19]	valid_0's auc: 0.907659	valid_0's binary_logloss: 0.338307	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.334276
[20]	valid_0's auc: 0.908416	valid_0's binary_logloss: 0.33563	valid_1's auc: 0.906586	valid_1's binary_logloss: 0.332392
[21]	valid_0's auc: 0.909067	valid_0's binary_logloss: 0.33313	valid_1's auc: 0.906681	valid_1's binary_logloss: 0.330627
[22]	valid_0's auc: 0.909696	valid_0's binary_logloss: 0.330901	valid_1's auc: 0.906783	valid_1's binary_logloss: 0.329174
[23]	valid_0's auc: 0.910208	valid_0's binary_logloss: 0.328885	valid_1's auc: 0.906922	valid_1's binary_logloss: 0.327663
[24]	valid_0's auc: 0.910854	valid_0's binary_logloss: 0.326932	valid_1's auc: 0.906875	valid_1's binary_logloss: 0.326583
[25]	valid_0's auc: 0.911462	valid_0's binary_logloss: 0.325177	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.325404
[26]	valid_0's auc: 0.911941	valid_0's binary_logloss: 0.323554	valid_1's auc: 0.907173	valid_1's binary_logloss: 0.324396
[27]	valid_0's auc: 0.912441	valid_0's binary_logloss: 0.322019	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.32328
[28]	valid_0's auc: 0.912892	valid_0's binary_logloss: 0.320592	valid_1's auc: 0.907588	valid_1's binary_logloss: 0.32251
[29]	valid_0's auc: 0.913249	valid_0's binary_logloss: 0.319368	valid_1's auc: 0.907691	valid_1's binary_logloss: 0.321745
[30]	valid_0's auc: 0.913691	valid_0's binary_logloss: 0.318139	valid_1's auc: 0.907786	valid_1's binary_logloss: 0.321144
[31]	valid_0's auc: 0.914103	valid_0's binary_logloss: 0.317021	valid_1's auc: 0.907843	valid_1's binary_logloss: 0.320645
[32]	valid_0's auc: 0.914525	valid_0's binary_logloss: 0.315901	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.320157
[33]	valid_0's auc: 0.91497	valid_0's binary_logloss: 0.314792	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.31978
[34]	valid_0's auc: 0.915343	valid_0's binary_logloss: 0.313791	valid_1's auc: 0.907981	valid_1's binary_logloss: 0.319378
[35]	valid_0's auc: 0.915854	valid_0's binary_logloss: 0.312648	valid_1's auc: 0.908065	valid_1's binary_logloss: 0.318974
[36]	valid_0's auc: 0.916195	valid_0's binary_logloss: 0.311759	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.318688
[37]	valid_0's auc: 0.916517	valid_0's binary_logloss: 0.310935	valid_1's auc: 0.908101	valid_1's binary_logloss: 0.318433
[38]	valid_0's auc: 0.916955	valid_0's binary_logloss: 0.310028	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.318329
[39]	valid_0's auc: 0.91725	valid_0's binary_logloss: 0.309359	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.318062
[40]	valid_0's auc: 0.917563	valid_0's binary_logloss: 0.308638	valid_1's auc: 0.908172	valid_1's binary_logloss: 0.317796
[41]	valid_0's auc: 0.917898	valid_0's binary_logloss: 0.307912	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.31778
[42]	valid_0's auc: 0.918183	valid_0's binary_logloss: 0.307214	valid_1's auc: 0.908204	valid_1's binary_logloss: 0.31746
[43]	valid_0's auc: 0.91853	valid_0's binary_logloss: 0.306483	valid_1's auc: 0.908167	valid_1's binary_logloss: 0.317323
[44]	valid_0's auc: 0.918753	valid_0's binary_logloss: 0.30599	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.31725
[45]	valid_0's auc: 0.919127	valid_0's binary_logloss: 0.305242	valid_1's auc: 0.908236	valid_1's binary_logloss: 0.31705
[46]	valid_0's auc: 0.919499	valid_0's binary_logloss: 0.304477	valid_1's auc: 0.90824	valid_1's binary_logloss: 0.316967
[47]	valid_0's auc: 0.919805	valid_0's binary_logloss: 0.30392	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316871
[48]	valid_0's auc: 0.920216	valid_0's binary_logloss: 0.303115	valid_1's auc: 0.908303	valid_1's binary_logloss: 0.316766
[49]	valid_0's auc: 0.920547	valid_0's binary_logloss: 0.302456	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316621
[50]	valid_0's auc: 0.920997	valid_0's binary_logloss: 0.301643	valid_1's auc: 0.908315	valid_1's binary_logloss: 0.316526
[51]	valid_0's auc: 0.921225	valid_0's binary_logloss: 0.301202	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.316648
[52]	valid_0's auc: 0.921509	valid_0's binary_logloss: 0.300592	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.31681
[53]	valid_0's auc: 0.921739	valid_0's binary_logloss: 0.300107	valid_1's auc: 0.907957	valid_1's binary_logloss: 0.316874
[54]	valid_0's auc: 0.922008	valid_0's binary_logloss: 0.29959	valid_1's auc: 0.907976	valid_1's binary_logloss: 0.316796
[55]	valid_0's auc: 0.922297	valid_0's binary_logloss: 0.299045	valid_1's auc: 0.907953	valid_1's binary_logloss: 0.3168
[56]	valid_0's auc: 0.92252	valid_0's binary_logloss: 0.298633	valid_1's auc: 0.907853	valid_1's binary_logloss: 0.31694
[57]	valid_0's auc: 0.922752	valid_0's binary_logloss: 0.298204	valid_1's auc: 0.907623	valid_1's binary_logloss: 0.317225
[58]	valid_0's auc: 0.922979	valid_0's binary_logloss: 0.297733	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317057
[59]	valid_0's auc: 0.923122	valid_0's binary_logloss: 0.297462	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.317103
[60]	valid_0's auc: 0.923342	valid_0's binary_logloss: 0.297069	valid_1's auc: 0.907652	valid_1's binary_logloss: 0.317152
[61]	valid_0's auc: 0.923574	valid_0's binary_logloss: 0.296649	valid_1's auc: 0.907696	valid_1's binary_logloss: 0.31704
[62]	valid_0's auc: 0.923958	valid_0's binary_logloss: 0.296068	valid_1's auc: 0.907619	valid_1's binary_logloss: 0.317148
[63]	valid_0's auc: 0.924116	valid_0's binary_logloss: 0.295744	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.317086
[64]	valid_0's auc: 0.924297	valid_0's binary_logloss: 0.29538	valid_1's auc: 0.907596	valid_1's binary_logloss: 0.317207
[65]	valid_0's auc: 0.924734	valid_0's binary_logloss: 0.294622	valid_1's auc: 0.907576	valid_1's binary_logloss: 0.317288
[66]	valid_0's auc: 0.925002	valid_0's binary_logloss: 0.294135	valid_1's auc: 0.907608	valid_1's binary_logloss: 0.317294
[67]	valid_0's auc: 0.925092	valid_0's binary_logloss: 0.293939	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.317429
[68]	valid_0's auc: 0.925416	valid_0's binary_logloss: 0.2934	valid_1's auc: 0.907464	valid_1's binary_logloss: 0.317472
[69]	valid_0's auc: 0.925541	valid_0's binary_logloss: 0.293154	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.317534
[70]	valid_0's auc: 0.925768	valid_0's binary_logloss: 0.292749	valid_1's auc: 0.907396	valid_1's binary_logloss: 0.317547
[71]	valid_0's auc: 0.926107	valid_0's binary_logloss: 0.292137	valid_1's auc: 0.907567	valid_1's binary_logloss: 0.31729
[72]	valid_0's auc: 0.92625	valid_0's binary_logloss: 0.291864	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.317276
[73]	valid_0's auc: 0.926569	valid_0's binary_logloss: 0.291314	valid_1's auc: 0.907559	valid_1's binary_logloss: 0.317353
[74]	valid_0's auc: 0.926792	valid_0's binary_logloss: 0.290926	valid_1's auc: 0.907439	valid_1's binary_logloss: 0.317581
[75]	valid_0's auc: 0.927024	valid_0's binary_logloss: 0.290456	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.317735
[76]	valid_0's auc: 0.927335	valid_0's binary_logloss: 0.289885	valid_1's auc: 0.9073	valid_1's binary_logloss: 0.317856
[77]	valid_0's auc: 0.927694	valid_0's binary_logloss: 0.289303	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.317909
[78]	valid_0's auc: 0.927793	valid_0's binary_logloss: 0.289109	valid_1's auc: 0.907301	valid_1's binary_logloss: 0.317898
[79]	valid_0's auc: 0.927935	valid_0's binary_logloss: 0.288796	valid_1's auc: 0.907202	valid_1's binary_logloss: 0.318065
[80]	valid_0's auc: 0.928178	valid_0's binary_logloss: 0.288342	valid_1's auc: 0.90704	valid_1's binary_logloss: 0.318338
[81]	valid_0's auc: 0.928345	valid_0's binary_logloss: 0.288069	valid_1's auc: 0.906983	valid_1's binary_logloss: 0.31846
[82]	valid_0's auc: 0.928521	valid_0's binary_logloss: 0.287765	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318496
[83]	valid_0's auc: 0.92863	valid_0's binary_logloss: 0.287568	valid_1's auc: 0.906936	valid_1's binary_logloss: 0.318539
[84]	valid_0's auc: 0.928904	valid_0's binary_logloss: 0.287083	valid_1's auc: 0.906931	valid_1's binary_logloss: 0.318601
[85]	valid_0's auc: 0.929163	valid_0's binary_logloss: 0.286607	valid_1's auc: 0.90688	valid_1's binary_logloss: 0.318667
[86]	valid_0's auc: 0.92939	valid_0's binary_logloss: 0.286236	valid_1's auc: 0.906897	valid_1's binary_logloss: 0.318704
[87]	valid_0's auc: 0.92963	valid_0's binary_logloss: 0.285798	valid_1's auc: 0.906864	valid_1's binary_logloss: 0.318823
[88]	valid_0's auc: 0.929929	valid_0's binary_logloss: 0.285278	valid_1's auc: 0.906767	valid_1's binary_logloss: 0.318992
[89]	valid_0's auc: 0.930176	valid_0's binary_logloss: 0.284858	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319028
[90]	valid_0's auc: 0.93037	valid_0's binary_logloss: 0.284508	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319154
[91]	valid_0's auc: 0.930645	valid_0's binary_logloss: 0.284006	valid_1's auc: 0.906702	valid_1's binary_logloss: 0.319049
[92]	valid_0's auc: 0.930797	valid_0's binary_logloss: 0.283757	valid_1's auc: 0.906653	valid_1's binary_logloss: 0.319186
[93]	valid_0's auc: 0.931018	valid_0's binary_logloss: 0.283359	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.319162
[94]	valid_0's auc: 0.931199	valid_0's binary_logloss: 0.283027	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319256
[95]	valid_0's auc: 0.9314	valid_0's binary_logloss: 0.282685	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319366
[96]	valid_0's auc: 0.931613	valid_0's binary_logloss: 0.282289	valid_1's auc: 0.906409	valid_1's binary_logloss: 0.319682
[97]	valid_0's auc: 0.931727	valid_0's binary_logloss: 0.282092	valid_1's auc: 0.906365	valid_1's binary_logloss: 0.319761
[98]	valid_0's auc: 0.93194	valid_0's binary_logloss: 0.28168	valid_1's auc: 0.906287	valid_1's binary_logloss: 0.319938
[99]	valid_0's auc: 0.932213	valid_0's binary_logloss: 0.281208	valid_1's auc: 0.906245	valid_1's binary_logloss: 0.320031
[100]	valid_0's auc: 0.932323	valid_0's binary_logloss: 0.281015	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.320026
[101]	valid_0's auc: 0.932581	valid_0's binary_logloss: 0.280575	valid_1's auc: 0.906104	valid_1's binary_logloss: 0.320294
[102]	valid_0's auc: 0.932664	valid_0's binary_logloss: 0.280422	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.320473
[103]	valid_0's auc: 0.932929	valid_0's binary_logloss: 0.279973	valid_1's auc: 0.905977	valid_1's binary_logloss: 0.32058
[104]	valid_0's auc: 0.933123	valid_0's binary_logloss: 0.279623	valid_1's auc: 0.905918	valid_1's binary_logloss: 0.320704
[105]	valid_0's auc: 0.933345	valid_0's binary_logloss: 0.279226	valid_1's auc: 0.905898	valid_1's binary_logloss: 0.320753
[106]	valid_0's auc: 0.933618	valid_0's binary_logloss: 0.278748	valid_1's auc: 0.905835	valid_1's binary_logloss: 0.320856
[107]	valid_0's auc: 0.93373	valid_0's binary_logloss: 0.278553	valid_1's auc: 0.905786	valid_1's binary_logloss: 0.32095
[108]	valid_0's auc: 0.933922	valid_0's binary_logloss: 0.278212	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.321101
[109]	valid_0's auc: 0.933991	valid_0's binary_logloss: 0.278067	valid_1's auc: 0.905709	valid_1's binary_logloss: 0.321143
[110]	valid_0's auc: 0.934211	valid_0's binary_logloss: 0.277688	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.321332
[111]	valid_0's auc: 0.934319	valid_0's binary_logloss: 0.277473	valid_1's auc: 0.905618	valid_1's binary_logloss: 0.321341
[112]	valid_0's auc: 0.934538	valid_0's binary_logloss: 0.277104	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.321335
[113]	valid_0's auc: 0.934718	valid_0's binary_logloss: 0.276752	valid_1's auc: 0.905715	valid_1's binary_logloss: 0.321205
[114]	valid_0's auc: 0.934842	valid_0's binary_logloss: 0.276546	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.321206
[115]	valid_0's auc: 0.934939	valid_0's binary_logloss: 0.276374	valid_1's auc: 0.905647	valid_1's binary_logloss: 0.321307
[116]	valid_0's auc: 0.935168	valid_0's binary_logloss: 0.275968	valid_1's auc: 0.905654	valid_1's binary_logloss: 0.321319
[117]	valid_0's auc: 0.935365	valid_0's binary_logloss: 0.275633	valid_1's auc: 0.905604	valid_1's binary_logloss: 0.321419
[118]	valid_0's auc: 0.935622	valid_0's binary_logloss: 0.275214	valid_1's auc: 0.905644	valid_1's binary_logloss: 0.32143
[119]	valid_0's auc: 0.935816	valid_0's binary_logloss: 0.274892	valid_1's auc: 0.905555	valid_1's binary_logloss: 0.321599
[120]	valid_0's auc: 0.936017	valid_0's binary_logloss: 0.27454	valid_1's auc: 0.905492	valid_1's binary_logloss: 0.321746
[121]	valid_0's auc: 0.936221	valid_0's binary_logloss: 0.27418	valid_1's auc: 0.905472	valid_1's binary_logloss: 0.321836
[122]	valid_0's auc: 0.936414	valid_0's binary_logloss: 0.273839	valid_1's auc: 0.905487	valid_1's binary_logloss: 0.321873
[123]	valid_0's auc: 0.936592	valid_0's binary_logloss: 0.273526	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.321754
[124]	valid_0's auc: 0.936783	valid_0's binary_logloss: 0.273151	valid_1's auc: 0.905504	valid_1's binary_logloss: 0.321932
[125]	valid_0's auc: 0.937001	valid_0's binary_logloss: 0.272769	valid_1's auc: 0.905399	valid_1's binary_logloss: 0.322148
[126]	valid_0's auc: 0.937181	valid_0's binary_logloss: 0.272461	valid_1's auc: 0.905368	valid_1's binary_logloss: 0.322182
[127]	valid_0's auc: 0.937255	valid_0's binary_logloss: 0.272326	valid_1's auc: 0.905317	valid_1's binary_logloss: 0.322276
[128]	valid_0's auc: 0.937347	valid_0's binary_logloss: 0.272143	valid_1's auc: 0.905181	valid_1's binary_logloss: 0.322531
[129]	valid_0's auc: 0.937562	valid_0's binary_logloss: 0.271738	valid_1's auc: 0.90501	valid_1's binary_logloss: 0.322899
[130]	valid_0's auc: 0.937816	valid_0's binary_logloss: 0.271295	valid_1's auc: 0.90503	valid_1's binary_logloss: 0.322912
[131]	valid_0's auc: 0.938005	valid_0's binary_logloss: 0.27095	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323006
[132]	valid_0's auc: 0.938193	valid_0's binary_logloss: 0.270604	valid_1's auc: 0.904878	valid_1's binary_logloss: 0.323233
[133]	valid_0's auc: 0.938399	valid_0's binary_logloss: 0.270237	valid_1's auc: 0.904824	valid_1's binary_logloss: 0.323395
[134]	valid_0's auc: 0.938547	valid_0's binary_logloss: 0.269957	valid_1's auc: 0.904761	valid_1's binary_logloss: 0.323515
[135]	valid_0's auc: 0.938752	valid_0's binary_logloss: 0.269578	valid_1's auc: 0.904766	valid_1's binary_logloss: 0.323557
[136]	valid_0's auc: 0.93897	valid_0's binary_logloss: 0.26919	valid_1's auc: 0.904837	valid_1's binary_logloss: 0.323527
[137]	valid_0's auc: 0.939156	valid_0's binary_logloss: 0.26889	valid_1's auc: 0.904658	valid_1's binary_logloss: 0.323821
[138]	valid_0's auc: 0.939319	valid_0's binary_logloss: 0.268631	valid_1's auc: 0.904651	valid_1's binary_logloss: 0.323812
[139]	valid_0's auc: 0.939391	valid_0's binary_logloss: 0.26849	valid_1's auc: 0.904626	valid_1's binary_logloss: 0.323872
[140]	valid_0's auc: 0.939569	valid_0's binary_logloss: 0.268168	valid_1's auc: 0.904566	valid_1's binary_logloss: 0.324057
[141]	valid_0's auc: 0.939699	valid_0's binary_logloss: 0.267926	valid_1's auc: 0.904499	valid_1's binary_logloss: 0.324206
[142]	valid_0's auc: 0.939832	valid_0's binary_logloss: 0.267691	valid_1's auc: 0.904503	valid_1's binary_logloss: 0.324252
[143]	valid_0's auc: 0.939924	valid_0's binary_logloss: 0.267531	valid_1's auc: 0.904464	valid_1's binary_logloss: 0.324357
[144]	valid_0's auc: 0.940063	valid_0's binary_logloss: 0.267275	valid_1's auc: 0.904379	valid_1's binary_logloss: 0.324532
[145]	valid_0's auc: 0.940192	valid_0's binary_logloss: 0.267036	valid_1's auc: 0.904377	valid_1's binary_logloss: 0.324658
[146]	valid_0's auc: 0.940267	valid_0's binary_logloss: 0.266867	valid_1's auc: 0.904366	valid_1's binary_logloss: 0.324713
[147]	valid_0's auc: 0.940447	valid_0's binary_logloss: 0.26657	valid_1's auc: 0.904312	valid_1's binary_logloss: 0.324756
[148]	valid_0's auc: 0.940676	valid_0's binary_logloss: 0.266153	valid_1's auc: 0.904287	valid_1's binary_logloss: 0.324812
[149]	valid_0's auc: 0.940703	valid_0's binary_logloss: 0.266099	valid_1's auc: 0.904324	valid_1's binary_logloss: 0.324771
Early stopping, best iteration is:
[49]	valid_0's auc: 0.920547	valid_0's binary_logloss: 0.302456	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316621
[1]	valid_0's auc: 0.886805	valid_0's binary_logloss: 0.517289	valid_1's auc: 0.891684	valid_1's binary_logloss: 0.508653
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889668	valid_0's binary_logloss: 0.488712	valid_1's auc: 0.894918	valid_1's binary_logloss: 0.47927
[3]	valid_0's auc: 0.89361	valid_0's binary_logloss: 0.465687	valid_1's auc: 0.898734	valid_1's binary_logloss: 0.45601
[4]	valid_0's auc: 0.895553	valid_0's binary_logloss: 0.446468	valid_1's auc: 0.90079	valid_1's binary_logloss: 0.436566
[5]	valid_0's auc: 0.896401	valid_0's binary_logloss: 0.430672	valid_1's auc: 0.901623	valid_1's binary_logloss: 0.420454
[6]	valid_0's auc: 0.896545	valid_0's binary_logloss: 0.41736	valid_1's auc: 0.901267	valid_1's binary_logloss: 0.406977
[7]	valid_0's auc: 0.897461	valid_0's binary_logloss: 0.405844	valid_1's auc: 0.902131	valid_1's binary_logloss: 0.395407
[8]	valid_0's auc: 0.898327	valid_0's binary_logloss: 0.395865	valid_1's auc: 0.903339	valid_1's binary_logloss: 0.385204
[9]	valid_0's auc: 0.899571	valid_0's binary_logloss: 0.387058	valid_1's auc: 0.904324	valid_1's binary_logloss: 0.376461
[10]	valid_0's auc: 0.900155	valid_0's binary_logloss: 0.379443	valid_1's auc: 0.905151	valid_1's binary_logloss: 0.368739
[11]	valid_0's auc: 0.90124	valid_0's binary_logloss: 0.372634	valid_1's auc: 0.905003	valid_1's binary_logloss: 0.362691
[12]	valid_0's auc: 0.902435	valid_0's binary_logloss: 0.366582	valid_1's auc: 0.905656	valid_1's binary_logloss: 0.357008
[13]	valid_0's auc: 0.903009	valid_0's binary_logloss: 0.36138	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.35201
[14]	valid_0's auc: 0.903743	valid_0's binary_logloss: 0.356547	valid_1's auc: 0.906627	valid_1's binary_logloss: 0.347441
[15]	valid_0's auc: 0.904526	valid_0's binary_logloss: 0.352314	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.343724
[16]	valid_0's auc: 0.905211	valid_0's binary_logloss: 0.348457	valid_1's auc: 0.907363	valid_1's binary_logloss: 0.340323
[17]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.344964	valid_1's auc: 0.907743	valid_1's binary_logloss: 0.337358
[18]	valid_0's auc: 0.906699	valid_0's binary_logloss: 0.34162	valid_1's auc: 0.90828	valid_1's binary_logloss: 0.33451
[19]	valid_0's auc: 0.907319	valid_0's binary_logloss: 0.33892	valid_1's auc: 0.908375	valid_1's binary_logloss: 0.332382
[20]	valid_0's auc: 0.907772	valid_0's binary_logloss: 0.336469	valid_1's auc: 0.90829	valid_1's binary_logloss: 0.330595
[21]	valid_0's auc: 0.908302	valid_0's binary_logloss: 0.334073	valid_1's auc: 0.908412	valid_1's binary_logloss: 0.328761
[22]	valid_0's auc: 0.908909	valid_0's binary_logloss: 0.33193	valid_1's auc: 0.908716	valid_1's binary_logloss: 0.327031
[23]	valid_0's auc: 0.909525	valid_0's binary_logloss: 0.329835	valid_1's auc: 0.908735	valid_1's binary_logloss: 0.325659
[24]	valid_0's auc: 0.909988	valid_0's binary_logloss: 0.328053	valid_1's auc: 0.908814	valid_1's binary_logloss: 0.324339
[25]	valid_0's auc: 0.910568	valid_0's binary_logloss: 0.326245	valid_1's auc: 0.908941	valid_1's binary_logloss: 0.323256
[26]	valid_0's auc: 0.911152	valid_0's binary_logloss: 0.324506	valid_1's auc: 0.908967	valid_1's binary_logloss: 0.322239
[27]	valid_0's auc: 0.911634	valid_0's binary_logloss: 0.323011	valid_1's auc: 0.909023	valid_1's binary_logloss: 0.321387
[28]	valid_0's auc: 0.91212	valid_0's binary_logloss: 0.321547	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.320603
[29]	valid_0's auc: 0.912647	valid_0's binary_logloss: 0.320118	valid_1's auc: 0.909103	valid_1's binary_logloss: 0.319904
[30]	valid_0's auc: 0.913062	valid_0's binary_logloss: 0.318877	valid_1's auc: 0.909051	valid_1's binary_logloss: 0.319345
[31]	valid_0's auc: 0.913456	valid_0's binary_logloss: 0.317847	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.318633
[32]	valid_0's auc: 0.914029	valid_0's binary_logloss: 0.316482	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.318282
[33]	valid_0's auc: 0.91448	valid_0's binary_logloss: 0.315316	valid_1's auc: 0.909164	valid_1's binary_logloss: 0.317931
[34]	valid_0's auc: 0.914927	valid_0's binary_logloss: 0.314249	valid_1's auc: 0.909118	valid_1's binary_logloss: 0.317609
[35]	valid_0's auc: 0.915219	valid_0's binary_logloss: 0.31341	valid_1's auc: 0.909169	valid_1's binary_logloss: 0.317194
[36]	valid_0's auc: 0.915565	valid_0's binary_logloss: 0.312507	valid_1's auc: 0.909334	valid_1's binary_logloss: 0.316725
[37]	valid_0's auc: 0.916165	valid_0's binary_logloss: 0.311296	valid_1's auc: 0.909385	valid_1's binary_logloss: 0.316466
[38]	valid_0's auc: 0.916598	valid_0's binary_logloss: 0.310285	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.316111
[39]	valid_0's auc: 0.916942	valid_0's binary_logloss: 0.309505	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.315705
[40]	valid_0's auc: 0.917226	valid_0's binary_logloss: 0.308822	valid_1's auc: 0.909632	valid_1's binary_logloss: 0.315446
[41]	valid_0's auc: 0.917562	valid_0's binary_logloss: 0.308106	valid_1's auc: 0.909701	valid_1's binary_logloss: 0.315181
[42]	valid_0's auc: 0.917993	valid_0's binary_logloss: 0.307252	valid_1's auc: 0.909809	valid_1's binary_logloss: 0.314872
[43]	valid_0's auc: 0.918376	valid_0's binary_logloss: 0.306475	valid_1's auc: 0.909849	valid_1's binary_logloss: 0.31473
[44]	valid_0's auc: 0.918764	valid_0's binary_logloss: 0.305707	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314649
[45]	valid_0's auc: 0.919084	valid_0's binary_logloss: 0.305032	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314533
[46]	valid_0's auc: 0.919454	valid_0's binary_logloss: 0.304289	valid_1's auc: 0.909845	valid_1's binary_logloss: 0.314408
[47]	valid_0's auc: 0.919709	valid_0's binary_logloss: 0.303741	valid_1's auc: 0.909825	valid_1's binary_logloss: 0.314348
[48]	valid_0's auc: 0.920064	valid_0's binary_logloss: 0.303076	valid_1's auc: 0.909784	valid_1's binary_logloss: 0.31434
[49]	valid_0's auc: 0.920324	valid_0's binary_logloss: 0.302573	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.314424
[50]	valid_0's auc: 0.920565	valid_0's binary_logloss: 0.302118	valid_1's auc: 0.909744	valid_1's binary_logloss: 0.31436
[51]	valid_0's auc: 0.920821	valid_0's binary_logloss: 0.301553	valid_1's auc: 0.909796	valid_1's binary_logloss: 0.314229
[52]	valid_0's auc: 0.921229	valid_0's binary_logloss: 0.300757	valid_1's auc: 0.909723	valid_1's binary_logloss: 0.314282
[53]	valid_0's auc: 0.92147	valid_0's binary_logloss: 0.300325	valid_1's auc: 0.9097	valid_1's binary_logloss: 0.314298
[54]	valid_0's auc: 0.921783	valid_0's binary_logloss: 0.299757	valid_1's auc: 0.909637	valid_1's binary_logloss: 0.314396
[55]	valid_0's auc: 0.921997	valid_0's binary_logloss: 0.299354	valid_1's auc: 0.90959	valid_1's binary_logloss: 0.314403
[56]	valid_0's auc: 0.922284	valid_0's binary_logloss: 0.298828	valid_1's auc: 0.909546	valid_1's binary_logloss: 0.314416
[57]	valid_0's auc: 0.922493	valid_0's binary_logloss: 0.298425	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.314393
[58]	valid_0's auc: 0.922814	valid_0's binary_logloss: 0.297839	valid_1's auc: 0.909397	valid_1's binary_logloss: 0.314582
[59]	valid_0's auc: 0.92297	valid_0's binary_logloss: 0.297516	valid_1's auc: 0.909453	valid_1's binary_logloss: 0.314464
[60]	valid_0's auc: 0.923253	valid_0's binary_logloss: 0.297021	valid_1's auc: 0.909513	valid_1's binary_logloss: 0.314365
[61]	valid_0's auc: 0.923567	valid_0's binary_logloss: 0.296482	valid_1's auc: 0.90945	valid_1's binary_logloss: 0.314422
[62]	valid_0's auc: 0.923798	valid_0's binary_logloss: 0.29607	valid_1's auc: 0.909324	valid_1's binary_logloss: 0.314626
[63]	valid_0's auc: 0.924095	valid_0's binary_logloss: 0.295523	valid_1's auc: 0.909202	valid_1's binary_logloss: 0.314749
[64]	valid_0's auc: 0.924262	valid_0's binary_logloss: 0.295202	valid_1's auc: 0.909154	valid_1's binary_logloss: 0.314768
[65]	valid_0's auc: 0.924621	valid_0's binary_logloss: 0.294597	valid_1's auc: 0.909137	valid_1's binary_logloss: 0.314782
[66]	valid_0's auc: 0.92487	valid_0's binary_logloss: 0.294201	valid_1's auc: 0.909159	valid_1's binary_logloss: 0.314723
[67]	valid_0's auc: 0.925171	valid_0's binary_logloss: 0.29367	valid_1's auc: 0.90909	valid_1's binary_logloss: 0.314803
[68]	valid_0's auc: 0.925329	valid_0's binary_logloss: 0.29334	valid_1's auc: 0.909111	valid_1's binary_logloss: 0.314788
[69]	valid_0's auc: 0.925561	valid_0's binary_logloss: 0.292967	valid_1's auc: 0.908959	valid_1's binary_logloss: 0.314993
[70]	valid_0's auc: 0.925915	valid_0's binary_logloss: 0.292413	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315123
[71]	valid_0's auc: 0.926187	valid_0's binary_logloss: 0.291899	valid_1's auc: 0.908821	valid_1's binary_logloss: 0.315221
[72]	valid_0's auc: 0.926386	valid_0's binary_logloss: 0.291555	valid_1's auc: 0.908715	valid_1's binary_logloss: 0.315379
[73]	valid_0's auc: 0.926625	valid_0's binary_logloss: 0.29111	valid_1's auc: 0.908759	valid_1's binary_logloss: 0.31534
[74]	valid_0's auc: 0.926923	valid_0's binary_logloss: 0.290575	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315509
[75]	valid_0's auc: 0.927152	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315463
[76]	valid_0's auc: 0.927366	valid_0's binary_logloss: 0.289702	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.315508
[77]	valid_0's auc: 0.927623	valid_0's binary_logloss: 0.28928	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.315549
[78]	valid_0's auc: 0.927797	valid_0's binary_logloss: 0.289	valid_1's auc: 0.908618	valid_1's binary_logloss: 0.315544
[79]	valid_0's auc: 0.928085	valid_0's binary_logloss: 0.288511	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.315588
[80]	valid_0's auc: 0.928249	valid_0's binary_logloss: 0.288208	valid_1's auc: 0.908626	valid_1's binary_logloss: 0.315548
[81]	valid_0's auc: 0.928399	valid_0's binary_logloss: 0.287909	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.315542
[82]	valid_0's auc: 0.928507	valid_0's binary_logloss: 0.287706	valid_1's auc: 0.908624	valid_1's binary_logloss: 0.315585
[83]	valid_0's auc: 0.928716	valid_0's binary_logloss: 0.287351	valid_1's auc: 0.90857	valid_1's binary_logloss: 0.315685
[84]	valid_0's auc: 0.929036	valid_0's binary_logloss: 0.286861	valid_1's auc: 0.90855	valid_1's binary_logloss: 0.315721
[85]	valid_0's auc: 0.929299	valid_0's binary_logloss: 0.286392	valid_1's auc: 0.908491	valid_1's binary_logloss: 0.315813
[86]	valid_0's auc: 0.929497	valid_0's binary_logloss: 0.285997	valid_1's auc: 0.908397	valid_1's binary_logloss: 0.315984
[87]	valid_0's auc: 0.929705	valid_0's binary_logloss: 0.285667	valid_1's auc: 0.908325	valid_1's binary_logloss: 0.316117
[88]	valid_0's auc: 0.929786	valid_0's binary_logloss: 0.28553	valid_1's auc: 0.908281	valid_1's binary_logloss: 0.316211
[89]	valid_0's auc: 0.930074	valid_0's binary_logloss: 0.285016	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.316383
[90]	valid_0's auc: 0.930288	valid_0's binary_logloss: 0.284648	valid_1's auc: 0.908136	valid_1's binary_logloss: 0.316485
[91]	valid_0's auc: 0.930518	valid_0's binary_logloss: 0.284228	valid_1's auc: 0.90806	valid_1's binary_logloss: 0.316669
[92]	valid_0's auc: 0.930644	valid_0's binary_logloss: 0.283943	valid_1's auc: 0.908043	valid_1's binary_logloss: 0.31673
[93]	valid_0's auc: 0.93079	valid_0's binary_logloss: 0.283673	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.316818
[94]	valid_0's auc: 0.931066	valid_0's binary_logloss: 0.283178	valid_1's auc: 0.907925	valid_1's binary_logloss: 0.316921
[95]	valid_0's auc: 0.931266	valid_0's binary_logloss: 0.282821	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317081
[96]	valid_0's auc: 0.931543	valid_0's binary_logloss: 0.282338	valid_1's auc: 0.907694	valid_1's binary_logloss: 0.31732
[97]	valid_0's auc: 0.931684	valid_0's binary_logloss: 0.282078	valid_1's auc: 0.907565	valid_1's binary_logloss: 0.317529
[98]	valid_0's auc: 0.931856	valid_0's binary_logloss: 0.281773	valid_1's auc: 0.90749	valid_1's binary_logloss: 0.31763
[99]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.281652	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.317643
[100]	valid_0's auc: 0.932047	valid_0's binary_logloss: 0.281416	valid_1's auc: 0.907405	valid_1's binary_logloss: 0.317875
[101]	valid_0's auc: 0.932095	valid_0's binary_logloss: 0.281322	valid_1's auc: 0.907373	valid_1's binary_logloss: 0.317957
[102]	valid_0's auc: 0.93224	valid_0's binary_logloss: 0.28105	valid_1's auc: 0.907301	valid_1's binary_logloss: 0.318104
[103]	valid_0's auc: 0.932457	valid_0's binary_logloss: 0.280702	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.318249
[104]	valid_0's auc: 0.932632	valid_0's binary_logloss: 0.280375	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318057
[105]	valid_0's auc: 0.932659	valid_0's binary_logloss: 0.280335	valid_1's auc: 0.907424	valid_1's binary_logloss: 0.318001
[106]	valid_0's auc: 0.932907	valid_0's binary_logloss: 0.279915	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.318063
[107]	valid_0's auc: 0.933186	valid_0's binary_logloss: 0.279396	valid_1's auc: 0.907387	valid_1's binary_logloss: 0.31812
[108]	valid_0's auc: 0.93338	valid_0's binary_logloss: 0.279037	valid_1's auc: 0.907416	valid_1's binary_logloss: 0.318118
[109]	valid_0's auc: 0.933538	valid_0's binary_logloss: 0.278752	valid_1's auc: 0.907362	valid_1's binary_logloss: 0.318217
[110]	valid_0's auc: 0.933745	valid_0's binary_logloss: 0.278408	valid_1's auc: 0.907306	valid_1's binary_logloss: 0.318341
[111]	valid_0's auc: 0.933848	valid_0's binary_logloss: 0.278244	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318403
[112]	valid_0's auc: 0.934061	valid_0's binary_logloss: 0.277899	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318402
[113]	valid_0's auc: 0.934334	valid_0's binary_logloss: 0.277427	valid_1's auc: 0.90729	valid_1's binary_logloss: 0.318329
[114]	valid_0's auc: 0.934561	valid_0's binary_logloss: 0.277025	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318505
[115]	valid_0's auc: 0.934807	valid_0's binary_logloss: 0.276653	valid_1's auc: 0.907152	valid_1's binary_logloss: 0.318562
[116]	valid_0's auc: 0.935021	valid_0's binary_logloss: 0.276275	valid_1's auc: 0.907195	valid_1's binary_logloss: 0.318503
[117]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.275763	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318733
[118]	valid_0's auc: 0.935471	valid_0's binary_logloss: 0.275463	valid_1's auc: 0.906989	valid_1's binary_logloss: 0.31891
[119]	valid_0's auc: 0.935687	valid_0's binary_logloss: 0.275104	valid_1's auc: 0.906945	valid_1's binary_logloss: 0.318984
[120]	valid_0's auc: 0.935811	valid_0's binary_logloss: 0.274887	valid_1's auc: 0.906954	valid_1's binary_logloss: 0.318987
[121]	valid_0's auc: 0.936057	valid_0's binary_logloss: 0.274466	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.319061
[122]	valid_0's auc: 0.936218	valid_0's binary_logloss: 0.274152	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.319154
[123]	valid_0's auc: 0.936336	valid_0's binary_logloss: 0.273922	valid_1's auc: 0.906825	valid_1's binary_logloss: 0.31935
[124]	valid_0's auc: 0.936478	valid_0's binary_logloss: 0.273668	valid_1's auc: 0.906773	valid_1's binary_logloss: 0.319441
[125]	valid_0's auc: 0.936584	valid_0's binary_logloss: 0.273468	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.31965
[126]	valid_0's auc: 0.936733	valid_0's binary_logloss: 0.273146	valid_1's auc: 0.906595	valid_1's binary_logloss: 0.319842
[127]	valid_0's auc: 0.936795	valid_0's binary_logloss: 0.273018	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319873
[128]	valid_0's auc: 0.936989	valid_0's binary_logloss: 0.272676	valid_1's auc: 0.90655	valid_1's binary_logloss: 0.319945
[129]	valid_0's auc: 0.93719	valid_0's binary_logloss: 0.272324	valid_1's auc: 0.906494	valid_1's binary_logloss: 0.320078
[130]	valid_0's auc: 0.937342	valid_0's binary_logloss: 0.272038	valid_1's auc: 0.906482	valid_1's binary_logloss: 0.320152
[131]	valid_0's auc: 0.937396	valid_0's binary_logloss: 0.271921	valid_1's auc: 0.906469	valid_1's binary_logloss: 0.320218
[132]	valid_0's auc: 0.937582	valid_0's binary_logloss: 0.271567	valid_1's auc: 0.906396	valid_1's binary_logloss: 0.320447
[133]	valid_0's auc: 0.937708	valid_0's binary_logloss: 0.271324	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320509
[134]	valid_0's auc: 0.937964	valid_0's binary_logloss: 0.270919	valid_1's auc: 0.906259	valid_1's binary_logloss: 0.320665
[135]	valid_0's auc: 0.93807	valid_0's binary_logloss: 0.270698	valid_1's auc: 0.906261	valid_1's binary_logloss: 0.320704
[136]	valid_0's auc: 0.938239	valid_0's binary_logloss: 0.270389	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.320939
[137]	valid_0's auc: 0.93836	valid_0's binary_logloss: 0.270151	valid_1's auc: 0.90616	valid_1's binary_logloss: 0.320925
[138]	valid_0's auc: 0.938533	valid_0's binary_logloss: 0.269805	valid_1's auc: 0.906125	valid_1's binary_logloss: 0.321022
[139]	valid_0's auc: 0.938694	valid_0's binary_logloss: 0.269489	valid_1's auc: 0.906069	valid_1's binary_logloss: 0.321183
[140]	valid_0's auc: 0.93889	valid_0's binary_logloss: 0.269175	valid_1's auc: 0.906024	valid_1's binary_logloss: 0.321248
[141]	valid_0's auc: 0.93895	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.906054	valid_1's binary_logloss: 0.321208
[142]	valid_0's auc: 0.939043	valid_0's binary_logloss: 0.268887	valid_1's auc: 0.905994	valid_1's binary_logloss: 0.321356
[143]	valid_0's auc: 0.939205	valid_0's binary_logloss: 0.26861	valid_1's auc: 0.905927	valid_1's binary_logloss: 0.321486
[144]	valid_0's auc: 0.939408	valid_0's binary_logloss: 0.26827	valid_1's auc: 0.905779	valid_1's binary_logloss: 0.321702
Early stopping, best iteration is:
[44]	valid_0's auc: 0.918764	valid_0's binary_logloss: 0.305707	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314649
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892925	valid_0's binary_logloss: 0.488849	valid_1's auc: 0.898619	valid_1's binary_logloss: 0.479345
[3]	valid_0's auc: 0.893551	valid_0's binary_logloss: 0.465882	valid_1's auc: 0.898638	valid_1's binary_logloss: 0.456011
[4]	valid_0's auc: 0.896053	valid_0's binary_logloss: 0.446354	valid_1's auc: 0.900446	valid_1's binary_logloss: 0.436516
[5]	valid_0's auc: 0.897119	valid_0's binary_logloss: 0.430499	valid_1's auc: 0.902176	valid_1's binary_logloss: 0.420287
[6]	valid_0's auc: 0.898588	valid_0's binary_logloss: 0.416679	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.40622
[7]	valid_0's auc: 0.899529	valid_0's binary_logloss: 0.405006	valid_1's auc: 0.904367	valid_1's binary_logloss: 0.394504
[8]	valid_0's auc: 0.90018	valid_0's binary_logloss: 0.394978	valid_1's auc: 0.904583	valid_1's binary_logloss: 0.384716
[9]	valid_0's auc: 0.900614	valid_0's binary_logloss: 0.386464	valid_1's auc: 0.904763	valid_1's binary_logloss: 0.376092
[10]	valid_0's auc: 0.901576	valid_0's binary_logloss: 0.378593	valid_1's auc: 0.905018	valid_1's binary_logloss: 0.368746
[11]	valid_0's auc: 0.902508	valid_0's binary_logloss: 0.371898	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.362418
[12]	valid_0's auc: 0.903079	valid_0's binary_logloss: 0.366032	valid_1's auc: 0.905353	valid_1's binary_logloss: 0.357073
[13]	valid_0's auc: 0.903656	valid_0's binary_logloss: 0.360699	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.352261
[14]	valid_0's auc: 0.904849	valid_0's binary_logloss: 0.355873	valid_1's auc: 0.906208	valid_1's binary_logloss: 0.347838
[15]	valid_0's auc: 0.905393	valid_0's binary_logloss: 0.351643	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.344199
[16]	valid_0's auc: 0.906008	valid_0's binary_logloss: 0.347815	valid_1's auc: 0.906843	valid_1's binary_logloss: 0.340819
[17]	valid_0's auc: 0.906554	valid_0's binary_logloss: 0.344379	valid_1's auc: 0.907228	valid_1's binary_logloss: 0.337716
[18]	valid_0's auc: 0.906982	valid_0's binary_logloss: 0.341387	valid_1's auc: 0.907447	valid_1's binary_logloss: 0.33513
[19]	valid_0's auc: 0.907602	valid_0's binary_logloss: 0.338525	valid_1's auc: 0.907563	valid_1's binary_logloss: 0.3329
[20]	valid_0's auc: 0.908251	valid_0's binary_logloss: 0.335882	valid_1's auc: 0.908	valid_1's binary_logloss: 0.330635
[21]	valid_0's auc: 0.908814	valid_0's binary_logloss: 0.333475	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.328872
[22]	valid_0's auc: 0.909375	valid_0's binary_logloss: 0.331353	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.327327
[23]	valid_0's auc: 0.909824	valid_0's binary_logloss: 0.329416	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.326051
[24]	valid_0's auc: 0.910349	valid_0's binary_logloss: 0.327532	valid_1's auc: 0.908316	valid_1's binary_logloss: 0.324722
[25]	valid_0's auc: 0.910802	valid_0's binary_logloss: 0.325869	valid_1's auc: 0.908417	valid_1's binary_logloss: 0.323584
[26]	valid_0's auc: 0.911366	valid_0's binary_logloss: 0.324182	valid_1's auc: 0.908676	valid_1's binary_logloss: 0.322558
[27]	valid_0's auc: 0.911868	valid_0's binary_logloss: 0.322633	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.321658
[28]	valid_0's auc: 0.912292	valid_0's binary_logloss: 0.321241	valid_1's auc: 0.908852	valid_1's binary_logloss: 0.320952
[29]	valid_0's auc: 0.912815	valid_0's binary_logloss: 0.319774	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.320199
[30]	valid_0's auc: 0.913219	valid_0's binary_logloss: 0.318584	valid_1's auc: 0.908901	valid_1's binary_logloss: 0.319623
[31]	valid_0's auc: 0.91371	valid_0's binary_logloss: 0.317324	valid_1's auc: 0.909002	valid_1's binary_logloss: 0.31901
[32]	valid_0's auc: 0.914161	valid_0's binary_logloss: 0.316196	valid_1's auc: 0.909193	valid_1's binary_logloss: 0.318452
[33]	valid_0's auc: 0.914556	valid_0's binary_logloss: 0.315144	valid_1's auc: 0.909196	valid_1's binary_logloss: 0.318068
[34]	valid_0's auc: 0.914912	valid_0's binary_logloss: 0.314282	valid_1's auc: 0.909218	valid_1's binary_logloss: 0.317693
[35]	valid_0's auc: 0.915356	valid_0's binary_logloss: 0.313219	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.317196
[36]	valid_0's auc: 0.915711	valid_0's binary_logloss: 0.312335	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.316845
[37]	valid_0's auc: 0.916164	valid_0's binary_logloss: 0.311283	valid_1's auc: 0.909516	valid_1's binary_logloss: 0.316478
[38]	valid_0's auc: 0.916614	valid_0's binary_logloss: 0.310332	valid_1's auc: 0.909388	valid_1's binary_logloss: 0.316423
[39]	valid_0's auc: 0.917012	valid_0's binary_logloss: 0.309457	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.316247
[40]	valid_0's auc: 0.917337	valid_0's binary_logloss: 0.30869	valid_1's auc: 0.909312	valid_1's binary_logloss: 0.316132
[41]	valid_0's auc: 0.917742	valid_0's binary_logloss: 0.307901	valid_1's auc: 0.909457	valid_1's binary_logloss: 0.315739
[42]	valid_0's auc: 0.918016	valid_0's binary_logloss: 0.307323	valid_1's auc: 0.909611	valid_1's binary_logloss: 0.315448
[43]	valid_0's auc: 0.918383	valid_0's binary_logloss: 0.306602	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.315283
[44]	valid_0's auc: 0.918737	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.909473	valid_1's binary_logloss: 0.315318
[45]	valid_0's auc: 0.919024	valid_0's binary_logloss: 0.305277	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.315376
[46]	valid_0's auc: 0.919333	valid_0's binary_logloss: 0.304644	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.315235
[47]	valid_0's auc: 0.919719	valid_0's binary_logloss: 0.303862	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.315087
[48]	valid_0's auc: 0.919976	valid_0's binary_logloss: 0.303367	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.315082
[49]	valid_0's auc: 0.920318	valid_0's binary_logloss: 0.302766	valid_1's auc: 0.909495	valid_1's binary_logloss: 0.314933
[50]	valid_0's auc: 0.920734	valid_0's binary_logloss: 0.302008	valid_1's auc: 0.90947	valid_1's binary_logloss: 0.31489
[51]	valid_0's auc: 0.921015	valid_0's binary_logloss: 0.30141	valid_1's auc: 0.90939	valid_1's binary_logloss: 0.314906
[52]	valid_0's auc: 0.921243	valid_0's binary_logloss: 0.300971	valid_1's auc: 0.909356	valid_1's binary_logloss: 0.314883
[53]	valid_0's auc: 0.921592	valid_0's binary_logloss: 0.300296	valid_1's auc: 0.909392	valid_1's binary_logloss: 0.314765
[54]	valid_0's auc: 0.921815	valid_0's binary_logloss: 0.299798	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.314686
[55]	valid_0's auc: 0.922089	valid_0's binary_logloss: 0.299287	valid_1's auc: 0.909407	valid_1's binary_logloss: 0.314581
[56]	valid_0's auc: 0.922299	valid_0's binary_logloss: 0.298883	valid_1's auc: 0.909489	valid_1's binary_logloss: 0.314388
[57]	valid_0's auc: 0.922529	valid_0's binary_logloss: 0.298462	valid_1's auc: 0.909514	valid_1's binary_logloss: 0.314347
[58]	valid_0's auc: 0.922719	valid_0's binary_logloss: 0.298049	valid_1's auc: 0.909537	valid_1's binary_logloss: 0.314294
[59]	valid_0's auc: 0.922985	valid_0's binary_logloss: 0.297603	valid_1's auc: 0.909582	valid_1's binary_logloss: 0.314226
[60]	valid_0's auc: 0.923266	valid_0's binary_logloss: 0.297065	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.314302
[61]	valid_0's auc: 0.923571	valid_0's binary_logloss: 0.296486	valid_1's auc: 0.909602	valid_1's binary_logloss: 0.314171
[62]	valid_0's auc: 0.923789	valid_0's binary_logloss: 0.296086	valid_1's auc: 0.909535	valid_1's binary_logloss: 0.314229
[63]	valid_0's auc: 0.924076	valid_0's binary_logloss: 0.295537	valid_1's auc: 0.909491	valid_1's binary_logloss: 0.314237
[64]	valid_0's auc: 0.924409	valid_0's binary_logloss: 0.294963	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.314358
[65]	valid_0's auc: 0.924668	valid_0's binary_logloss: 0.294489	valid_1's auc: 0.909396	valid_1's binary_logloss: 0.314357
[66]	valid_0's auc: 0.924902	valid_0's binary_logloss: 0.294087	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.314423
[67]	valid_0's auc: 0.925083	valid_0's binary_logloss: 0.293767	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.314426
[68]	valid_0's auc: 0.925243	valid_0's binary_logloss: 0.293473	valid_1's auc: 0.909218	valid_1's binary_logloss: 0.314566
[69]	valid_0's auc: 0.925585	valid_0's binary_logloss: 0.292894	valid_1's auc: 0.909163	valid_1's binary_logloss: 0.314653
[70]	valid_0's auc: 0.925693	valid_0's binary_logloss: 0.292698	valid_1's auc: 0.909162	valid_1's binary_logloss: 0.314627
[71]	valid_0's auc: 0.925966	valid_0's binary_logloss: 0.292203	valid_1's auc: 0.909273	valid_1's binary_logloss: 0.314467
[72]	valid_0's auc: 0.92619	valid_0's binary_logloss: 0.291818	valid_1's auc: 0.909184	valid_1's binary_logloss: 0.31455
[73]	valid_0's auc: 0.926456	valid_0's binary_logloss: 0.291316	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.314457
[74]	valid_0's auc: 0.92671	valid_0's binary_logloss: 0.29091	valid_1's auc: 0.909165	valid_1's binary_logloss: 0.314532
[75]	valid_0's auc: 0.927182	valid_0's binary_logloss: 0.290169	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314728
[76]	valid_0's auc: 0.927371	valid_0's binary_logloss: 0.289822	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314767
[77]	valid_0's auc: 0.927774	valid_0's binary_logloss: 0.289175	valid_1's auc: 0.909019	valid_1's binary_logloss: 0.314897
[78]	valid_0's auc: 0.928021	valid_0's binary_logloss: 0.288698	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.314811
[79]	valid_0's auc: 0.928232	valid_0's binary_logloss: 0.288378	valid_1's auc: 0.909044	valid_1's binary_logloss: 0.314845
[80]	valid_0's auc: 0.928472	valid_0's binary_logloss: 0.287919	valid_1's auc: 0.909078	valid_1's binary_logloss: 0.314808
[81]	valid_0's auc: 0.928687	valid_0's binary_logloss: 0.287553	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.314849
[82]	valid_0's auc: 0.92894	valid_0's binary_logloss: 0.287155	valid_1's auc: 0.909044	valid_1's binary_logloss: 0.314928
[83]	valid_0's auc: 0.929101	valid_0's binary_logloss: 0.286879	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.314921
[84]	valid_0's auc: 0.929247	valid_0's binary_logloss: 0.28659	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.315092
[85]	valid_0's auc: 0.929467	valid_0's binary_logloss: 0.286244	valid_1's auc: 0.908982	valid_1's binary_logloss: 0.315083
[86]	valid_0's auc: 0.929681	valid_0's binary_logloss: 0.285813	valid_1's auc: 0.908913	valid_1's binary_logloss: 0.315199
[87]	valid_0's auc: 0.929894	valid_0's binary_logloss: 0.285461	valid_1's auc: 0.908821	valid_1's binary_logloss: 0.315332
[88]	valid_0's auc: 0.930174	valid_0's binary_logloss: 0.284959	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.315384
[89]	valid_0's auc: 0.930331	valid_0's binary_logloss: 0.284691	valid_1's auc: 0.908715	valid_1's binary_logloss: 0.315484
[90]	valid_0's auc: 0.930562	valid_0's binary_logloss: 0.284279	valid_1's auc: 0.908696	valid_1's binary_logloss: 0.315558
[91]	valid_0's auc: 0.930763	valid_0's binary_logloss: 0.283887	valid_1's auc: 0.908676	valid_1's binary_logloss: 0.315615
[92]	valid_0's auc: 0.930955	valid_0's binary_logloss: 0.283524	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.315708
[93]	valid_0's auc: 0.931237	valid_0's binary_logloss: 0.283051	valid_1's auc: 0.908572	valid_1's binary_logloss: 0.315778
[94]	valid_0's auc: 0.931514	valid_0's binary_logloss: 0.282516	valid_1's auc: 0.908475	valid_1's binary_logloss: 0.315879
[95]	valid_0's auc: 0.931746	valid_0's binary_logloss: 0.282115	valid_1's auc: 0.908431	valid_1's binary_logloss: 0.316001
[96]	valid_0's auc: 0.932023	valid_0's binary_logloss: 0.281639	valid_1's auc: 0.908462	valid_1's binary_logloss: 0.315948
[97]	valid_0's auc: 0.932176	valid_0's binary_logloss: 0.281385	valid_1's auc: 0.908409	valid_1's binary_logloss: 0.316008
[98]	valid_0's auc: 0.932348	valid_0's binary_logloss: 0.281097	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.31589
[99]	valid_0's auc: 0.932612	valid_0's binary_logloss: 0.280647	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.31592
[100]	valid_0's auc: 0.932849	valid_0's binary_logloss: 0.280228	valid_1's auc: 0.908455	valid_1's binary_logloss: 0.315971
[101]	valid_0's auc: 0.933046	valid_0's binary_logloss: 0.279928	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.315985
[102]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.279607	valid_1's auc: 0.908475	valid_1's binary_logloss: 0.316016
[103]	valid_0's auc: 0.933454	valid_0's binary_logloss: 0.279224	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.316167
[104]	valid_0's auc: 0.933718	valid_0's binary_logloss: 0.278809	valid_1's auc: 0.908255	valid_1's binary_logloss: 0.316312
[105]	valid_0's auc: 0.93388	valid_0's binary_logloss: 0.278543	valid_1's auc: 0.908123	valid_1's binary_logloss: 0.31651
[106]	valid_0's auc: 0.934049	valid_0's binary_logloss: 0.278266	valid_1's auc: 0.908049	valid_1's binary_logloss: 0.316664
[107]	valid_0's auc: 0.934185	valid_0's binary_logloss: 0.278009	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.316857
[108]	valid_0's auc: 0.934355	valid_0's binary_logloss: 0.277745	valid_1's auc: 0.907908	valid_1's binary_logloss: 0.316924
[109]	valid_0's auc: 0.934557	valid_0's binary_logloss: 0.277395	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316874
[110]	valid_0's auc: 0.93471	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317003
[111]	valid_0's auc: 0.934879	valid_0's binary_logloss: 0.276828	valid_1's auc: 0.907823	valid_1's binary_logloss: 0.317077
[112]	valid_0's auc: 0.93498	valid_0's binary_logloss: 0.276675	valid_1's auc: 0.907753	valid_1's binary_logloss: 0.317181
[113]	valid_0's auc: 0.935217	valid_0's binary_logloss: 0.276271	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.31716
[114]	valid_0's auc: 0.93543	valid_0's binary_logloss: 0.275908	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317215
[115]	valid_0's auc: 0.935533	valid_0's binary_logloss: 0.275738	valid_1's auc: 0.907694	valid_1's binary_logloss: 0.317442
[116]	valid_0's auc: 0.935729	valid_0's binary_logloss: 0.275388	valid_1's auc: 0.907663	valid_1's binary_logloss: 0.31749
[117]	valid_0's auc: 0.935945	valid_0's binary_logloss: 0.275021	valid_1's auc: 0.907606	valid_1's binary_logloss: 0.317606
[118]	valid_0's auc: 0.93615	valid_0's binary_logloss: 0.274648	valid_1's auc: 0.907524	valid_1's binary_logloss: 0.317765
[119]	valid_0's auc: 0.936369	valid_0's binary_logloss: 0.274303	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317927
[120]	valid_0's auc: 0.936534	valid_0's binary_logloss: 0.273991	valid_1's auc: 0.907271	valid_1's binary_logloss: 0.318141
[121]	valid_0's auc: 0.936728	valid_0's binary_logloss: 0.27367	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318188
[122]	valid_0's auc: 0.936915	valid_0's binary_logloss: 0.273328	valid_1's auc: 0.907247	valid_1's binary_logloss: 0.318202
[123]	valid_0's auc: 0.937124	valid_0's binary_logloss: 0.272961	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.318323
[124]	valid_0's auc: 0.937328	valid_0's binary_logloss: 0.272542	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.318575
[125]	valid_0's auc: 0.937475	valid_0's binary_logloss: 0.272248	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318608
[126]	valid_0's auc: 0.937665	valid_0's binary_logloss: 0.271889	valid_1's auc: 0.906995	valid_1's binary_logloss: 0.318789
[127]	valid_0's auc: 0.937849	valid_0's binary_logloss: 0.271574	valid_1's auc: 0.906896	valid_1's binary_logloss: 0.319007
[128]	valid_0's auc: 0.938125	valid_0's binary_logloss: 0.271128	valid_1's auc: 0.906854	valid_1's binary_logloss: 0.319107
[129]	valid_0's auc: 0.938297	valid_0's binary_logloss: 0.270818	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.319251
[130]	valid_0's auc: 0.938493	valid_0's binary_logloss: 0.270447	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.31939
[131]	valid_0's auc: 0.938703	valid_0's binary_logloss: 0.270079	valid_1's auc: 0.906559	valid_1's binary_logloss: 0.319704
[132]	valid_0's auc: 0.938843	valid_0's binary_logloss: 0.269824	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.319766
[133]	valid_0's auc: 0.939022	valid_0's binary_logloss: 0.269512	valid_1's auc: 0.906383	valid_1's binary_logloss: 0.319975
[134]	valid_0's auc: 0.939109	valid_0's binary_logloss: 0.269339	valid_1's auc: 0.906336	valid_1's binary_logloss: 0.320098
[135]	valid_0's auc: 0.939345	valid_0's binary_logloss: 0.268912	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.320102
[136]	valid_0's auc: 0.939511	valid_0's binary_logloss: 0.268649	valid_1's auc: 0.906262	valid_1's binary_logloss: 0.320252
[137]	valid_0's auc: 0.939636	valid_0's binary_logloss: 0.268381	valid_1's auc: 0.906274	valid_1's binary_logloss: 0.320322
[138]	valid_0's auc: 0.939738	valid_0's binary_logloss: 0.268171	valid_1's auc: 0.906242	valid_1's binary_logloss: 0.320352
[139]	valid_0's auc: 0.939855	valid_0's binary_logloss: 0.267915	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.320212
[140]	valid_0's auc: 0.939971	valid_0's binary_logloss: 0.267672	valid_1's auc: 0.90636	valid_1's binary_logloss: 0.320241
[141]	valid_0's auc: 0.940133	valid_0's binary_logloss: 0.267364	valid_1's auc: 0.906308	valid_1's binary_logloss: 0.32033
[142]	valid_0's auc: 0.940292	valid_0's binary_logloss: 0.267012	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320542
[143]	valid_0's auc: 0.94052	valid_0's binary_logloss: 0.266591	valid_1's auc: 0.906156	valid_1's binary_logloss: 0.320688
Early stopping, best iteration is:
[43]	valid_0's auc: 0.918383	valid_0's binary_logloss: 0.306602	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.315283
[1]	valid_0's auc: 0.888136	valid_0's binary_logloss: 0.517854	valid_1's auc: 0.89393	valid_1's binary_logloss: 0.508854
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891446	valid_0's binary_logloss: 0.489299	valid_1's auc: 0.894892	valid_1's binary_logloss: 0.479913
[3]	valid_0's auc: 0.894038	valid_0's binary_logloss: 0.466006	valid_1's auc: 0.897301	valid_1's binary_logloss: 0.456282
[4]	valid_0's auc: 0.895358	valid_0's binary_logloss: 0.446806	valid_1's auc: 0.898891	valid_1's binary_logloss: 0.437001
[5]	valid_0's auc: 0.897062	valid_0's binary_logloss: 0.43042	valid_1's auc: 0.900121	valid_1's binary_logloss: 0.42066
[6]	valid_0's auc: 0.897753	valid_0's binary_logloss: 0.416973	valid_1's auc: 0.901305	valid_1's binary_logloss: 0.407041
[7]	valid_0's auc: 0.898496	valid_0's binary_logloss: 0.405285	valid_1's auc: 0.90152	valid_1's binary_logloss: 0.395542
[8]	valid_0's auc: 0.899601	valid_0's binary_logloss: 0.395018	valid_1's auc: 0.902834	valid_1's binary_logloss: 0.385161
[9]	valid_0's auc: 0.900309	valid_0's binary_logloss: 0.38628	valid_1's auc: 0.903314	valid_1's binary_logloss: 0.376468
[10]	valid_0's auc: 0.900879	valid_0's binary_logloss: 0.378683	valid_1's auc: 0.903486	valid_1's binary_logloss: 0.369189
[11]	valid_0's auc: 0.901314	valid_0's binary_logloss: 0.372179	valid_1's auc: 0.903545	valid_1's binary_logloss: 0.363044
[12]	valid_0's auc: 0.902019	valid_0's binary_logloss: 0.366218	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.357307
[13]	valid_0's auc: 0.902768	valid_0's binary_logloss: 0.360999	valid_1's auc: 0.904527	valid_1's binary_logloss: 0.352542
[14]	valid_0's auc: 0.903581	valid_0's binary_logloss: 0.356267	valid_1's auc: 0.90534	valid_1's binary_logloss: 0.347981
[15]	valid_0's auc: 0.904279	valid_0's binary_logloss: 0.352021	valid_1's auc: 0.905796	valid_1's binary_logloss: 0.344233
[16]	valid_0's auc: 0.904859	valid_0's binary_logloss: 0.348325	valid_1's auc: 0.906107	valid_1's binary_logloss: 0.340942
[17]	valid_0's auc: 0.905675	valid_0's binary_logloss: 0.344855	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.337985
[18]	valid_0's auc: 0.906509	valid_0's binary_logloss: 0.341622	valid_1's auc: 0.906774	valid_1's binary_logloss: 0.335609
[19]	valid_0's auc: 0.907097	valid_0's binary_logloss: 0.338785	valid_1's auc: 0.907143	valid_1's binary_logloss: 0.333283
[20]	valid_0's auc: 0.907558	valid_0's binary_logloss: 0.336305	valid_1's auc: 0.907354	valid_1's binary_logloss: 0.331148
[21]	valid_0's auc: 0.908378	valid_0's binary_logloss: 0.333814	valid_1's auc: 0.90764	valid_1's binary_logloss: 0.329295
[22]	valid_0's auc: 0.908958	valid_0's binary_logloss: 0.331572	valid_1's auc: 0.90797	valid_1's binary_logloss: 0.327415
[23]	valid_0's auc: 0.909526	valid_0's binary_logloss: 0.329478	valid_1's auc: 0.908289	valid_1's binary_logloss: 0.325685
[24]	valid_0's auc: 0.910203	valid_0's binary_logloss: 0.32749	valid_1's auc: 0.908433	valid_1's binary_logloss: 0.324457
[25]	valid_0's auc: 0.910766	valid_0's binary_logloss: 0.325706	valid_1's auc: 0.90871	valid_1's binary_logloss: 0.323222
[26]	valid_0's auc: 0.911103	valid_0's binary_logloss: 0.324349	valid_1's auc: 0.908774	valid_1's binary_logloss: 0.322294
[27]	valid_0's auc: 0.911523	valid_0's binary_logloss: 0.32284	valid_1's auc: 0.908903	valid_1's binary_logloss: 0.321285
[28]	valid_0's auc: 0.912053	valid_0's binary_logloss: 0.32133	valid_1's auc: 0.908994	valid_1's binary_logloss: 0.32044
[29]	valid_0's auc: 0.91256	valid_0's binary_logloss: 0.319935	valid_1's auc: 0.909003	valid_1's binary_logloss: 0.319741
[30]	valid_0's auc: 0.91302	valid_0's binary_logloss: 0.318651	valid_1's auc: 0.909113	valid_1's binary_logloss: 0.319024
[31]	valid_0's auc: 0.913531	valid_0's binary_logloss: 0.317382	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.31846
[32]	valid_0's auc: 0.913959	valid_0's binary_logloss: 0.316199	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.31792
[33]	valid_0's auc: 0.914338	valid_0's binary_logloss: 0.315227	valid_1's auc: 0.909213	valid_1's binary_logloss: 0.317438
[34]	valid_0's auc: 0.914701	valid_0's binary_logloss: 0.314299	valid_1's auc: 0.909325	valid_1's binary_logloss: 0.317016
[35]	valid_0's auc: 0.915078	valid_0's binary_logloss: 0.313349	valid_1's auc: 0.909279	valid_1's binary_logloss: 0.316728
[36]	valid_0's auc: 0.915465	valid_0's binary_logloss: 0.312396	valid_1's auc: 0.909381	valid_1's binary_logloss: 0.316332
[37]	valid_0's auc: 0.91574	valid_0's binary_logloss: 0.311714	valid_1's auc: 0.909368	valid_1's binary_logloss: 0.316152
[38]	valid_0's auc: 0.916223	valid_0's binary_logloss: 0.310741	valid_1's auc: 0.909384	valid_1's binary_logloss: 0.315786
[39]	valid_0's auc: 0.916477	valid_0's binary_logloss: 0.310122	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.315443
[40]	valid_0's auc: 0.916817	valid_0's binary_logloss: 0.309372	valid_1's auc: 0.909603	valid_1's binary_logloss: 0.315066
[41]	valid_0's auc: 0.917162	valid_0's binary_logloss: 0.308604	valid_1's auc: 0.909639	valid_1's binary_logloss: 0.3149
[42]	valid_0's auc: 0.917493	valid_0's binary_logloss: 0.307907	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.314861
[43]	valid_0's auc: 0.917837	valid_0's binary_logloss: 0.307162	valid_1's auc: 0.90957	valid_1's binary_logloss: 0.314733
[44]	valid_0's auc: 0.918167	valid_0's binary_logloss: 0.306487	valid_1's auc: 0.909621	valid_1's binary_logloss: 0.31455
[45]	valid_0's auc: 0.918333	valid_0's binary_logloss: 0.306105	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.314526
[46]	valid_0's auc: 0.918655	valid_0's binary_logloss: 0.305424	valid_1's auc: 0.909539	valid_1's binary_logloss: 0.314427
[47]	valid_0's auc: 0.918985	valid_0's binary_logloss: 0.304742	valid_1's auc: 0.909456	valid_1's binary_logloss: 0.314424
[48]	valid_0's auc: 0.91939	valid_0's binary_logloss: 0.304018	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.314384
[49]	valid_0's auc: 0.91975	valid_0's binary_logloss: 0.303358	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314159
[50]	valid_0's auc: 0.920083	valid_0's binary_logloss: 0.30273	valid_1's auc: 0.90957	valid_1's binary_logloss: 0.314176
[51]	valid_0's auc: 0.920397	valid_0's binary_logloss: 0.302171	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314126
[52]	valid_0's auc: 0.920643	valid_0's binary_logloss: 0.301737	valid_1's auc: 0.909555	valid_1's binary_logloss: 0.314108
[53]	valid_0's auc: 0.92103	valid_0's binary_logloss: 0.301055	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.314161
[54]	valid_0's auc: 0.921355	valid_0's binary_logloss: 0.300483	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.3142
[55]	valid_0's auc: 0.921795	valid_0's binary_logloss: 0.299702	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.314181
[56]	valid_0's auc: 0.922088	valid_0's binary_logloss: 0.29912	valid_1's auc: 0.909452	valid_1's binary_logloss: 0.314208
[57]	valid_0's auc: 0.922427	valid_0's binary_logloss: 0.298476	valid_1's auc: 0.909426	valid_1's binary_logloss: 0.314258
[58]	valid_0's auc: 0.922606	valid_0's binary_logloss: 0.298081	valid_1's auc: 0.909423	valid_1's binary_logloss: 0.314268
[59]	valid_0's auc: 0.922862	valid_0's binary_logloss: 0.297566	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.314353
[60]	valid_0's auc: 0.923163	valid_0's binary_logloss: 0.297038	valid_1's auc: 0.909243	valid_1's binary_logloss: 0.314481
[61]	valid_0's auc: 0.923316	valid_0's binary_logloss: 0.296708	valid_1's auc: 0.909211	valid_1's binary_logloss: 0.314471
[62]	valid_0's auc: 0.923645	valid_0's binary_logloss: 0.29619	valid_1's auc: 0.909099	valid_1's binary_logloss: 0.314658
[63]	valid_0's auc: 0.923866	valid_0's binary_logloss: 0.295798	valid_1's auc: 0.909084	valid_1's binary_logloss: 0.314661
[64]	valid_0's auc: 0.9242	valid_0's binary_logloss: 0.295235	valid_1's auc: 0.908959	valid_1's binary_logloss: 0.314867
[65]	valid_0's auc: 0.924464	valid_0's binary_logloss: 0.294731	valid_1's auc: 0.908857	valid_1's binary_logloss: 0.314948
[66]	valid_0's auc: 0.924677	valid_0's binary_logloss: 0.294344	valid_1's auc: 0.9088	valid_1's binary_logloss: 0.315026
[67]	valid_0's auc: 0.925025	valid_0's binary_logloss: 0.293773	valid_1's auc: 0.908749	valid_1's binary_logloss: 0.315115
[68]	valid_0's auc: 0.92518	valid_0's binary_logloss: 0.293496	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.315227
[69]	valid_0's auc: 0.925456	valid_0's binary_logloss: 0.293047	valid_1's auc: 0.90862	valid_1's binary_logloss: 0.315335
[70]	valid_0's auc: 0.925634	valid_0's binary_logloss: 0.29272	valid_1's auc: 0.908646	valid_1's binary_logloss: 0.315359
[71]	valid_0's auc: 0.925872	valid_0's binary_logloss: 0.292262	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.315263
[72]	valid_0's auc: 0.926065	valid_0's binary_logloss: 0.291939	valid_1's auc: 0.908616	valid_1's binary_logloss: 0.315408
[73]	valid_0's auc: 0.926426	valid_0's binary_logloss: 0.291351	valid_1's auc: 0.908659	valid_1's binary_logloss: 0.315366
[74]	valid_0's auc: 0.926622	valid_0's binary_logloss: 0.290995	valid_1's auc: 0.908647	valid_1's binary_logloss: 0.315374
[75]	valid_0's auc: 0.92691	valid_0's binary_logloss: 0.290504	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.315337
[76]	valid_0's auc: 0.927022	valid_0's binary_logloss: 0.290284	valid_1's auc: 0.90854	valid_1's binary_logloss: 0.315519
[77]	valid_0's auc: 0.927277	valid_0's binary_logloss: 0.289798	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.315637
[78]	valid_0's auc: 0.927536	valid_0's binary_logloss: 0.289357	valid_1's auc: 0.908396	valid_1's binary_logloss: 0.315793
[79]	valid_0's auc: 0.927812	valid_0's binary_logloss: 0.288851	valid_1's auc: 0.908282	valid_1's binary_logloss: 0.316022
[80]	valid_0's auc: 0.928044	valid_0's binary_logloss: 0.28844	valid_1's auc: 0.908214	valid_1's binary_logloss: 0.316115
[81]	valid_0's auc: 0.928205	valid_0's binary_logloss: 0.288111	valid_1's auc: 0.908118	valid_1's binary_logloss: 0.316254
[82]	valid_0's auc: 0.928396	valid_0's binary_logloss: 0.287727	valid_1's auc: 0.90802	valid_1's binary_logloss: 0.316449
[83]	valid_0's auc: 0.928605	valid_0's binary_logloss: 0.287366	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.316466
[84]	valid_0's auc: 0.928839	valid_0's binary_logloss: 0.286971	valid_1's auc: 0.907933	valid_1's binary_logloss: 0.31662
[85]	valid_0's auc: 0.928915	valid_0's binary_logloss: 0.2868	valid_1's auc: 0.907916	valid_1's binary_logloss: 0.316654
[86]	valid_0's auc: 0.929181	valid_0's binary_logloss: 0.286319	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.316728
[87]	valid_0's auc: 0.929371	valid_0's binary_logloss: 0.285994	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.316765
[88]	valid_0's auc: 0.929502	valid_0's binary_logloss: 0.285761	valid_1's auc: 0.907916	valid_1's binary_logloss: 0.316743
[89]	valid_0's auc: 0.929659	valid_0's binary_logloss: 0.285429	valid_1's auc: 0.907961	valid_1's binary_logloss: 0.316672
[90]	valid_0's auc: 0.929931	valid_0's binary_logloss: 0.284982	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.316773
[91]	valid_0's auc: 0.93015	valid_0's binary_logloss: 0.2846	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.316769
[92]	valid_0's auc: 0.930368	valid_0's binary_logloss: 0.284197	valid_1's auc: 0.907787	valid_1's binary_logloss: 0.317005
[93]	valid_0's auc: 0.930583	valid_0's binary_logloss: 0.283829	valid_1's auc: 0.907746	valid_1's binary_logloss: 0.317083
[94]	valid_0's auc: 0.930804	valid_0's binary_logloss: 0.283453	valid_1's auc: 0.907833	valid_1's binary_logloss: 0.316959
[95]	valid_0's auc: 0.930997	valid_0's binary_logloss: 0.283092	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.31709
[96]	valid_0's auc: 0.931191	valid_0's binary_logloss: 0.282729	valid_1's auc: 0.907659	valid_1's binary_logloss: 0.317264
[97]	valid_0's auc: 0.931372	valid_0's binary_logloss: 0.282436	valid_1's auc: 0.907629	valid_1's binary_logloss: 0.317278
[98]	valid_0's auc: 0.931553	valid_0's binary_logloss: 0.282131	valid_1's auc: 0.907633	valid_1's binary_logloss: 0.317264
[99]	valid_0's auc: 0.931774	valid_0's binary_logloss: 0.281744	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.317429
[100]	valid_0's auc: 0.931904	valid_0's binary_logloss: 0.281482	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317349
[101]	valid_0's auc: 0.932084	valid_0's binary_logloss: 0.281156	valid_1's auc: 0.90758	valid_1's binary_logloss: 0.317376
[102]	valid_0's auc: 0.932305	valid_0's binary_logloss: 0.280757	valid_1's auc: 0.907474	valid_1's binary_logloss: 0.317591
[103]	valid_0's auc: 0.932607	valid_0's binary_logloss: 0.280266	valid_1's auc: 0.907353	valid_1's binary_logloss: 0.317736
[104]	valid_0's auc: 0.932796	valid_0's binary_logloss: 0.279974	valid_1's auc: 0.90731	valid_1's binary_logloss: 0.317816
[105]	valid_0's auc: 0.932951	valid_0's binary_logloss: 0.279695	valid_1's auc: 0.907265	valid_1's binary_logloss: 0.31795
[106]	valid_0's auc: 0.933104	valid_0's binary_logloss: 0.279431	valid_1's auc: 0.907172	valid_1's binary_logloss: 0.318088
[107]	valid_0's auc: 0.933257	valid_0's binary_logloss: 0.279174	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318058
[108]	valid_0's auc: 0.93343	valid_0's binary_logloss: 0.278857	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.318236
[109]	valid_0's auc: 0.933558	valid_0's binary_logloss: 0.278626	valid_1's auc: 0.907023	valid_1's binary_logloss: 0.318332
[110]	valid_0's auc: 0.933732	valid_0's binary_logloss: 0.278322	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318478
[111]	valid_0's auc: 0.933953	valid_0's binary_logloss: 0.277947	valid_1's auc: 0.906897	valid_1's binary_logloss: 0.318553
[112]	valid_0's auc: 0.934012	valid_0's binary_logloss: 0.277813	valid_1's auc: 0.906878	valid_1's binary_logloss: 0.318612
[113]	valid_0's auc: 0.934274	valid_0's binary_logloss: 0.27736	valid_1's auc: 0.906806	valid_1's binary_logloss: 0.318723
[114]	valid_0's auc: 0.934468	valid_0's binary_logloss: 0.277018	valid_1's auc: 0.906638	valid_1's binary_logloss: 0.319016
[115]	valid_0's auc: 0.934638	valid_0's binary_logloss: 0.27676	valid_1's auc: 0.906613	valid_1's binary_logloss: 0.319048
[116]	valid_0's auc: 0.934859	valid_0's binary_logloss: 0.276382	valid_1's auc: 0.906575	valid_1's binary_logloss: 0.31909
[117]	valid_0's auc: 0.934925	valid_0's binary_logloss: 0.276253	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.319189
[118]	valid_0's auc: 0.935133	valid_0's binary_logloss: 0.275888	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.319235
[119]	valid_0's auc: 0.935308	valid_0's binary_logloss: 0.275562	valid_1's auc: 0.906449	valid_1's binary_logloss: 0.319398
[120]	valid_0's auc: 0.935468	valid_0's binary_logloss: 0.275277	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.31929
[121]	valid_0's auc: 0.935668	valid_0's binary_logloss: 0.274917	valid_1's auc: 0.906467	valid_1's binary_logloss: 0.31938
[122]	valid_0's auc: 0.935807	valid_0's binary_logloss: 0.274678	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.319463
[123]	valid_0's auc: 0.936005	valid_0's binary_logloss: 0.2743	valid_1's auc: 0.906462	valid_1's binary_logloss: 0.319443
[124]	valid_0's auc: 0.936173	valid_0's binary_logloss: 0.273982	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319597
[125]	valid_0's auc: 0.936376	valid_0's binary_logloss: 0.273627	valid_1's auc: 0.906473	valid_1's binary_logloss: 0.319552
[126]	valid_0's auc: 0.936551	valid_0's binary_logloss: 0.273322	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.319885
[127]	valid_0's auc: 0.936745	valid_0's binary_logloss: 0.272991	valid_1's auc: 0.906121	valid_1's binary_logloss: 0.32011
[128]	valid_0's auc: 0.93691	valid_0's binary_logloss: 0.272682	valid_1's auc: 0.906086	valid_1's binary_logloss: 0.320223
[129]	valid_0's auc: 0.937074	valid_0's binary_logloss: 0.272395	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.320087
[130]	valid_0's auc: 0.937206	valid_0's binary_logloss: 0.272148	valid_1's auc: 0.906151	valid_1's binary_logloss: 0.32007
[131]	valid_0's auc: 0.93742	valid_0's binary_logloss: 0.271797	valid_1's auc: 0.906127	valid_1's binary_logloss: 0.320121
[132]	valid_0's auc: 0.937542	valid_0's binary_logloss: 0.271551	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.320187
[133]	valid_0's auc: 0.9377	valid_0's binary_logloss: 0.271277	valid_1's auc: 0.90604	valid_1's binary_logloss: 0.320381
[134]	valid_0's auc: 0.937735	valid_0's binary_logloss: 0.271221	valid_1's auc: 0.90598	valid_1's binary_logloss: 0.320479
[135]	valid_0's auc: 0.937769	valid_0's binary_logloss: 0.271166	valid_1's auc: 0.905914	valid_1's binary_logloss: 0.320599
[136]	valid_0's auc: 0.937933	valid_0's binary_logloss: 0.270894	valid_1's auc: 0.905932	valid_1's binary_logloss: 0.320674
[137]	valid_0's auc: 0.938118	valid_0's binary_logloss: 0.270562	valid_1's auc: 0.905833	valid_1's binary_logloss: 0.320836
[138]	valid_0's auc: 0.938331	valid_0's binary_logloss: 0.270171	valid_1's auc: 0.905794	valid_1's binary_logloss: 0.320872
[139]	valid_0's auc: 0.938497	valid_0's binary_logloss: 0.269823	valid_1's auc: 0.905847	valid_1's binary_logloss: 0.320815
[140]	valid_0's auc: 0.938624	valid_0's binary_logloss: 0.269606	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320907
[141]	valid_0's auc: 0.938678	valid_0's binary_logloss: 0.269487	valid_1's auc: 0.905873	valid_1's binary_logloss: 0.320891
Early stopping, best iteration is:
[41]	valid_0's auc: 0.917162	valid_0's binary_logloss: 0.308604	valid_1's auc: 0.909639	valid_1's binary_logloss: 0.3149
[1]	valid_0's auc: 0.886809	valid_0's binary_logloss: 0.517145	valid_1's auc: 0.89313	valid_1's binary_logloss: 0.508294
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89216	valid_0's binary_logloss: 0.488453	valid_1's auc: 0.898763	valid_1's binary_logloss: 0.478697
[3]	valid_0's auc: 0.893142	valid_0's binary_logloss: 0.465421	valid_1's auc: 0.900417	valid_1's binary_logloss: 0.455027
[4]	valid_0's auc: 0.894664	valid_0's binary_logloss: 0.446357	valid_1's auc: 0.90081	valid_1's binary_logloss: 0.435946
[5]	valid_0's auc: 0.896153	valid_0's binary_logloss: 0.430079	valid_1's auc: 0.901764	valid_1's binary_logloss: 0.419975
[6]	valid_0's auc: 0.897206	valid_0's binary_logloss: 0.416532	valid_1's auc: 0.902251	valid_1's binary_logloss: 0.40638
[7]	valid_0's auc: 0.898567	valid_0's binary_logloss: 0.404826	valid_1's auc: 0.903033	valid_1's binary_logloss: 0.394778
[8]	valid_0's auc: 0.899448	valid_0's binary_logloss: 0.394776	valid_1's auc: 0.903927	valid_1's binary_logloss: 0.384847
[9]	valid_0's auc: 0.900088	valid_0's binary_logloss: 0.386104	valid_1's auc: 0.904161	valid_1's binary_logloss: 0.37639
[10]	valid_0's auc: 0.901027	valid_0's binary_logloss: 0.378192	valid_1's auc: 0.904446	valid_1's binary_logloss: 0.369001
[11]	valid_0's auc: 0.901764	valid_0's binary_logloss: 0.371436	valid_1's auc: 0.904953	valid_1's binary_logloss: 0.362451
[12]	valid_0's auc: 0.902489	valid_0's binary_logloss: 0.365439	valid_1's auc: 0.904959	valid_1's binary_logloss: 0.357082
[13]	valid_0's auc: 0.903502	valid_0's binary_logloss: 0.360046	valid_1's auc: 0.905536	valid_1's binary_logloss: 0.352049
[14]	valid_0's auc: 0.904396	valid_0's binary_logloss: 0.355398	valid_1's auc: 0.905823	valid_1's binary_logloss: 0.34774
[15]	valid_0's auc: 0.904934	valid_0's binary_logloss: 0.351206	valid_1's auc: 0.906022	valid_1's binary_logloss: 0.344043
[16]	valid_0's auc: 0.905569	valid_0's binary_logloss: 0.347535	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.340724
[17]	valid_0's auc: 0.906055	valid_0's binary_logloss: 0.344217	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.337671
[18]	valid_0's auc: 0.906551	valid_0's binary_logloss: 0.341209	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.334811
[19]	valid_0's auc: 0.907641	valid_0's binary_logloss: 0.338006	valid_1's auc: 0.907893	valid_1's binary_logloss: 0.332332
[20]	valid_0's auc: 0.90819	valid_0's binary_logloss: 0.335486	valid_1's auc: 0.908373	valid_1's binary_logloss: 0.329934
[21]	valid_0's auc: 0.908964	valid_0's binary_logloss: 0.332971	valid_1's auc: 0.90855	valid_1's binary_logloss: 0.32818
[22]	valid_0's auc: 0.909547	valid_0's binary_logloss: 0.330718	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.326522
[23]	valid_0's auc: 0.910058	valid_0's binary_logloss: 0.328697	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.325272
[24]	valid_0's auc: 0.910606	valid_0's binary_logloss: 0.326753	valid_1's auc: 0.908869	valid_1's binary_logloss: 0.323869
[25]	valid_0's auc: 0.911109	valid_0's binary_logloss: 0.324964	valid_1's auc: 0.909069	valid_1's binary_logloss: 0.322625
[26]	valid_0's auc: 0.911732	valid_0's binary_logloss: 0.323322	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.321654
[27]	valid_0's auc: 0.912288	valid_0's binary_logloss: 0.321716	valid_1's auc: 0.909162	valid_1's binary_logloss: 0.321004
[28]	valid_0's auc: 0.912703	valid_0's binary_logloss: 0.320322	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.320072
[29]	valid_0's auc: 0.913164	valid_0's binary_logloss: 0.318981	valid_1's auc: 0.90934	valid_1's binary_logloss: 0.319466
[30]	valid_0's auc: 0.913641	valid_0's binary_logloss: 0.317667	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.318834
[31]	valid_0's auc: 0.914029	valid_0's binary_logloss: 0.316637	valid_1's auc: 0.909567	valid_1's binary_logloss: 0.318209
[32]	valid_0's auc: 0.914472	valid_0's binary_logloss: 0.31551	valid_1's auc: 0.909657	valid_1's binary_logloss: 0.317686
[33]	valid_0's auc: 0.914852	valid_0's binary_logloss: 0.314576	valid_1's auc: 0.909778	valid_1's binary_logloss: 0.317205
[34]	valid_0's auc: 0.915237	valid_0's binary_logloss: 0.31355	valid_1's auc: 0.909801	valid_1's binary_logloss: 0.316731
[35]	valid_0's auc: 0.915653	valid_0's binary_logloss: 0.312657	valid_1's auc: 0.909855	valid_1's binary_logloss: 0.316376
[36]	valid_0's auc: 0.915976	valid_0's binary_logloss: 0.311797	valid_1's auc: 0.90981	valid_1's binary_logloss: 0.316174
[37]	valid_0's auc: 0.916279	valid_0's binary_logloss: 0.311071	valid_1's auc: 0.909893	valid_1's binary_logloss: 0.315847
[38]	valid_0's auc: 0.916637	valid_0's binary_logloss: 0.310222	valid_1's auc: 0.909867	valid_1's binary_logloss: 0.315592
[39]	valid_0's auc: 0.917042	valid_0's binary_logloss: 0.309337	valid_1's auc: 0.909799	valid_1's binary_logloss: 0.315496
[40]	valid_0's auc: 0.917355	valid_0's binary_logloss: 0.308607	valid_1's auc: 0.909819	valid_1's binary_logloss: 0.315243
[41]	valid_0's auc: 0.917701	valid_0's binary_logloss: 0.307828	valid_1's auc: 0.909946	valid_1's binary_logloss: 0.314876
[42]	valid_0's auc: 0.91791	valid_0's binary_logloss: 0.307312	valid_1's auc: 0.909868	valid_1's binary_logloss: 0.314873
[43]	valid_0's auc: 0.918213	valid_0's binary_logloss: 0.306626	valid_1's auc: 0.909911	valid_1's binary_logloss: 0.314674
[44]	valid_0's auc: 0.918685	valid_0's binary_logloss: 0.305763	valid_1's auc: 0.910019	valid_1's binary_logloss: 0.314403
[45]	valid_0's auc: 0.919016	valid_0's binary_logloss: 0.305061	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.314482
[46]	valid_0's auc: 0.919317	valid_0's binary_logloss: 0.304415	valid_1's auc: 0.90993	valid_1's binary_logloss: 0.314315
[47]	valid_0's auc: 0.919643	valid_0's binary_logloss: 0.303774	valid_1's auc: 0.91001	valid_1's binary_logloss: 0.314116
[48]	valid_0's auc: 0.919876	valid_0's binary_logloss: 0.303313	valid_1's auc: 0.910168	valid_1's binary_logloss: 0.313836
[49]	valid_0's auc: 0.920177	valid_0's binary_logloss: 0.302649	valid_1's auc: 0.91025	valid_1's binary_logloss: 0.3136
[50]	valid_0's auc: 0.920349	valid_0's binary_logloss: 0.302246	valid_1's auc: 0.910222	valid_1's binary_logloss: 0.313564
[51]	valid_0's auc: 0.920706	valid_0's binary_logloss: 0.301598	valid_1's auc: 0.910294	valid_1's binary_logloss: 0.313402
[52]	valid_0's auc: 0.920921	valid_0's binary_logloss: 0.301137	valid_1's auc: 0.910263	valid_1's binary_logloss: 0.31342
[53]	valid_0's auc: 0.921298	valid_0's binary_logloss: 0.300471	valid_1's auc: 0.910231	valid_1's binary_logloss: 0.313349
[54]	valid_0's auc: 0.921585	valid_0's binary_logloss: 0.299963	valid_1's auc: 0.910234	valid_1's binary_logloss: 0.313302
[55]	valid_0's auc: 0.921697	valid_0's binary_logloss: 0.299732	valid_1's auc: 0.910245	valid_1's binary_logloss: 0.313266
[56]	valid_0's auc: 0.922057	valid_0's binary_logloss: 0.299048	valid_1's auc: 0.91021	valid_1's binary_logloss: 0.313286
[57]	valid_0's auc: 0.922272	valid_0's binary_logloss: 0.298589	valid_1's auc: 0.910227	valid_1's binary_logloss: 0.313215
[58]	valid_0's auc: 0.922627	valid_0's binary_logloss: 0.297913	valid_1's auc: 0.910163	valid_1's binary_logloss: 0.31331
[59]	valid_0's auc: 0.922844	valid_0's binary_logloss: 0.297475	valid_1's auc: 0.910196	valid_1's binary_logloss: 0.313274
[60]	valid_0's auc: 0.923142	valid_0's binary_logloss: 0.296931	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.313461
[61]	valid_0's auc: 0.923408	valid_0's binary_logloss: 0.29645	valid_1's auc: 0.909899	valid_1's binary_logloss: 0.313659
[62]	valid_0's auc: 0.923753	valid_0's binary_logloss: 0.295876	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.313769
[63]	valid_0's auc: 0.923918	valid_0's binary_logloss: 0.295573	valid_1's auc: 0.909839	valid_1's binary_logloss: 0.313806
[64]	valid_0's auc: 0.924058	valid_0's binary_logloss: 0.295292	valid_1's auc: 0.909802	valid_1's binary_logloss: 0.313854
[65]	valid_0's auc: 0.924295	valid_0's binary_logloss: 0.294827	valid_1's auc: 0.909754	valid_1's binary_logloss: 0.31389
[66]	valid_0's auc: 0.924591	valid_0's binary_logloss: 0.294336	valid_1's auc: 0.909557	valid_1's binary_logloss: 0.314177
[67]	valid_0's auc: 0.924695	valid_0's binary_logloss: 0.294118	valid_1's auc: 0.909637	valid_1's binary_logloss: 0.314063
[68]	valid_0's auc: 0.92506	valid_0's binary_logloss: 0.293509	valid_1's auc: 0.90968	valid_1's binary_logloss: 0.314033
[69]	valid_0's auc: 0.925381	valid_0's binary_logloss: 0.292937	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.314218
[70]	valid_0's auc: 0.925704	valid_0's binary_logloss: 0.292351	valid_1's auc: 0.909505	valid_1's binary_logloss: 0.314355
[71]	valid_0's auc: 0.926066	valid_0's binary_logloss: 0.291815	valid_1's auc: 0.909454	valid_1's binary_logloss: 0.314434
[72]	valid_0's auc: 0.926392	valid_0's binary_logloss: 0.291233	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.314452
[73]	valid_0's auc: 0.926687	valid_0's binary_logloss: 0.290731	valid_1's auc: 0.909389	valid_1's binary_logloss: 0.314558
[74]	valid_0's auc: 0.926863	valid_0's binary_logloss: 0.290417	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.314633
[75]	valid_0's auc: 0.927058	valid_0's binary_logloss: 0.290045	valid_1's auc: 0.909244	valid_1's binary_logloss: 0.314776
[76]	valid_0's auc: 0.927263	valid_0's binary_logloss: 0.289688	valid_1's auc: 0.909167	valid_1's binary_logloss: 0.314921
[77]	valid_0's auc: 0.927689	valid_0's binary_logloss: 0.288981	valid_1's auc: 0.909179	valid_1's binary_logloss: 0.314832
[78]	valid_0's auc: 0.927919	valid_0's binary_logloss: 0.288578	valid_1's auc: 0.909109	valid_1's binary_logloss: 0.314948
[79]	valid_0's auc: 0.928059	valid_0's binary_logloss: 0.288347	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.315034
[80]	valid_0's auc: 0.928365	valid_0's binary_logloss: 0.287803	valid_1's auc: 0.909176	valid_1's binary_logloss: 0.314929
[81]	valid_0's auc: 0.928568	valid_0's binary_logloss: 0.287417	valid_1's auc: 0.909032	valid_1's binary_logloss: 0.315136
[82]	valid_0's auc: 0.92872	valid_0's binary_logloss: 0.28717	valid_1's auc: 0.909108	valid_1's binary_logloss: 0.315059
[83]	valid_0's auc: 0.92888	valid_0's binary_logloss: 0.286886	valid_1's auc: 0.909067	valid_1's binary_logloss: 0.31514
[84]	valid_0's auc: 0.929183	valid_0's binary_logloss: 0.286369	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.315224
[85]	valid_0's auc: 0.929482	valid_0's binary_logloss: 0.285895	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.315277
[86]	valid_0's auc: 0.929739	valid_0's binary_logloss: 0.285461	valid_1's auc: 0.90904	valid_1's binary_logloss: 0.315297
[87]	valid_0's auc: 0.929925	valid_0's binary_logloss: 0.285139	valid_1's auc: 0.908926	valid_1's binary_logloss: 0.315499
[88]	valid_0's auc: 0.930169	valid_0's binary_logloss: 0.2847	valid_1's auc: 0.908899	valid_1's binary_logloss: 0.315544
[89]	valid_0's auc: 0.930365	valid_0's binary_logloss: 0.284347	valid_1's auc: 0.908884	valid_1's binary_logloss: 0.315591
[90]	valid_0's auc: 0.930587	valid_0's binary_logloss: 0.283946	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.315658
[91]	valid_0's auc: 0.93075	valid_0's binary_logloss: 0.283696	valid_1's auc: 0.908728	valid_1's binary_logloss: 0.315867
[92]	valid_0's auc: 0.930981	valid_0's binary_logloss: 0.283342	valid_1's auc: 0.908746	valid_1's binary_logloss: 0.315862
[93]	valid_0's auc: 0.931177	valid_0's binary_logloss: 0.28298	valid_1's auc: 0.908636	valid_1's binary_logloss: 0.316031
[94]	valid_0's auc: 0.93136	valid_0's binary_logloss: 0.282631	valid_1's auc: 0.908576	valid_1's binary_logloss: 0.316121
[95]	valid_0's auc: 0.931666	valid_0's binary_logloss: 0.28212	valid_1's auc: 0.908527	valid_1's binary_logloss: 0.316188
[96]	valid_0's auc: 0.931787	valid_0's binary_logloss: 0.281858	valid_1's auc: 0.908518	valid_1's binary_logloss: 0.316223
[97]	valid_0's auc: 0.931907	valid_0's binary_logloss: 0.281655	valid_1's auc: 0.908519	valid_1's binary_logloss: 0.316246
[98]	valid_0's auc: 0.9321	valid_0's binary_logloss: 0.281286	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.316424
[99]	valid_0's auc: 0.932193	valid_0's binary_logloss: 0.281118	valid_1's auc: 0.908408	valid_1's binary_logloss: 0.316464
[100]	valid_0's auc: 0.932369	valid_0's binary_logloss: 0.280841	valid_1's auc: 0.908268	valid_1's binary_logloss: 0.316661
[101]	valid_0's auc: 0.932661	valid_0's binary_logloss: 0.28034	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.316955
[102]	valid_0's auc: 0.932826	valid_0's binary_logloss: 0.280049	valid_1's auc: 0.908069	valid_1's binary_logloss: 0.317018
[103]	valid_0's auc: 0.933014	valid_0's binary_logloss: 0.279725	valid_1's auc: 0.908021	valid_1's binary_logloss: 0.317085
[104]	valid_0's auc: 0.933166	valid_0's binary_logloss: 0.279473	valid_1's auc: 0.907929	valid_1's binary_logloss: 0.317241
[105]	valid_0's auc: 0.933321	valid_0's binary_logloss: 0.279207	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.31726
[106]	valid_0's auc: 0.933581	valid_0's binary_logloss: 0.278748	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.317267
[107]	valid_0's auc: 0.933698	valid_0's binary_logloss: 0.278542	valid_1's auc: 0.90794	valid_1's binary_logloss: 0.317308
[108]	valid_0's auc: 0.933821	valid_0's binary_logloss: 0.278321	valid_1's auc: 0.907919	valid_1's binary_logloss: 0.317375
[109]	valid_0's auc: 0.933888	valid_0's binary_logloss: 0.27822	valid_1's auc: 0.907898	valid_1's binary_logloss: 0.317388
[110]	valid_0's auc: 0.934064	valid_0's binary_logloss: 0.277874	valid_1's auc: 0.907812	valid_1's binary_logloss: 0.317555
[111]	valid_0's auc: 0.934327	valid_0's binary_logloss: 0.277437	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.317713
[112]	valid_0's auc: 0.934544	valid_0's binary_logloss: 0.277065	valid_1's auc: 0.907635	valid_1's binary_logloss: 0.317884
[113]	valid_0's auc: 0.934611	valid_0's binary_logloss: 0.276948	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.317942
[114]	valid_0's auc: 0.934754	valid_0's binary_logloss: 0.276625	valid_1's auc: 0.907642	valid_1's binary_logloss: 0.317983
[115]	valid_0's auc: 0.934975	valid_0's binary_logloss: 0.276261	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.318194
[116]	valid_0's auc: 0.935169	valid_0's binary_logloss: 0.275939	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.318353
[117]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.275729	valid_1's auc: 0.907339	valid_1's binary_logloss: 0.318545
[118]	valid_0's auc: 0.935438	valid_0's binary_logloss: 0.275487	valid_1's auc: 0.907353	valid_1's binary_logloss: 0.318587
[119]	valid_0's auc: 0.935658	valid_0's binary_logloss: 0.27512	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.318633
[120]	valid_0's auc: 0.935802	valid_0's binary_logloss: 0.274844	valid_1's auc: 0.907275	valid_1's binary_logloss: 0.318715
[121]	valid_0's auc: 0.936013	valid_0's binary_logloss: 0.274488	valid_1's auc: 0.907205	valid_1's binary_logloss: 0.318872
[122]	valid_0's auc: 0.936204	valid_0's binary_logloss: 0.274157	valid_1's auc: 0.907177	valid_1's binary_logloss: 0.318962
[123]	valid_0's auc: 0.936337	valid_0's binary_logloss: 0.273926	valid_1's auc: 0.907094	valid_1's binary_logloss: 0.319126
[124]	valid_0's auc: 0.936498	valid_0's binary_logloss: 0.273636	valid_1's auc: 0.907081	valid_1's binary_logloss: 0.319178
[125]	valid_0's auc: 0.936675	valid_0's binary_logloss: 0.273302	valid_1's auc: 0.906984	valid_1's binary_logloss: 0.319317
[126]	valid_0's auc: 0.936776	valid_0's binary_logloss: 0.273149	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.319331
[127]	valid_0's auc: 0.93689	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.319368
[128]	valid_0's auc: 0.937077	valid_0's binary_logloss: 0.272605	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.319397
[129]	valid_0's auc: 0.937324	valid_0's binary_logloss: 0.272162	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.319597
[130]	valid_0's auc: 0.93747	valid_0's binary_logloss: 0.271892	valid_1's auc: 0.90684	valid_1's binary_logloss: 0.319663
[131]	valid_0's auc: 0.937649	valid_0's binary_logloss: 0.271597	valid_1's auc: 0.90672	valid_1's binary_logloss: 0.319891
[132]	valid_0's auc: 0.937821	valid_0's binary_logloss: 0.271277	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.319871
[133]	valid_0's auc: 0.937978	valid_0's binary_logloss: 0.270996	valid_1's auc: 0.906701	valid_1's binary_logloss: 0.319963
[134]	valid_0's auc: 0.938099	valid_0's binary_logloss: 0.270759	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.319974
[135]	valid_0's auc: 0.938254	valid_0's binary_logloss: 0.270458	valid_1's auc: 0.906758	valid_1's binary_logloss: 0.319938
[136]	valid_0's auc: 0.938492	valid_0's binary_logloss: 0.270064	valid_1's auc: 0.906781	valid_1's binary_logloss: 0.319962
[137]	valid_0's auc: 0.938675	valid_0's binary_logloss: 0.269735	valid_1's auc: 0.906837	valid_1's binary_logloss: 0.319855
[138]	valid_0's auc: 0.938811	valid_0's binary_logloss: 0.269492	valid_1's auc: 0.906887	valid_1's binary_logloss: 0.319759
[139]	valid_0's auc: 0.939007	valid_0's binary_logloss: 0.269148	valid_1's auc: 0.906784	valid_1's binary_logloss: 0.319974
[140]	valid_0's auc: 0.939196	valid_0's binary_logloss: 0.268795	valid_1's auc: 0.906671	valid_1's binary_logloss: 0.320188
[141]	valid_0's auc: 0.939263	valid_0's binary_logloss: 0.268669	valid_1's auc: 0.906668	valid_1's binary_logloss: 0.320225
[142]	valid_0's auc: 0.939523	valid_0's binary_logloss: 0.268238	valid_1's auc: 0.906601	valid_1's binary_logloss: 0.320365
[143]	valid_0's auc: 0.939667	valid_0's binary_logloss: 0.267985	valid_1's auc: 0.906498	valid_1's binary_logloss: 0.320565
[144]	valid_0's auc: 0.93981	valid_0's binary_logloss: 0.267715	valid_1's auc: 0.906369	valid_1's binary_logloss: 0.32077
[145]	valid_0's auc: 0.939975	valid_0's binary_logloss: 0.267408	valid_1's auc: 0.906251	valid_1's binary_logloss: 0.320988
[146]	valid_0's auc: 0.940066	valid_0's binary_logloss: 0.267248	valid_1's auc: 0.906272	valid_1's binary_logloss: 0.320964
[147]	valid_0's auc: 0.940152	valid_0's binary_logloss: 0.26711	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.320942
[148]	valid_0's auc: 0.940358	valid_0's binary_logloss: 0.266717	valid_1's auc: 0.906162	valid_1's binary_logloss: 0.321257
[149]	valid_0's auc: 0.940566	valid_0's binary_logloss: 0.266371	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321599
[150]	valid_0's auc: 0.940659	valid_0's binary_logloss: 0.266164	valid_1's auc: 0.905894	valid_1's binary_logloss: 0.321786
[151]	valid_0's auc: 0.94085	valid_0's binary_logloss: 0.265815	valid_1's auc: 0.905868	valid_1's binary_logloss: 0.321815
Early stopping, best iteration is:
[51]	valid_0's auc: 0.920706	valid_0's binary_logloss: 0.301598	valid_1's auc: 0.910294	valid_1's binary_logloss: 0.313402
[1]	valid_0's auc: 0.886366	valid_0's binary_logloss: 0.517423	valid_1's auc: 0.892799	valid_1's binary_logloss: 0.508777
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.888759	valid_0's binary_logloss: 0.488556	valid_1's auc: 0.895152	valid_1's binary_logloss: 0.479361
[3]	valid_0's auc: 0.892643	valid_0's binary_logloss: 0.465454	valid_1's auc: 0.896898	valid_1's binary_logloss: 0.456014
[4]	valid_0's auc: 0.895125	valid_0's binary_logloss: 0.446087	valid_1's auc: 0.898809	valid_1's binary_logloss: 0.436623
[5]	valid_0's auc: 0.896757	valid_0's binary_logloss: 0.429967	valid_1's auc: 0.900346	valid_1's binary_logloss: 0.420554
[6]	valid_0's auc: 0.897595	valid_0's binary_logloss: 0.416415	valid_1's auc: 0.90118	valid_1's binary_logloss: 0.406888
[7]	valid_0's auc: 0.898389	valid_0's binary_logloss: 0.404783	valid_1's auc: 0.902115	valid_1's binary_logloss: 0.395137
[8]	valid_0's auc: 0.899254	valid_0's binary_logloss: 0.39474	valid_1's auc: 0.90328	valid_1's binary_logloss: 0.384959
[9]	valid_0's auc: 0.900112	valid_0's binary_logloss: 0.386002	valid_1's auc: 0.903808	valid_1's binary_logloss: 0.376579
[10]	valid_0's auc: 0.900897	valid_0's binary_logloss: 0.378409	valid_1's auc: 0.903466	valid_1's binary_logloss: 0.36976
[11]	valid_0's auc: 0.901567	valid_0's binary_logloss: 0.371769	valid_1's auc: 0.903577	valid_1's binary_logloss: 0.363767
[12]	valid_0's auc: 0.90237	valid_0's binary_logloss: 0.365834	valid_1's auc: 0.903726	valid_1's binary_logloss: 0.358346
[13]	valid_0's auc: 0.903362	valid_0's binary_logloss: 0.360672	valid_1's auc: 0.90434	valid_1's binary_logloss: 0.353454
[14]	valid_0's auc: 0.904131	valid_0's binary_logloss: 0.355963	valid_1's auc: 0.904464	valid_1's binary_logloss: 0.349327
[15]	valid_0's auc: 0.904883	valid_0's binary_logloss: 0.351582	valid_1's auc: 0.904861	valid_1's binary_logloss: 0.345397
[16]	valid_0's auc: 0.905702	valid_0's binary_logloss: 0.34777	valid_1's auc: 0.905292	valid_1's binary_logloss: 0.342089
[17]	valid_0's auc: 0.906274	valid_0's binary_logloss: 0.34436	valid_1's auc: 0.905994	valid_1's binary_logloss: 0.339027
[18]	valid_0's auc: 0.906857	valid_0's binary_logloss: 0.341298	valid_1's auc: 0.906403	valid_1's binary_logloss: 0.336268
[19]	valid_0's auc: 0.907659	valid_0's binary_logloss: 0.338307	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.334276
[20]	valid_0's auc: 0.908416	valid_0's binary_logloss: 0.33563	valid_1's auc: 0.906586	valid_1's binary_logloss: 0.332392
[21]	valid_0's auc: 0.909067	valid_0's binary_logloss: 0.33313	valid_1's auc: 0.906681	valid_1's binary_logloss: 0.330627
[22]	valid_0's auc: 0.909696	valid_0's binary_logloss: 0.330901	valid_1's auc: 0.906783	valid_1's binary_logloss: 0.329174
[23]	valid_0's auc: 0.910208	valid_0's binary_logloss: 0.328885	valid_1's auc: 0.906922	valid_1's binary_logloss: 0.327663
[24]	valid_0's auc: 0.910854	valid_0's binary_logloss: 0.326932	valid_1's auc: 0.906875	valid_1's binary_logloss: 0.326583
[25]	valid_0's auc: 0.911462	valid_0's binary_logloss: 0.325177	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.325404
[26]	valid_0's auc: 0.911941	valid_0's binary_logloss: 0.323554	valid_1's auc: 0.907173	valid_1's binary_logloss: 0.324396
[27]	valid_0's auc: 0.912441	valid_0's binary_logloss: 0.322019	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.32328
[28]	valid_0's auc: 0.912892	valid_0's binary_logloss: 0.320592	valid_1's auc: 0.907588	valid_1's binary_logloss: 0.32251
[29]	valid_0's auc: 0.913249	valid_0's binary_logloss: 0.319368	valid_1's auc: 0.907691	valid_1's binary_logloss: 0.321745
[30]	valid_0's auc: 0.913691	valid_0's binary_logloss: 0.318139	valid_1's auc: 0.907786	valid_1's binary_logloss: 0.321144
[31]	valid_0's auc: 0.914103	valid_0's binary_logloss: 0.317021	valid_1's auc: 0.907843	valid_1's binary_logloss: 0.320645
[32]	valid_0's auc: 0.914525	valid_0's binary_logloss: 0.315901	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.320157
[33]	valid_0's auc: 0.91497	valid_0's binary_logloss: 0.314792	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.31978
[34]	valid_0's auc: 0.915343	valid_0's binary_logloss: 0.313791	valid_1's auc: 0.907981	valid_1's binary_logloss: 0.319378
[35]	valid_0's auc: 0.915854	valid_0's binary_logloss: 0.312648	valid_1's auc: 0.908065	valid_1's binary_logloss: 0.318974
[36]	valid_0's auc: 0.916195	valid_0's binary_logloss: 0.311759	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.318688
[37]	valid_0's auc: 0.916517	valid_0's binary_logloss: 0.310935	valid_1's auc: 0.908101	valid_1's binary_logloss: 0.318433
[38]	valid_0's auc: 0.916955	valid_0's binary_logloss: 0.310028	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.318329
[39]	valid_0's auc: 0.91725	valid_0's binary_logloss: 0.309359	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.318062
[40]	valid_0's auc: 0.917563	valid_0's binary_logloss: 0.308638	valid_1's auc: 0.908172	valid_1's binary_logloss: 0.317796
[41]	valid_0's auc: 0.917898	valid_0's binary_logloss: 0.307912	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.31778
[42]	valid_0's auc: 0.918183	valid_0's binary_logloss: 0.307214	valid_1's auc: 0.908204	valid_1's binary_logloss: 0.31746
[43]	valid_0's auc: 0.91853	valid_0's binary_logloss: 0.306483	valid_1's auc: 0.908167	valid_1's binary_logloss: 0.317323
[44]	valid_0's auc: 0.918753	valid_0's binary_logloss: 0.30599	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.31725
[45]	valid_0's auc: 0.919127	valid_0's binary_logloss: 0.305242	valid_1's auc: 0.908236	valid_1's binary_logloss: 0.31705
[46]	valid_0's auc: 0.919499	valid_0's binary_logloss: 0.304477	valid_1's auc: 0.90824	valid_1's binary_logloss: 0.316967
[47]	valid_0's auc: 0.919805	valid_0's binary_logloss: 0.30392	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.316871
[48]	valid_0's auc: 0.920216	valid_0's binary_logloss: 0.303115	valid_1's auc: 0.908303	valid_1's binary_logloss: 0.316766
[49]	valid_0's auc: 0.920547	valid_0's binary_logloss: 0.302456	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316621
[50]	valid_0's auc: 0.920997	valid_0's binary_logloss: 0.301643	valid_1's auc: 0.908315	valid_1's binary_logloss: 0.316526
[51]	valid_0's auc: 0.921225	valid_0's binary_logloss: 0.301202	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.316648
[52]	valid_0's auc: 0.921509	valid_0's binary_logloss: 0.300592	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.31681
[53]	valid_0's auc: 0.921739	valid_0's binary_logloss: 0.300107	valid_1's auc: 0.907957	valid_1's binary_logloss: 0.316874
[54]	valid_0's auc: 0.922008	valid_0's binary_logloss: 0.29959	valid_1's auc: 0.907976	valid_1's binary_logloss: 0.316796
[55]	valid_0's auc: 0.922297	valid_0's binary_logloss: 0.299045	valid_1's auc: 0.907953	valid_1's binary_logloss: 0.3168
[56]	valid_0's auc: 0.92252	valid_0's binary_logloss: 0.298633	valid_1's auc: 0.907853	valid_1's binary_logloss: 0.31694
[57]	valid_0's auc: 0.922752	valid_0's binary_logloss: 0.298204	valid_1's auc: 0.907623	valid_1's binary_logloss: 0.317225
[58]	valid_0's auc: 0.922979	valid_0's binary_logloss: 0.297733	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317057
[59]	valid_0's auc: 0.923122	valid_0's binary_logloss: 0.297462	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.317103
[60]	valid_0's auc: 0.923342	valid_0's binary_logloss: 0.297069	valid_1's auc: 0.907652	valid_1's binary_logloss: 0.317152
[61]	valid_0's auc: 0.923574	valid_0's binary_logloss: 0.296649	valid_1's auc: 0.907696	valid_1's binary_logloss: 0.31704
[62]	valid_0's auc: 0.923958	valid_0's binary_logloss: 0.296068	valid_1's auc: 0.907619	valid_1's binary_logloss: 0.317148
[63]	valid_0's auc: 0.924116	valid_0's binary_logloss: 0.295744	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.317086
[64]	valid_0's auc: 0.924297	valid_0's binary_logloss: 0.29538	valid_1's auc: 0.907596	valid_1's binary_logloss: 0.317207
[65]	valid_0's auc: 0.924734	valid_0's binary_logloss: 0.294622	valid_1's auc: 0.907576	valid_1's binary_logloss: 0.317288
[66]	valid_0's auc: 0.925002	valid_0's binary_logloss: 0.294135	valid_1's auc: 0.907608	valid_1's binary_logloss: 0.317294
[67]	valid_0's auc: 0.925092	valid_0's binary_logloss: 0.293939	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.317429
[68]	valid_0's auc: 0.925416	valid_0's binary_logloss: 0.2934	valid_1's auc: 0.907464	valid_1's binary_logloss: 0.317472
[69]	valid_0's auc: 0.925541	valid_0's binary_logloss: 0.293154	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.317534
[70]	valid_0's auc: 0.925768	valid_0's binary_logloss: 0.292749	valid_1's auc: 0.907396	valid_1's binary_logloss: 0.317547
[71]	valid_0's auc: 0.926107	valid_0's binary_logloss: 0.292137	valid_1's auc: 0.907567	valid_1's binary_logloss: 0.31729
[72]	valid_0's auc: 0.92625	valid_0's binary_logloss: 0.291864	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.317276
[73]	valid_0's auc: 0.926569	valid_0's binary_logloss: 0.291314	valid_1's auc: 0.907559	valid_1's binary_logloss: 0.317353
[74]	valid_0's auc: 0.926792	valid_0's binary_logloss: 0.290926	valid_1's auc: 0.907439	valid_1's binary_logloss: 0.317581
[75]	valid_0's auc: 0.927024	valid_0's binary_logloss: 0.290456	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.317735
[76]	valid_0's auc: 0.927335	valid_0's binary_logloss: 0.289885	valid_1's auc: 0.9073	valid_1's binary_logloss: 0.317856
[77]	valid_0's auc: 0.927694	valid_0's binary_logloss: 0.289303	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.317909
[78]	valid_0's auc: 0.927793	valid_0's binary_logloss: 0.289109	valid_1's auc: 0.907301	valid_1's binary_logloss: 0.317898
[79]	valid_0's auc: 0.927935	valid_0's binary_logloss: 0.288796	valid_1's auc: 0.907202	valid_1's binary_logloss: 0.318065
[80]	valid_0's auc: 0.928178	valid_0's binary_logloss: 0.288342	valid_1's auc: 0.90704	valid_1's binary_logloss: 0.318338
[81]	valid_0's auc: 0.928345	valid_0's binary_logloss: 0.288069	valid_1's auc: 0.906983	valid_1's binary_logloss: 0.31846
[82]	valid_0's auc: 0.928521	valid_0's binary_logloss: 0.287765	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318496
[83]	valid_0's auc: 0.92863	valid_0's binary_logloss: 0.287568	valid_1's auc: 0.906936	valid_1's binary_logloss: 0.318539
[84]	valid_0's auc: 0.928904	valid_0's binary_logloss: 0.287083	valid_1's auc: 0.906931	valid_1's binary_logloss: 0.318601
[85]	valid_0's auc: 0.929163	valid_0's binary_logloss: 0.286607	valid_1's auc: 0.90688	valid_1's binary_logloss: 0.318667
[86]	valid_0's auc: 0.92939	valid_0's binary_logloss: 0.286236	valid_1's auc: 0.906897	valid_1's binary_logloss: 0.318704
[87]	valid_0's auc: 0.92963	valid_0's binary_logloss: 0.285798	valid_1's auc: 0.906864	valid_1's binary_logloss: 0.318823
[88]	valid_0's auc: 0.929929	valid_0's binary_logloss: 0.285278	valid_1's auc: 0.906767	valid_1's binary_logloss: 0.318992
[89]	valid_0's auc: 0.930176	valid_0's binary_logloss: 0.284858	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319028
[90]	valid_0's auc: 0.93037	valid_0's binary_logloss: 0.284508	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319154
[91]	valid_0's auc: 0.930645	valid_0's binary_logloss: 0.284006	valid_1's auc: 0.906702	valid_1's binary_logloss: 0.319049
[92]	valid_0's auc: 0.930797	valid_0's binary_logloss: 0.283757	valid_1's auc: 0.906653	valid_1's binary_logloss: 0.319186
[93]	valid_0's auc: 0.931018	valid_0's binary_logloss: 0.283359	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.319162
[94]	valid_0's auc: 0.931199	valid_0's binary_logloss: 0.283027	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319256
[95]	valid_0's auc: 0.9314	valid_0's binary_logloss: 0.282685	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319366
[96]	valid_0's auc: 0.931613	valid_0's binary_logloss: 0.282289	valid_1's auc: 0.906409	valid_1's binary_logloss: 0.319682
[97]	valid_0's auc: 0.931727	valid_0's binary_logloss: 0.282092	valid_1's auc: 0.906365	valid_1's binary_logloss: 0.319761
[98]	valid_0's auc: 0.93194	valid_0's binary_logloss: 0.28168	valid_1's auc: 0.906287	valid_1's binary_logloss: 0.319938
[99]	valid_0's auc: 0.932213	valid_0's binary_logloss: 0.281208	valid_1's auc: 0.906245	valid_1's binary_logloss: 0.320031
[100]	valid_0's auc: 0.932323	valid_0's binary_logloss: 0.281015	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.320026
[101]	valid_0's auc: 0.932581	valid_0's binary_logloss: 0.280575	valid_1's auc: 0.906104	valid_1's binary_logloss: 0.320294
[102]	valid_0's auc: 0.932664	valid_0's binary_logloss: 0.280422	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.320473
[103]	valid_0's auc: 0.932929	valid_0's binary_logloss: 0.279973	valid_1's auc: 0.905977	valid_1's binary_logloss: 0.32058
[104]	valid_0's auc: 0.933123	valid_0's binary_logloss: 0.279623	valid_1's auc: 0.905918	valid_1's binary_logloss: 0.320704
[105]	valid_0's auc: 0.933345	valid_0's binary_logloss: 0.279226	valid_1's auc: 0.905898	valid_1's binary_logloss: 0.320753
[106]	valid_0's auc: 0.933618	valid_0's binary_logloss: 0.278748	valid_1's auc: 0.905835	valid_1's binary_logloss: 0.320856
[107]	valid_0's auc: 0.93373	valid_0's binary_logloss: 0.278553	valid_1's auc: 0.905786	valid_1's binary_logloss: 0.32095
[108]	valid_0's auc: 0.933922	valid_0's binary_logloss: 0.278212	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.321101
[109]	valid_0's auc: 0.933991	valid_0's binary_logloss: 0.278067	valid_1's auc: 0.905709	valid_1's binary_logloss: 0.321143
[110]	valid_0's auc: 0.934211	valid_0's binary_logloss: 0.277688	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.321332
[111]	valid_0's auc: 0.934319	valid_0's binary_logloss: 0.277473	valid_1's auc: 0.905618	valid_1's binary_logloss: 0.321341
[112]	valid_0's auc: 0.934538	valid_0's binary_logloss: 0.277104	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.321335
[113]	valid_0's auc: 0.934718	valid_0's binary_logloss: 0.276752	valid_1's auc: 0.905715	valid_1's binary_logloss: 0.321205
[114]	valid_0's auc: 0.934842	valid_0's binary_logloss: 0.276546	valid_1's auc: 0.905714	valid_1's binary_logloss: 0.321206
[115]	valid_0's auc: 0.934939	valid_0's binary_logloss: 0.276374	valid_1's auc: 0.905647	valid_1's binary_logloss: 0.321307
[116]	valid_0's auc: 0.935168	valid_0's binary_logloss: 0.275968	valid_1's auc: 0.905654	valid_1's binary_logloss: 0.321319
[117]	valid_0's auc: 0.935365	valid_0's binary_logloss: 0.275633	valid_1's auc: 0.905604	valid_1's binary_logloss: 0.321419
[118]	valid_0's auc: 0.935622	valid_0's binary_logloss: 0.275214	valid_1's auc: 0.905644	valid_1's binary_logloss: 0.32143
[119]	valid_0's auc: 0.935816	valid_0's binary_logloss: 0.274892	valid_1's auc: 0.905555	valid_1's binary_logloss: 0.321599
[120]	valid_0's auc: 0.936017	valid_0's binary_logloss: 0.27454	valid_1's auc: 0.905492	valid_1's binary_logloss: 0.321746
[121]	valid_0's auc: 0.936221	valid_0's binary_logloss: 0.27418	valid_1's auc: 0.905472	valid_1's binary_logloss: 0.321836
[122]	valid_0's auc: 0.936414	valid_0's binary_logloss: 0.273839	valid_1's auc: 0.905487	valid_1's binary_logloss: 0.321873
[123]	valid_0's auc: 0.936592	valid_0's binary_logloss: 0.273526	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.321754
[124]	valid_0's auc: 0.936783	valid_0's binary_logloss: 0.273151	valid_1's auc: 0.905504	valid_1's binary_logloss: 0.321932
[125]	valid_0's auc: 0.937001	valid_0's binary_logloss: 0.272769	valid_1's auc: 0.905399	valid_1's binary_logloss: 0.322148
[126]	valid_0's auc: 0.937181	valid_0's binary_logloss: 0.272461	valid_1's auc: 0.905368	valid_1's binary_logloss: 0.322182
[127]	valid_0's auc: 0.937255	valid_0's binary_logloss: 0.272326	valid_1's auc: 0.905317	valid_1's binary_logloss: 0.322276
[128]	valid_0's auc: 0.937347	valid_0's binary_logloss: 0.272143	valid_1's auc: 0.905181	valid_1's binary_logloss: 0.322531
[129]	valid_0's auc: 0.937562	valid_0's binary_logloss: 0.271738	valid_1's auc: 0.90501	valid_1's binary_logloss: 0.322899
[130]	valid_0's auc: 0.937816	valid_0's binary_logloss: 0.271295	valid_1's auc: 0.90503	valid_1's binary_logloss: 0.322912
[131]	valid_0's auc: 0.938005	valid_0's binary_logloss: 0.27095	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323006
[132]	valid_0's auc: 0.938193	valid_0's binary_logloss: 0.270604	valid_1's auc: 0.904878	valid_1's binary_logloss: 0.323233
[133]	valid_0's auc: 0.938399	valid_0's binary_logloss: 0.270237	valid_1's auc: 0.904824	valid_1's binary_logloss: 0.323395
[134]	valid_0's auc: 0.938547	valid_0's binary_logloss: 0.269957	valid_1's auc: 0.904761	valid_1's binary_logloss: 0.323515
[135]	valid_0's auc: 0.938752	valid_0's binary_logloss: 0.269578	valid_1's auc: 0.904766	valid_1's binary_logloss: 0.323557
[136]	valid_0's auc: 0.93897	valid_0's binary_logloss: 0.26919	valid_1's auc: 0.904837	valid_1's binary_logloss: 0.323527
[137]	valid_0's auc: 0.939156	valid_0's binary_logloss: 0.26889	valid_1's auc: 0.904658	valid_1's binary_logloss: 0.323821
[138]	valid_0's auc: 0.939319	valid_0's binary_logloss: 0.268631	valid_1's auc: 0.904651	valid_1's binary_logloss: 0.323812
[139]	valid_0's auc: 0.939391	valid_0's binary_logloss: 0.26849	valid_1's auc: 0.904626	valid_1's binary_logloss: 0.323872
[140]	valid_0's auc: 0.939569	valid_0's binary_logloss: 0.268168	valid_1's auc: 0.904566	valid_1's binary_logloss: 0.324057
[141]	valid_0's auc: 0.939699	valid_0's binary_logloss: 0.267926	valid_1's auc: 0.904499	valid_1's binary_logloss: 0.324206
[142]	valid_0's auc: 0.939832	valid_0's binary_logloss: 0.267691	valid_1's auc: 0.904503	valid_1's binary_logloss: 0.324252
[143]	valid_0's auc: 0.939924	valid_0's binary_logloss: 0.267531	valid_1's auc: 0.904464	valid_1's binary_logloss: 0.324357
[144]	valid_0's auc: 0.940063	valid_0's binary_logloss: 0.267275	valid_1's auc: 0.904379	valid_1's binary_logloss: 0.324532
[145]	valid_0's auc: 0.940192	valid_0's binary_logloss: 0.267036	valid_1's auc: 0.904377	valid_1's binary_logloss: 0.324658
[146]	valid_0's auc: 0.940267	valid_0's binary_logloss: 0.266867	valid_1's auc: 0.904366	valid_1's binary_logloss: 0.324713
[147]	valid_0's auc: 0.940447	valid_0's binary_logloss: 0.26657	valid_1's auc: 0.904312	valid_1's binary_logloss: 0.324756
[148]	valid_0's auc: 0.940676	valid_0's binary_logloss: 0.266153	valid_1's auc: 0.904287	valid_1's binary_logloss: 0.324812
[149]	valid_0's auc: 0.940703	valid_0's binary_logloss: 0.266099	valid_1's auc: 0.904324	valid_1's binary_logloss: 0.324771
Early stopping, best iteration is:
[49]	valid_0's auc: 0.920547	valid_0's binary_logloss: 0.302456	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316621
[1]	valid_0's auc: 0.886805	valid_0's binary_logloss: 0.517289	valid_1's auc: 0.891684	valid_1's binary_logloss: 0.508653
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889668	valid_0's binary_logloss: 0.488712	valid_1's auc: 0.894918	valid_1's binary_logloss: 0.47927
[3]	valid_0's auc: 0.89361	valid_0's binary_logloss: 0.465687	valid_1's auc: 0.898734	valid_1's binary_logloss: 0.45601
[4]	valid_0's auc: 0.895553	valid_0's binary_logloss: 0.446468	valid_1's auc: 0.90079	valid_1's binary_logloss: 0.436566
[5]	valid_0's auc: 0.896401	valid_0's binary_logloss: 0.430672	valid_1's auc: 0.901623	valid_1's binary_logloss: 0.420454
[6]	valid_0's auc: 0.896545	valid_0's binary_logloss: 0.41736	valid_1's auc: 0.901267	valid_1's binary_logloss: 0.406977
[7]	valid_0's auc: 0.897461	valid_0's binary_logloss: 0.405844	valid_1's auc: 0.902131	valid_1's binary_logloss: 0.395407
[8]	valid_0's auc: 0.898327	valid_0's binary_logloss: 0.395865	valid_1's auc: 0.903339	valid_1's binary_logloss: 0.385204
[9]	valid_0's auc: 0.899571	valid_0's binary_logloss: 0.387058	valid_1's auc: 0.904324	valid_1's binary_logloss: 0.376461
[10]	valid_0's auc: 0.900155	valid_0's binary_logloss: 0.379443	valid_1's auc: 0.905151	valid_1's binary_logloss: 0.368739
[11]	valid_0's auc: 0.90124	valid_0's binary_logloss: 0.372634	valid_1's auc: 0.905003	valid_1's binary_logloss: 0.362691
[12]	valid_0's auc: 0.902435	valid_0's binary_logloss: 0.366582	valid_1's auc: 0.905656	valid_1's binary_logloss: 0.357008
[13]	valid_0's auc: 0.903009	valid_0's binary_logloss: 0.36138	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.35201
[14]	valid_0's auc: 0.903743	valid_0's binary_logloss: 0.356547	valid_1's auc: 0.906627	valid_1's binary_logloss: 0.347441
[15]	valid_0's auc: 0.904526	valid_0's binary_logloss: 0.352314	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.343724
[16]	valid_0's auc: 0.905211	valid_0's binary_logloss: 0.348457	valid_1's auc: 0.907363	valid_1's binary_logloss: 0.340323
[17]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.344964	valid_1's auc: 0.907743	valid_1's binary_logloss: 0.337358
[18]	valid_0's auc: 0.906699	valid_0's binary_logloss: 0.34162	valid_1's auc: 0.90828	valid_1's binary_logloss: 0.33451
[19]	valid_0's auc: 0.907319	valid_0's binary_logloss: 0.33892	valid_1's auc: 0.908375	valid_1's binary_logloss: 0.332382
[20]	valid_0's auc: 0.907772	valid_0's binary_logloss: 0.336469	valid_1's auc: 0.90829	valid_1's binary_logloss: 0.330595
[21]	valid_0's auc: 0.908302	valid_0's binary_logloss: 0.334073	valid_1's auc: 0.908412	valid_1's binary_logloss: 0.328761
[22]	valid_0's auc: 0.908909	valid_0's binary_logloss: 0.33193	valid_1's auc: 0.908716	valid_1's binary_logloss: 0.327031
[23]	valid_0's auc: 0.909525	valid_0's binary_logloss: 0.329835	valid_1's auc: 0.908735	valid_1's binary_logloss: 0.325659
[24]	valid_0's auc: 0.909988	valid_0's binary_logloss: 0.328053	valid_1's auc: 0.908814	valid_1's binary_logloss: 0.324339
[25]	valid_0's auc: 0.910568	valid_0's binary_logloss: 0.326245	valid_1's auc: 0.908941	valid_1's binary_logloss: 0.323256
[26]	valid_0's auc: 0.911152	valid_0's binary_logloss: 0.324506	valid_1's auc: 0.908967	valid_1's binary_logloss: 0.322239
[27]	valid_0's auc: 0.911634	valid_0's binary_logloss: 0.323011	valid_1's auc: 0.909023	valid_1's binary_logloss: 0.321387
[28]	valid_0's auc: 0.91212	valid_0's binary_logloss: 0.321547	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.320603
[29]	valid_0's auc: 0.912647	valid_0's binary_logloss: 0.320118	valid_1's auc: 0.909103	valid_1's binary_logloss: 0.319904
[30]	valid_0's auc: 0.913062	valid_0's binary_logloss: 0.318877	valid_1's auc: 0.909051	valid_1's binary_logloss: 0.319345
[31]	valid_0's auc: 0.913456	valid_0's binary_logloss: 0.317847	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.318633
[32]	valid_0's auc: 0.914029	valid_0's binary_logloss: 0.316482	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.318282
[33]	valid_0's auc: 0.91448	valid_0's binary_logloss: 0.315316	valid_1's auc: 0.909164	valid_1's binary_logloss: 0.317931
[34]	valid_0's auc: 0.914927	valid_0's binary_logloss: 0.314249	valid_1's auc: 0.909118	valid_1's binary_logloss: 0.317609
[35]	valid_0's auc: 0.915219	valid_0's binary_logloss: 0.31341	valid_1's auc: 0.909169	valid_1's binary_logloss: 0.317194
[36]	valid_0's auc: 0.915565	valid_0's binary_logloss: 0.312507	valid_1's auc: 0.909334	valid_1's binary_logloss: 0.316725
[37]	valid_0's auc: 0.916165	valid_0's binary_logloss: 0.311296	valid_1's auc: 0.909385	valid_1's binary_logloss: 0.316466
[38]	valid_0's auc: 0.916598	valid_0's binary_logloss: 0.310285	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.316111
[39]	valid_0's auc: 0.916942	valid_0's binary_logloss: 0.309505	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.315705
[40]	valid_0's auc: 0.917226	valid_0's binary_logloss: 0.308822	valid_1's auc: 0.909632	valid_1's binary_logloss: 0.315446
[41]	valid_0's auc: 0.917562	valid_0's binary_logloss: 0.308106	valid_1's auc: 0.909701	valid_1's binary_logloss: 0.315181
[42]	valid_0's auc: 0.917993	valid_0's binary_logloss: 0.307252	valid_1's auc: 0.909809	valid_1's binary_logloss: 0.314872
[43]	valid_0's auc: 0.918376	valid_0's binary_logloss: 0.306475	valid_1's auc: 0.909849	valid_1's binary_logloss: 0.31473
[44]	valid_0's auc: 0.918764	valid_0's binary_logloss: 0.305707	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314649
[45]	valid_0's auc: 0.919084	valid_0's binary_logloss: 0.305032	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314533
[46]	valid_0's auc: 0.919454	valid_0's binary_logloss: 0.304289	valid_1's auc: 0.909845	valid_1's binary_logloss: 0.314408
[47]	valid_0's auc: 0.919709	valid_0's binary_logloss: 0.303741	valid_1's auc: 0.909825	valid_1's binary_logloss: 0.314348
[48]	valid_0's auc: 0.920064	valid_0's binary_logloss: 0.303076	valid_1's auc: 0.909784	valid_1's binary_logloss: 0.31434
[49]	valid_0's auc: 0.920324	valid_0's binary_logloss: 0.302573	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.314424
[50]	valid_0's auc: 0.920565	valid_0's binary_logloss: 0.302118	valid_1's auc: 0.909744	valid_1's binary_logloss: 0.31436
[51]	valid_0's auc: 0.920821	valid_0's binary_logloss: 0.301553	valid_1's auc: 0.909796	valid_1's binary_logloss: 0.314229
[52]	valid_0's auc: 0.921229	valid_0's binary_logloss: 0.300757	valid_1's auc: 0.909723	valid_1's binary_logloss: 0.314282
[53]	valid_0's auc: 0.92147	valid_0's binary_logloss: 0.300325	valid_1's auc: 0.9097	valid_1's binary_logloss: 0.314298
[54]	valid_0's auc: 0.921783	valid_0's binary_logloss: 0.299757	valid_1's auc: 0.909637	valid_1's binary_logloss: 0.314396
[55]	valid_0's auc: 0.921997	valid_0's binary_logloss: 0.299354	valid_1's auc: 0.90959	valid_1's binary_logloss: 0.314403
[56]	valid_0's auc: 0.922284	valid_0's binary_logloss: 0.298828	valid_1's auc: 0.909546	valid_1's binary_logloss: 0.314416
[57]	valid_0's auc: 0.922493	valid_0's binary_logloss: 0.298425	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.314393
[58]	valid_0's auc: 0.922814	valid_0's binary_logloss: 0.297839	valid_1's auc: 0.909397	valid_1's binary_logloss: 0.314582
[59]	valid_0's auc: 0.92297	valid_0's binary_logloss: 0.297516	valid_1's auc: 0.909453	valid_1's binary_logloss: 0.314464
[60]	valid_0's auc: 0.923253	valid_0's binary_logloss: 0.297021	valid_1's auc: 0.909513	valid_1's binary_logloss: 0.314365
[61]	valid_0's auc: 0.923567	valid_0's binary_logloss: 0.296482	valid_1's auc: 0.90945	valid_1's binary_logloss: 0.314422
[62]	valid_0's auc: 0.923798	valid_0's binary_logloss: 0.29607	valid_1's auc: 0.909324	valid_1's binary_logloss: 0.314626
[63]	valid_0's auc: 0.924095	valid_0's binary_logloss: 0.295523	valid_1's auc: 0.909202	valid_1's binary_logloss: 0.314749
[64]	valid_0's auc: 0.924262	valid_0's binary_logloss: 0.295202	valid_1's auc: 0.909154	valid_1's binary_logloss: 0.314768
[65]	valid_0's auc: 0.924621	valid_0's binary_logloss: 0.294597	valid_1's auc: 0.909137	valid_1's binary_logloss: 0.314782
[66]	valid_0's auc: 0.92487	valid_0's binary_logloss: 0.294201	valid_1's auc: 0.909159	valid_1's binary_logloss: 0.314723
[67]	valid_0's auc: 0.925171	valid_0's binary_logloss: 0.29367	valid_1's auc: 0.90909	valid_1's binary_logloss: 0.314803
[68]	valid_0's auc: 0.925329	valid_0's binary_logloss: 0.29334	valid_1's auc: 0.909111	valid_1's binary_logloss: 0.314788
[69]	valid_0's auc: 0.925561	valid_0's binary_logloss: 0.292967	valid_1's auc: 0.908959	valid_1's binary_logloss: 0.314993
[70]	valid_0's auc: 0.925915	valid_0's binary_logloss: 0.292413	valid_1's auc: 0.908912	valid_1's binary_logloss: 0.315123
[71]	valid_0's auc: 0.926187	valid_0's binary_logloss: 0.291899	valid_1's auc: 0.908821	valid_1's binary_logloss: 0.315221
[72]	valid_0's auc: 0.926386	valid_0's binary_logloss: 0.291555	valid_1's auc: 0.908715	valid_1's binary_logloss: 0.315379
[73]	valid_0's auc: 0.926625	valid_0's binary_logloss: 0.29111	valid_1's auc: 0.908759	valid_1's binary_logloss: 0.31534
[74]	valid_0's auc: 0.926923	valid_0's binary_logloss: 0.290575	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315509
[75]	valid_0's auc: 0.927152	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315463
[76]	valid_0's auc: 0.927366	valid_0's binary_logloss: 0.289702	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.315508
[77]	valid_0's auc: 0.927623	valid_0's binary_logloss: 0.28928	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.315549
[78]	valid_0's auc: 0.927797	valid_0's binary_logloss: 0.289	valid_1's auc: 0.908618	valid_1's binary_logloss: 0.315544
[79]	valid_0's auc: 0.928085	valid_0's binary_logloss: 0.288511	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.315588
[80]	valid_0's auc: 0.928249	valid_0's binary_logloss: 0.288208	valid_1's auc: 0.908626	valid_1's binary_logloss: 0.315548
[81]	valid_0's auc: 0.928399	valid_0's binary_logloss: 0.287909	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.315542
[82]	valid_0's auc: 0.928507	valid_0's binary_logloss: 0.287706	valid_1's auc: 0.908624	valid_1's binary_logloss: 0.315585
[83]	valid_0's auc: 0.928716	valid_0's binary_logloss: 0.287351	valid_1's auc: 0.90857	valid_1's binary_logloss: 0.315685
[84]	valid_0's auc: 0.929036	valid_0's binary_logloss: 0.286861	valid_1's auc: 0.90855	valid_1's binary_logloss: 0.315721
[85]	valid_0's auc: 0.929299	valid_0's binary_logloss: 0.286392	valid_1's auc: 0.908491	valid_1's binary_logloss: 0.315813
[86]	valid_0's auc: 0.929497	valid_0's binary_logloss: 0.285997	valid_1's auc: 0.908397	valid_1's binary_logloss: 0.315984
[87]	valid_0's auc: 0.929705	valid_0's binary_logloss: 0.285667	valid_1's auc: 0.908325	valid_1's binary_logloss: 0.316117
[88]	valid_0's auc: 0.929786	valid_0's binary_logloss: 0.28553	valid_1's auc: 0.908281	valid_1's binary_logloss: 0.316211
[89]	valid_0's auc: 0.930074	valid_0's binary_logloss: 0.285016	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.316383
[90]	valid_0's auc: 0.930288	valid_0's binary_logloss: 0.284648	valid_1's auc: 0.908136	valid_1's binary_logloss: 0.316485
[91]	valid_0's auc: 0.930518	valid_0's binary_logloss: 0.284228	valid_1's auc: 0.90806	valid_1's binary_logloss: 0.316669
[92]	valid_0's auc: 0.930644	valid_0's binary_logloss: 0.283943	valid_1's auc: 0.908043	valid_1's binary_logloss: 0.31673
[93]	valid_0's auc: 0.93079	valid_0's binary_logloss: 0.283673	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.316818
[94]	valid_0's auc: 0.931066	valid_0's binary_logloss: 0.283178	valid_1's auc: 0.907925	valid_1's binary_logloss: 0.316921
[95]	valid_0's auc: 0.931266	valid_0's binary_logloss: 0.282821	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317081
[96]	valid_0's auc: 0.931543	valid_0's binary_logloss: 0.282338	valid_1's auc: 0.907694	valid_1's binary_logloss: 0.31732
[97]	valid_0's auc: 0.931684	valid_0's binary_logloss: 0.282078	valid_1's auc: 0.907565	valid_1's binary_logloss: 0.317529
[98]	valid_0's auc: 0.931856	valid_0's binary_logloss: 0.281773	valid_1's auc: 0.90749	valid_1's binary_logloss: 0.31763
[99]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.281652	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.317643
[100]	valid_0's auc: 0.932047	valid_0's binary_logloss: 0.281416	valid_1's auc: 0.907405	valid_1's binary_logloss: 0.317875
[101]	valid_0's auc: 0.932095	valid_0's binary_logloss: 0.281322	valid_1's auc: 0.907373	valid_1's binary_logloss: 0.317957
[102]	valid_0's auc: 0.93224	valid_0's binary_logloss: 0.28105	valid_1's auc: 0.907301	valid_1's binary_logloss: 0.318104
[103]	valid_0's auc: 0.932457	valid_0's binary_logloss: 0.280702	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.318249
[104]	valid_0's auc: 0.932632	valid_0's binary_logloss: 0.280375	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318057
[105]	valid_0's auc: 0.932659	valid_0's binary_logloss: 0.280335	valid_1's auc: 0.907424	valid_1's binary_logloss: 0.318001
[106]	valid_0's auc: 0.932907	valid_0's binary_logloss: 0.279915	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.318063
[107]	valid_0's auc: 0.933186	valid_0's binary_logloss: 0.279396	valid_1's auc: 0.907387	valid_1's binary_logloss: 0.31812
[108]	valid_0's auc: 0.93338	valid_0's binary_logloss: 0.279037	valid_1's auc: 0.907416	valid_1's binary_logloss: 0.318118
[109]	valid_0's auc: 0.933538	valid_0's binary_logloss: 0.278752	valid_1's auc: 0.907362	valid_1's binary_logloss: 0.318217
[110]	valid_0's auc: 0.933745	valid_0's binary_logloss: 0.278408	valid_1's auc: 0.907306	valid_1's binary_logloss: 0.318341
[111]	valid_0's auc: 0.933848	valid_0's binary_logloss: 0.278244	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318403
[112]	valid_0's auc: 0.934061	valid_0's binary_logloss: 0.277899	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318402
[113]	valid_0's auc: 0.934334	valid_0's binary_logloss: 0.277427	valid_1's auc: 0.90729	valid_1's binary_logloss: 0.318329
[114]	valid_0's auc: 0.934561	valid_0's binary_logloss: 0.277025	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318505
[115]	valid_0's auc: 0.934807	valid_0's binary_logloss: 0.276653	valid_1's auc: 0.907152	valid_1's binary_logloss: 0.318562
[116]	valid_0's auc: 0.935021	valid_0's binary_logloss: 0.276275	valid_1's auc: 0.907195	valid_1's binary_logloss: 0.318503
[117]	valid_0's auc: 0.935298	valid_0's binary_logloss: 0.275763	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318733
[118]	valid_0's auc: 0.935471	valid_0's binary_logloss: 0.275463	valid_1's auc: 0.906989	valid_1's binary_logloss: 0.31891
[119]	valid_0's auc: 0.935687	valid_0's binary_logloss: 0.275104	valid_1's auc: 0.906945	valid_1's binary_logloss: 0.318984
[120]	valid_0's auc: 0.935811	valid_0's binary_logloss: 0.274887	valid_1's auc: 0.906954	valid_1's binary_logloss: 0.318987
[121]	valid_0's auc: 0.936057	valid_0's binary_logloss: 0.274466	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.319061
[122]	valid_0's auc: 0.936218	valid_0's binary_logloss: 0.274152	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.319154
[123]	valid_0's auc: 0.936336	valid_0's binary_logloss: 0.273922	valid_1's auc: 0.906825	valid_1's binary_logloss: 0.31935
[124]	valid_0's auc: 0.936478	valid_0's binary_logloss: 0.273668	valid_1's auc: 0.906773	valid_1's binary_logloss: 0.319441
[125]	valid_0's auc: 0.936584	valid_0's binary_logloss: 0.273468	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.31965
[126]	valid_0's auc: 0.936733	valid_0's binary_logloss: 0.273146	valid_1's auc: 0.906595	valid_1's binary_logloss: 0.319842
[127]	valid_0's auc: 0.936795	valid_0's binary_logloss: 0.273018	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319873
[128]	valid_0's auc: 0.936989	valid_0's binary_logloss: 0.272676	valid_1's auc: 0.90655	valid_1's binary_logloss: 0.319945
[129]	valid_0's auc: 0.93719	valid_0's binary_logloss: 0.272324	valid_1's auc: 0.906494	valid_1's binary_logloss: 0.320078
[130]	valid_0's auc: 0.937342	valid_0's binary_logloss: 0.272038	valid_1's auc: 0.906482	valid_1's binary_logloss: 0.320152
[131]	valid_0's auc: 0.937396	valid_0's binary_logloss: 0.271921	valid_1's auc: 0.906469	valid_1's binary_logloss: 0.320218
[132]	valid_0's auc: 0.937582	valid_0's binary_logloss: 0.271567	valid_1's auc: 0.906396	valid_1's binary_logloss: 0.320447
[133]	valid_0's auc: 0.937708	valid_0's binary_logloss: 0.271324	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320509
[134]	valid_0's auc: 0.937964	valid_0's binary_logloss: 0.270919	valid_1's auc: 0.906259	valid_1's binary_logloss: 0.320665
[135]	valid_0's auc: 0.93807	valid_0's binary_logloss: 0.270698	valid_1's auc: 0.906261	valid_1's binary_logloss: 0.320704
[136]	valid_0's auc: 0.938239	valid_0's binary_logloss: 0.270389	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.320939
[137]	valid_0's auc: 0.93836	valid_0's binary_logloss: 0.270151	valid_1's auc: 0.90616	valid_1's binary_logloss: 0.320925
[138]	valid_0's auc: 0.938533	valid_0's binary_logloss: 0.269805	valid_1's auc: 0.906125	valid_1's binary_logloss: 0.321022
[139]	valid_0's auc: 0.938694	valid_0's binary_logloss: 0.269489	valid_1's auc: 0.906069	valid_1's binary_logloss: 0.321183
[140]	valid_0's auc: 0.93889	valid_0's binary_logloss: 0.269175	valid_1's auc: 0.906024	valid_1's binary_logloss: 0.321248
[141]	valid_0's auc: 0.93895	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.906054	valid_1's binary_logloss: 0.321208
[142]	valid_0's auc: 0.939043	valid_0's binary_logloss: 0.268887	valid_1's auc: 0.905994	valid_1's binary_logloss: 0.321356
[143]	valid_0's auc: 0.939205	valid_0's binary_logloss: 0.26861	valid_1's auc: 0.905927	valid_1's binary_logloss: 0.321486
[144]	valid_0's auc: 0.939408	valid_0's binary_logloss: 0.26827	valid_1's auc: 0.905779	valid_1's binary_logloss: 0.321702
Early stopping, best iteration is:
[44]	valid_0's auc: 0.918764	valid_0's binary_logloss: 0.305707	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314649
[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893965	valid_0's binary_logloss: 0.48775	valid_1's auc: 0.898564	valid_1's binary_logloss: 0.47888
[3]	valid_0's auc: 0.895655	valid_0's binary_logloss: 0.464581	valid_1's auc: 0.900964	valid_1's binary_logloss: 0.455298
[4]	valid_0's auc: 0.897539	valid_0's binary_logloss: 0.445277	valid_1's auc: 0.902035	valid_1's binary_logloss: 0.435832
[5]	valid_0's auc: 0.898387	valid_0's binary_logloss: 0.429396	valid_1's auc: 0.902551	valid_1's binary_logloss: 0.419909
[6]	valid_0's auc: 0.899784	valid_0's binary_logloss: 0.415601	valid_1's auc: 0.903665	valid_1's binary_logloss: 0.405988
[7]	valid_0's auc: 0.900831	valid_0's binary_logloss: 0.403734	valid_1's auc: 0.904525	valid_1's binary_logloss: 0.394007
[8]	valid_0's auc: 0.902074	valid_0's binary_logloss: 0.393454	valid_1's auc: 0.904554	valid_1's binary_logloss: 0.384534
[9]	valid_0's auc: 0.902691	valid_0's binary_logloss: 0.384773	valid_1's auc: 0.904903	valid_1's binary_logloss: 0.376052
[10]	valid_0's auc: 0.903406	valid_0's binary_logloss: 0.377125	valid_1's auc: 0.905336	valid_1's binary_logloss: 0.36871
[11]	valid_0's auc: 0.904104	valid_0's binary_logloss: 0.370202	valid_1's auc: 0.905376	valid_1's binary_logloss: 0.36243
[12]	valid_0's auc: 0.904891	valid_0's binary_logloss: 0.364111	valid_1's auc: 0.905619	valid_1's binary_logloss: 0.356926
[13]	valid_0's auc: 0.905957	valid_0's binary_logloss: 0.358664	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.351824
[14]	valid_0's auc: 0.906835	valid_0's binary_logloss: 0.35382	valid_1's auc: 0.907068	valid_1's binary_logloss: 0.347514
[15]	valid_0's auc: 0.907499	valid_0's binary_logloss: 0.349488	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.34372
[16]	valid_0's auc: 0.908278	valid_0's binary_logloss: 0.345434	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.340404
[17]	valid_0's auc: 0.908963	valid_0's binary_logloss: 0.341925	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.337467
[18]	valid_0's auc: 0.909506	valid_0's binary_logloss: 0.33877	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.334924
[19]	valid_0's auc: 0.910325	valid_0's binary_logloss: 0.335693	valid_1's auc: 0.908188	valid_1's binary_logloss: 0.332695
[20]	valid_0's auc: 0.910811	valid_0's binary_logloss: 0.333061	valid_1's auc: 0.908235	valid_1's binary_logloss: 0.330738
[21]	valid_0's auc: 0.911457	valid_0's binary_logloss: 0.33059	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.329008
[22]	valid_0's auc: 0.91208	valid_0's binary_logloss: 0.328273	valid_1's auc: 0.908597	valid_1's binary_logloss: 0.327193
[23]	valid_0's auc: 0.912696	valid_0's binary_logloss: 0.326188	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.325776
[24]	valid_0's auc: 0.913437	valid_0's binary_logloss: 0.324096	valid_1's auc: 0.909015	valid_1's binary_logloss: 0.324428
[25]	valid_0's auc: 0.914099	valid_0's binary_logloss: 0.322178	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.323024
[26]	valid_0's auc: 0.914848	valid_0's binary_logloss: 0.320278	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.322028
[27]	valid_0's auc: 0.915368	valid_0's binary_logloss: 0.318709	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.321119
[28]	valid_0's auc: 0.915901	valid_0's binary_logloss: 0.317124	valid_1's auc: 0.909502	valid_1's binary_logloss: 0.320442
[29]	valid_0's auc: 0.916539	valid_0's binary_logloss: 0.315481	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.319912
[30]	valid_0's auc: 0.917199	valid_0's binary_logloss: 0.313941	valid_1's auc: 0.909411	valid_1's binary_logloss: 0.319377
[31]	valid_0's auc: 0.917762	valid_0's binary_logloss: 0.312489	valid_1's auc: 0.909552	valid_1's binary_logloss: 0.31874
[32]	valid_0's auc: 0.918363	valid_0's binary_logloss: 0.311025	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.318411
[33]	valid_0's auc: 0.918787	valid_0's binary_logloss: 0.309888	valid_1's auc: 0.909489	valid_1's binary_logloss: 0.317904
[34]	valid_0's auc: 0.919222	valid_0's binary_logloss: 0.308721	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.317581
[35]	valid_0's auc: 0.919692	valid_0's binary_logloss: 0.307598	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.31723
[36]	valid_0's auc: 0.920165	valid_0's binary_logloss: 0.306529	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.316949
[37]	valid_0's auc: 0.920518	valid_0's binary_logloss: 0.305578	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.316719
[38]	valid_0's auc: 0.920964	valid_0's binary_logloss: 0.304573	valid_1's auc: 0.909618	valid_1's binary_logloss: 0.316259
[39]	valid_0's auc: 0.921413	valid_0's binary_logloss: 0.303538	valid_1's auc: 0.90968	valid_1's binary_logloss: 0.31597
[40]	valid_0's auc: 0.921827	valid_0's binary_logloss: 0.302604	valid_1's auc: 0.909769	valid_1's binary_logloss: 0.315659
[41]	valid_0's auc: 0.922248	valid_0's binary_logloss: 0.301637	valid_1's auc: 0.910064	valid_1's binary_logloss: 0.315096
[42]	valid_0's auc: 0.92268	valid_0's binary_logloss: 0.300781	valid_1's auc: 0.910248	valid_1's binary_logloss: 0.314713
[43]	valid_0's auc: 0.923159	valid_0's binary_logloss: 0.299782	valid_1's auc: 0.910295	valid_1's binary_logloss: 0.314557
[44]	valid_0's auc: 0.923571	valid_0's binary_logloss: 0.298949	valid_1's auc: 0.910375	valid_1's binary_logloss: 0.314362
[45]	valid_0's auc: 0.923957	valid_0's binary_logloss: 0.298126	valid_1's auc: 0.910473	valid_1's binary_logloss: 0.314007
[46]	valid_0's auc: 0.92435	valid_0's binary_logloss: 0.297349	valid_1's auc: 0.91047	valid_1's binary_logloss: 0.313925
[47]	valid_0's auc: 0.924713	valid_0's binary_logloss: 0.296625	valid_1's auc: 0.910288	valid_1's binary_logloss: 0.314068
[48]	valid_0's auc: 0.925081	valid_0's binary_logloss: 0.295895	valid_1's auc: 0.910327	valid_1's binary_logloss: 0.313981
[49]	valid_0's auc: 0.925486	valid_0's binary_logloss: 0.295234	valid_1's auc: 0.91031	valid_1's binary_logloss: 0.31392
[50]	valid_0's auc: 0.925864	valid_0's binary_logloss: 0.294542	valid_1's auc: 0.91023	valid_1's binary_logloss: 0.313957
[51]	valid_0's auc: 0.926162	valid_0's binary_logloss: 0.293987	valid_1's auc: 0.910083	valid_1's binary_logloss: 0.314078
[52]	valid_0's auc: 0.926656	valid_0's binary_logloss: 0.293165	valid_1's auc: 0.910125	valid_1's binary_logloss: 0.313957
[53]	valid_0's auc: 0.92702	valid_0's binary_logloss: 0.292483	valid_1's auc: 0.910159	valid_1's binary_logloss: 0.313865
[54]	valid_0's auc: 0.927388	valid_0's binary_logloss: 0.291784	valid_1's auc: 0.910105	valid_1's binary_logloss: 0.313926
[55]	valid_0's auc: 0.927743	valid_0's binary_logloss: 0.291075	valid_1's auc: 0.910236	valid_1's binary_logloss: 0.313686
[56]	valid_0's auc: 0.928161	valid_0's binary_logloss: 0.29034	valid_1's auc: 0.910356	valid_1's binary_logloss: 0.313502
[57]	valid_0's auc: 0.928568	valid_0's binary_logloss: 0.289642	valid_1's auc: 0.910246	valid_1's binary_logloss: 0.313583
[58]	valid_0's auc: 0.928869	valid_0's binary_logloss: 0.289132	valid_1's auc: 0.910163	valid_1's binary_logloss: 0.313662
[59]	valid_0's auc: 0.929294	valid_0's binary_logloss: 0.288419	valid_1's auc: 0.910043	valid_1's binary_logloss: 0.313812
[60]	valid_0's auc: 0.929718	valid_0's binary_logloss: 0.287745	valid_1's auc: 0.910005	valid_1's binary_logloss: 0.313816
[61]	valid_0's auc: 0.930139	valid_0's binary_logloss: 0.287021	valid_1's auc: 0.910146	valid_1's binary_logloss: 0.313558
[62]	valid_0's auc: 0.930571	valid_0's binary_logloss: 0.28629	valid_1's auc: 0.910101	valid_1's binary_logloss: 0.313647
[63]	valid_0's auc: 0.93084	valid_0's binary_logloss: 0.285798	valid_1's auc: 0.910121	valid_1's binary_logloss: 0.313557
[64]	valid_0's auc: 0.931204	valid_0's binary_logloss: 0.285154	valid_1's auc: 0.910041	valid_1's binary_logloss: 0.313733
[65]	valid_0's auc: 0.931571	valid_0's binary_logloss: 0.284514	valid_1's auc: 0.909906	valid_1's binary_logloss: 0.313987
[66]	valid_0's auc: 0.931838	valid_0's binary_logloss: 0.284033	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.314104
[67]	valid_0's auc: 0.932112	valid_0's binary_logloss: 0.283505	valid_1's auc: 0.909743	valid_1's binary_logloss: 0.314247
[68]	valid_0's auc: 0.932416	valid_0's binary_logloss: 0.282919	valid_1's auc: 0.909736	valid_1's binary_logloss: 0.314236
[69]	valid_0's auc: 0.932769	valid_0's binary_logloss: 0.282291	valid_1's auc: 0.909849	valid_1's binary_logloss: 0.314079
[70]	valid_0's auc: 0.933092	valid_0's binary_logloss: 0.281764	valid_1's auc: 0.909697	valid_1's binary_logloss: 0.314311
[71]	valid_0's auc: 0.933456	valid_0's binary_logloss: 0.281123	valid_1's auc: 0.90969	valid_1's binary_logloss: 0.314301
[72]	valid_0's auc: 0.933786	valid_0's binary_logloss: 0.280537	valid_1's auc: 0.909724	valid_1's binary_logloss: 0.314299
[73]	valid_0's auc: 0.934014	valid_0's binary_logloss: 0.280053	valid_1's auc: 0.909614	valid_1's binary_logloss: 0.314448
[74]	valid_0's auc: 0.934294	valid_0's binary_logloss: 0.279571	valid_1's auc: 0.909529	valid_1's binary_logloss: 0.31456
[75]	valid_0's auc: 0.93471	valid_0's binary_logloss: 0.278858	valid_1's auc: 0.909491	valid_1's binary_logloss: 0.314579
[76]	valid_0's auc: 0.934963	valid_0's binary_logloss: 0.278416	valid_1's auc: 0.909428	valid_1's binary_logloss: 0.314662
[77]	valid_0's auc: 0.935162	valid_0's binary_logloss: 0.278073	valid_1's auc: 0.909187	valid_1's binary_logloss: 0.315032
[78]	valid_0's auc: 0.935572	valid_0's binary_logloss: 0.277355	valid_1's auc: 0.909107	valid_1's binary_logloss: 0.315119
[79]	valid_0's auc: 0.935833	valid_0's binary_logloss: 0.276878	valid_1's auc: 0.909091	valid_1's binary_logloss: 0.315151
[80]	valid_0's auc: 0.936089	valid_0's binary_logloss: 0.276374	valid_1's auc: 0.909104	valid_1's binary_logloss: 0.315185
[81]	valid_0's auc: 0.936339	valid_0's binary_logloss: 0.275936	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.315308
[82]	valid_0's auc: 0.936495	valid_0's binary_logloss: 0.275682	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315611
[83]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.275276	valid_1's auc: 0.908765	valid_1's binary_logloss: 0.31579
[84]	valid_0's auc: 0.937002	valid_0's binary_logloss: 0.274721	valid_1's auc: 0.908742	valid_1's binary_logloss: 0.315785
[85]	valid_0's auc: 0.937259	valid_0's binary_logloss: 0.274285	valid_1's auc: 0.908752	valid_1's binary_logloss: 0.315775
[86]	valid_0's auc: 0.937473	valid_0's binary_logloss: 0.273799	valid_1's auc: 0.908738	valid_1's binary_logloss: 0.315823
[87]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.273317	valid_1's auc: 0.908719	valid_1's binary_logloss: 0.31583
[88]	valid_0's auc: 0.937893	valid_0's binary_logloss: 0.272969	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.316114
[89]	valid_0's auc: 0.938071	valid_0's binary_logloss: 0.272584	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.316094
[90]	valid_0's auc: 0.938384	valid_0's binary_logloss: 0.272057	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.316209
[91]	valid_0's auc: 0.938713	valid_0's binary_logloss: 0.271461	valid_1's auc: 0.908592	valid_1's binary_logloss: 0.316161
[92]	valid_0's auc: 0.938927	valid_0's binary_logloss: 0.270985	valid_1's auc: 0.908525	valid_1's binary_logloss: 0.316219
[93]	valid_0's auc: 0.939251	valid_0's binary_logloss: 0.270397	valid_1's auc: 0.908375	valid_1's binary_logloss: 0.316456
[94]	valid_0's auc: 0.939444	valid_0's binary_logloss: 0.270047	valid_1's auc: 0.908288	valid_1's binary_logloss: 0.316567
[95]	valid_0's auc: 0.93964	valid_0's binary_logloss: 0.269703	valid_1's auc: 0.908333	valid_1's binary_logloss: 0.316515
[96]	valid_0's auc: 0.93981	valid_0's binary_logloss: 0.269332	valid_1's auc: 0.908222	valid_1's binary_logloss: 0.316712
[97]	valid_0's auc: 0.940066	valid_0's binary_logloss: 0.268872	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.316877
[98]	valid_0's auc: 0.940238	valid_0's binary_logloss: 0.268531	valid_1's auc: 0.908051	valid_1's binary_logloss: 0.317097
[99]	valid_0's auc: 0.940582	valid_0's binary_logloss: 0.267968	valid_1's auc: 0.907989	valid_1's binary_logloss: 0.317212
[100]	valid_0's auc: 0.940784	valid_0's binary_logloss: 0.267537	valid_1's auc: 0.907983	valid_1's binary_logloss: 0.317208
[101]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.26718	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317335
[102]	valid_0's auc: 0.941186	valid_0's binary_logloss: 0.266768	valid_1's auc: 0.907955	valid_1's binary_logloss: 0.317285
[103]	valid_0's auc: 0.941446	valid_0's binary_logloss: 0.266308	valid_1's auc: 0.907801	valid_1's binary_logloss: 0.3176
[104]	valid_0's auc: 0.941663	valid_0's binary_logloss: 0.265849	valid_1's auc: 0.907797	valid_1's binary_logloss: 0.317633
[105]	valid_0's auc: 0.941861	valid_0's binary_logloss: 0.265473	valid_1's auc: 0.907767	valid_1's binary_logloss: 0.317711
[106]	valid_0's auc: 0.94219	valid_0's binary_logloss: 0.264897	valid_1's auc: 0.907788	valid_1's binary_logloss: 0.317689
[107]	valid_0's auc: 0.942315	valid_0's binary_logloss: 0.264613	valid_1's auc: 0.90775	valid_1's binary_logloss: 0.317765
[108]	valid_0's auc: 0.942556	valid_0's binary_logloss: 0.264181	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.317789
[109]	valid_0's auc: 0.942729	valid_0's binary_logloss: 0.26389	valid_1's auc: 0.907689	valid_1's binary_logloss: 0.317876
[110]	valid_0's auc: 0.942944	valid_0's binary_logloss: 0.263509	valid_1's auc: 0.907737	valid_1's binary_logloss: 0.317831
[111]	valid_0's auc: 0.943158	valid_0's binary_logloss: 0.263108	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317844
[112]	valid_0's auc: 0.943453	valid_0's binary_logloss: 0.262613	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.317807
[113]	valid_0's auc: 0.943648	valid_0's binary_logloss: 0.262268	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317779
[114]	valid_0's auc: 0.943804	valid_0's binary_logloss: 0.261914	valid_1's auc: 0.907781	valid_1's binary_logloss: 0.317837
[115]	valid_0's auc: 0.944071	valid_0's binary_logloss: 0.261404	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.31802
[116]	valid_0's auc: 0.944224	valid_0's binary_logloss: 0.261089	valid_1's auc: 0.907623	valid_1's binary_logloss: 0.318207
[117]	valid_0's auc: 0.944503	valid_0's binary_logloss: 0.260612	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.318462
[118]	valid_0's auc: 0.944698	valid_0's binary_logloss: 0.26025	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318634
[119]	valid_0's auc: 0.944867	valid_0's binary_logloss: 0.259948	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.318809
[120]	valid_0's auc: 0.94505	valid_0's binary_logloss: 0.259568	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.318769
[121]	valid_0's auc: 0.945347	valid_0's binary_logloss: 0.258982	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318959
[122]	valid_0's auc: 0.945536	valid_0's binary_logloss: 0.258641	valid_1's auc: 0.907201	valid_1's binary_logloss: 0.319004
[123]	valid_0's auc: 0.945727	valid_0's binary_logloss: 0.258278	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.319318
[124]	valid_0's auc: 0.945946	valid_0's binary_logloss: 0.257886	valid_1's auc: 0.906923	valid_1's binary_logloss: 0.3195
[125]	valid_0's auc: 0.946076	valid_0's binary_logloss: 0.257628	valid_1's auc: 0.90691	valid_1's binary_logloss: 0.319492
[126]	valid_0's auc: 0.946299	valid_0's binary_logloss: 0.257211	valid_1's auc: 0.906892	valid_1's binary_logloss: 0.319499
[127]	valid_0's auc: 0.946494	valid_0's binary_logloss: 0.256828	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.319445
[128]	valid_0's auc: 0.946785	valid_0's binary_logloss: 0.256324	valid_1's auc: 0.906988	valid_1's binary_logloss: 0.319338
[129]	valid_0's auc: 0.946951	valid_0's binary_logloss: 0.25596	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.319526
[130]	valid_0's auc: 0.947072	valid_0's binary_logloss: 0.25569	valid_1's auc: 0.906869	valid_1's binary_logloss: 0.319609
[131]	valid_0's auc: 0.94721	valid_0's binary_logloss: 0.255416	valid_1's auc: 0.906816	valid_1's binary_logloss: 0.319682
[132]	valid_0's auc: 0.947377	valid_0's binary_logloss: 0.255084	valid_1's auc: 0.906746	valid_1's binary_logloss: 0.319828
[133]	valid_0's auc: 0.947613	valid_0's binary_logloss: 0.254648	valid_1's auc: 0.906606	valid_1's binary_logloss: 0.320084
[134]	valid_0's auc: 0.947812	valid_0's binary_logloss: 0.254261	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.320032
[135]	valid_0's auc: 0.947997	valid_0's binary_logloss: 0.253907	valid_1's auc: 0.906556	valid_1's binary_logloss: 0.320237
[136]	valid_0's auc: 0.948131	valid_0's binary_logloss: 0.253582	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.320121
[137]	valid_0's auc: 0.948254	valid_0's binary_logloss: 0.25333	valid_1's auc: 0.906604	valid_1's binary_logloss: 0.320167
[138]	valid_0's auc: 0.948437	valid_0's binary_logloss: 0.252955	valid_1's auc: 0.906663	valid_1's binary_logloss: 0.320131
[139]	valid_0's auc: 0.948623	valid_0's binary_logloss: 0.252624	valid_1's auc: 0.906604	valid_1's binary_logloss: 0.320245
[140]	valid_0's auc: 0.948722	valid_0's binary_logloss: 0.252391	valid_1's auc: 0.906519	valid_1's binary_logloss: 0.320346
[141]	valid_0's auc: 0.948873	valid_0's binary_logloss: 0.252106	valid_1's auc: 0.90639	valid_1's binary_logloss: 0.320531
[142]	valid_0's auc: 0.949089	valid_0's binary_logloss: 0.251688	valid_1's auc: 0.9063	valid_1's binary_logloss: 0.320703
[143]	valid_0's auc: 0.949202	valid_0's binary_logloss: 0.251417	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.32093
[144]	valid_0's auc: 0.94938	valid_0's binary_logloss: 0.251061	valid_1's auc: 0.906265	valid_1's binary_logloss: 0.320934
[145]	valid_0's auc: 0.949575	valid_0's binary_logloss: 0.250724	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.321002
Early stopping, best iteration is:
[45]	valid_0's auc: 0.923957	valid_0's binary_logloss: 0.298126	valid_1's auc: 0.910473	valid_1's binary_logloss: 0.314007
[1]	valid_0's auc: 0.883716	valid_0's binary_logloss: 0.517437	valid_1's auc: 0.891829	valid_1's binary_logloss: 0.508331
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890073	valid_0's binary_logloss: 0.488559	valid_1's auc: 0.895643	valid_1's binary_logloss: 0.47903
[3]	valid_0's auc: 0.89469	valid_0's binary_logloss: 0.465046	valid_1's auc: 0.899849	valid_1's binary_logloss: 0.455412
[4]	valid_0's auc: 0.896069	valid_0's binary_logloss: 0.445806	valid_1's auc: 0.901287	valid_1's binary_logloss: 0.435833
[5]	valid_0's auc: 0.897389	valid_0's binary_logloss: 0.429622	valid_1's auc: 0.901269	valid_1's binary_logloss: 0.419878
[6]	valid_0's auc: 0.898537	valid_0's binary_logloss: 0.415829	valid_1's auc: 0.90164	valid_1's binary_logloss: 0.406518
[7]	valid_0's auc: 0.899913	valid_0's binary_logloss: 0.404082	valid_1's auc: 0.90253	valid_1's binary_logloss: 0.394728
[8]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.394009	valid_1's auc: 0.90316	valid_1's binary_logloss: 0.384967
[9]	valid_0's auc: 0.901575	valid_0's binary_logloss: 0.385168	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.376241
[10]	valid_0's auc: 0.902151	valid_0's binary_logloss: 0.377494	valid_1's auc: 0.904329	valid_1's binary_logloss: 0.368945
[11]	valid_0's auc: 0.903157	valid_0's binary_logloss: 0.370649	valid_1's auc: 0.904521	valid_1's binary_logloss: 0.362422
[12]	valid_0's auc: 0.904146	valid_0's binary_logloss: 0.364509	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.357161
[13]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.358996	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.352531
[14]	valid_0's auc: 0.905821	valid_0's binary_logloss: 0.354303	valid_1's auc: 0.905235	valid_1's binary_logloss: 0.348331
[15]	valid_0's auc: 0.906501	valid_0's binary_logloss: 0.350005	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.344659
[16]	valid_0's auc: 0.907197	valid_0's binary_logloss: 0.346171	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.341413
[17]	valid_0's auc: 0.907706	valid_0's binary_logloss: 0.342767	valid_1's auc: 0.906119	valid_1's binary_logloss: 0.33838
[18]	valid_0's auc: 0.908317	valid_0's binary_logloss: 0.339542	valid_1's auc: 0.906532	valid_1's binary_logloss: 0.335615
[19]	valid_0's auc: 0.909294	valid_0's binary_logloss: 0.336599	valid_1's auc: 0.907164	valid_1's binary_logloss: 0.333169
[20]	valid_0's auc: 0.90999	valid_0's binary_logloss: 0.333889	valid_1's auc: 0.907187	valid_1's binary_logloss: 0.331401
[21]	valid_0's auc: 0.910796	valid_0's binary_logloss: 0.331319	valid_1's auc: 0.907442	valid_1's binary_logloss: 0.329573
[22]	valid_0's auc: 0.911382	valid_0's binary_logloss: 0.329005	valid_1's auc: 0.907783	valid_1's binary_logloss: 0.327861
[23]	valid_0's auc: 0.912164	valid_0's binary_logloss: 0.326684	valid_1's auc: 0.908088	valid_1's binary_logloss: 0.326044
[24]	valid_0's auc: 0.912839	valid_0's binary_logloss: 0.324613	valid_1's auc: 0.908199	valid_1's binary_logloss: 0.32477
[25]	valid_0's auc: 0.913549	valid_0's binary_logloss: 0.322611	valid_1's auc: 0.908385	valid_1's binary_logloss: 0.323644
[26]	valid_0's auc: 0.914061	valid_0's binary_logloss: 0.320916	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.322746
[27]	valid_0's auc: 0.914646	valid_0's binary_logloss: 0.31926	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.321783
[28]	valid_0's auc: 0.91518	valid_0's binary_logloss: 0.31762	valid_1's auc: 0.908938	valid_1's binary_logloss: 0.320791
[29]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.316177	valid_1's auc: 0.908731	valid_1's binary_logloss: 0.320349
[30]	valid_0's auc: 0.916273	valid_0's binary_logloss: 0.314667	valid_1's auc: 0.908747	valid_1's binary_logloss: 0.319864
[31]	valid_0's auc: 0.91676	valid_0's binary_logloss: 0.313286	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.31936
[32]	valid_0's auc: 0.917204	valid_0's binary_logloss: 0.312006	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.318635
[33]	valid_0's auc: 0.917713	valid_0's binary_logloss: 0.310731	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.318135
[34]	valid_0's auc: 0.918131	valid_0's binary_logloss: 0.309675	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.31799
[35]	valid_0's auc: 0.918582	valid_0's binary_logloss: 0.308584	valid_1's auc: 0.908977	valid_1's binary_logloss: 0.31743
[36]	valid_0's auc: 0.919153	valid_0's binary_logloss: 0.307488	valid_1's auc: 0.909043	valid_1's binary_logloss: 0.317176
[37]	valid_0's auc: 0.919574	valid_0's binary_logloss: 0.306567	valid_1's auc: 0.909248	valid_1's binary_logloss: 0.316736
[38]	valid_0's auc: 0.920034	valid_0's binary_logloss: 0.305538	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.316445
[39]	valid_0's auc: 0.920455	valid_0's binary_logloss: 0.304592	valid_1's auc: 0.909118	valid_1's binary_logloss: 0.316396
[40]	valid_0's auc: 0.920838	valid_0's binary_logloss: 0.303703	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.316239
[41]	valid_0's auc: 0.921195	valid_0's binary_logloss: 0.302819	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.316214
[42]	valid_0's auc: 0.921676	valid_0's binary_logloss: 0.301858	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.316114
[43]	valid_0's auc: 0.922118	valid_0's binary_logloss: 0.301017	valid_1's auc: 0.9091	valid_1's binary_logloss: 0.315848
[44]	valid_0's auc: 0.922509	valid_0's binary_logloss: 0.300328	valid_1's auc: 0.909201	valid_1's binary_logloss: 0.315603
[45]	valid_0's auc: 0.922973	valid_0's binary_logloss: 0.299474	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.315188
[46]	valid_0's auc: 0.923431	valid_0's binary_logloss: 0.298601	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.31515
[47]	valid_0's auc: 0.923817	valid_0's binary_logloss: 0.297895	valid_1's auc: 0.909426	valid_1's binary_logloss: 0.315022
[48]	valid_0's auc: 0.92418	valid_0's binary_logloss: 0.297239	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.31489
[49]	valid_0's auc: 0.924611	valid_0's binary_logloss: 0.29649	valid_1's auc: 0.909316	valid_1's binary_logloss: 0.315043
[50]	valid_0's auc: 0.924958	valid_0's binary_logloss: 0.295842	valid_1's auc: 0.909349	valid_1's binary_logloss: 0.314937
[51]	valid_0's auc: 0.925351	valid_0's binary_logloss: 0.295085	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.314744
[52]	valid_0's auc: 0.925636	valid_0's binary_logloss: 0.294599	valid_1's auc: 0.909423	valid_1's binary_logloss: 0.314687
[53]	valid_0's auc: 0.926002	valid_0's binary_logloss: 0.293941	valid_1's auc: 0.909309	valid_1's binary_logloss: 0.314829
[54]	valid_0's auc: 0.926442	valid_0's binary_logloss: 0.293167	valid_1's auc: 0.909189	valid_1's binary_logloss: 0.314951
[55]	valid_0's auc: 0.92683	valid_0's binary_logloss: 0.292467	valid_1's auc: 0.909166	valid_1's binary_logloss: 0.314906
[56]	valid_0's auc: 0.927187	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.909139	valid_1's binary_logloss: 0.314933
[57]	valid_0's auc: 0.927533	valid_0's binary_logloss: 0.291189	valid_1's auc: 0.90898	valid_1's binary_logloss: 0.315139
[58]	valid_0's auc: 0.928016	valid_0's binary_logloss: 0.2904	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.314864
[59]	valid_0's auc: 0.928339	valid_0's binary_logloss: 0.289863	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.314928
[60]	valid_0's auc: 0.92875	valid_0's binary_logloss: 0.289194	valid_1's auc: 0.909001	valid_1's binary_logloss: 0.315072
[61]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.288403	valid_1's auc: 0.909023	valid_1's binary_logloss: 0.314983
[62]	valid_0's auc: 0.929678	valid_0's binary_logloss: 0.287572	valid_1's auc: 0.908998	valid_1's binary_logloss: 0.315016
[63]	valid_0's auc: 0.929988	valid_0's binary_logloss: 0.286969	valid_1's auc: 0.909103	valid_1's binary_logloss: 0.314867
[64]	valid_0's auc: 0.930369	valid_0's binary_logloss: 0.286292	valid_1's auc: 0.909085	valid_1's binary_logloss: 0.314911
[65]	valid_0's auc: 0.930682	valid_0's binary_logloss: 0.285697	valid_1's auc: 0.909126	valid_1's binary_logloss: 0.314869
[66]	valid_0's auc: 0.931088	valid_0's binary_logloss: 0.285091	valid_1's auc: 0.909065	valid_1's binary_logloss: 0.31499
[67]	valid_0's auc: 0.931411	valid_0's binary_logloss: 0.284547	valid_1's auc: 0.908957	valid_1's binary_logloss: 0.315145
[68]	valid_0's auc: 0.931742	valid_0's binary_logloss: 0.283919	valid_1's auc: 0.908886	valid_1's binary_logloss: 0.315191
[69]	valid_0's auc: 0.932053	valid_0's binary_logloss: 0.283427	valid_1's auc: 0.908939	valid_1's binary_logloss: 0.31508
[70]	valid_0's auc: 0.932375	valid_0's binary_logloss: 0.282863	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.315224
[71]	valid_0's auc: 0.932698	valid_0's binary_logloss: 0.2823	valid_1's auc: 0.90882	valid_1's binary_logloss: 0.315262
[72]	valid_0's auc: 0.932968	valid_0's binary_logloss: 0.281835	valid_1's auc: 0.908749	valid_1's binary_logloss: 0.315389
[73]	valid_0's auc: 0.933232	valid_0's binary_logloss: 0.281372	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.315687
[74]	valid_0's auc: 0.933466	valid_0's binary_logloss: 0.280948	valid_1's auc: 0.90843	valid_1's binary_logloss: 0.315869
[75]	valid_0's auc: 0.933773	valid_0's binary_logloss: 0.280406	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.3157
[76]	valid_0's auc: 0.93402	valid_0's binary_logloss: 0.27993	valid_1's auc: 0.908559	valid_1's binary_logloss: 0.315583
[77]	valid_0's auc: 0.934265	valid_0's binary_logloss: 0.27944	valid_1's auc: 0.908501	valid_1's binary_logloss: 0.315647
[78]	valid_0's auc: 0.934593	valid_0's binary_logloss: 0.278892	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.315792
[79]	valid_0's auc: 0.934893	valid_0's binary_logloss: 0.278289	valid_1's auc: 0.908478	valid_1's binary_logloss: 0.315701
[80]	valid_0's auc: 0.93509	valid_0's binary_logloss: 0.277951	valid_1's auc: 0.908439	valid_1's binary_logloss: 0.315758
[81]	valid_0's auc: 0.935353	valid_0's binary_logloss: 0.277445	valid_1's auc: 0.908477	valid_1's binary_logloss: 0.315684
[82]	valid_0's auc: 0.935608	valid_0's binary_logloss: 0.277016	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.315691
[83]	valid_0's auc: 0.935862	valid_0's binary_logloss: 0.276597	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.315919
[84]	valid_0's auc: 0.936122	valid_0's binary_logloss: 0.276122	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.315985
[85]	valid_0's auc: 0.936368	valid_0's binary_logloss: 0.275658	valid_1's auc: 0.908257	valid_1's binary_logloss: 0.315952
[86]	valid_0's auc: 0.936636	valid_0's binary_logloss: 0.275201	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.31603
[87]	valid_0's auc: 0.937046	valid_0's binary_logloss: 0.274498	valid_1's auc: 0.908227	valid_1's binary_logloss: 0.316062
[88]	valid_0's auc: 0.937257	valid_0's binary_logloss: 0.274099	valid_1's auc: 0.908252	valid_1's binary_logloss: 0.315981
[89]	valid_0's auc: 0.93748	valid_0's binary_logloss: 0.273713	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.31602
[90]	valid_0's auc: 0.937695	valid_0's binary_logloss: 0.273335	valid_1's auc: 0.908106	valid_1's binary_logloss: 0.316176
[91]	valid_0's auc: 0.937945	valid_0's binary_logloss: 0.272886	valid_1's auc: 0.90796	valid_1's binary_logloss: 0.316357
[92]	valid_0's auc: 0.938157	valid_0's binary_logloss: 0.272498	valid_1's auc: 0.907956	valid_1's binary_logloss: 0.316372
[93]	valid_0's auc: 0.938359	valid_0's binary_logloss: 0.272149	valid_1's auc: 0.907826	valid_1's binary_logloss: 0.316591
[94]	valid_0's auc: 0.938587	valid_0's binary_logloss: 0.271683	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.316631
[95]	valid_0's auc: 0.938759	valid_0's binary_logloss: 0.271307	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.31669
[96]	valid_0's auc: 0.939088	valid_0's binary_logloss: 0.270739	valid_1's auc: 0.90777	valid_1's binary_logloss: 0.316698
[97]	valid_0's auc: 0.939308	valid_0's binary_logloss: 0.270289	valid_1's auc: 0.907633	valid_1's binary_logloss: 0.316942
[98]	valid_0's auc: 0.939523	valid_0's binary_logloss: 0.269932	valid_1's auc: 0.907534	valid_1's binary_logloss: 0.317123
[99]	valid_0's auc: 0.939729	valid_0's binary_logloss: 0.269552	valid_1's auc: 0.907446	valid_1's binary_logloss: 0.317276
[100]	valid_0's auc: 0.939923	valid_0's binary_logloss: 0.26918	valid_1's auc: 0.907461	valid_1's binary_logloss: 0.317241
[101]	valid_0's auc: 0.94011	valid_0's binary_logloss: 0.26876	valid_1's auc: 0.907318	valid_1's binary_logloss: 0.317514
[102]	valid_0's auc: 0.940323	valid_0's binary_logloss: 0.268393	valid_1's auc: 0.907372	valid_1's binary_logloss: 0.317425
[103]	valid_0's auc: 0.94052	valid_0's binary_logloss: 0.268022	valid_1's auc: 0.907287	valid_1's binary_logloss: 0.317592
[104]	valid_0's auc: 0.940756	valid_0's binary_logloss: 0.267555	valid_1's auc: 0.907159	valid_1's binary_logloss: 0.317818
[105]	valid_0's auc: 0.940982	valid_0's binary_logloss: 0.267184	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.317877
[106]	valid_0's auc: 0.941179	valid_0's binary_logloss: 0.266827	valid_1's auc: 0.906989	valid_1's binary_logloss: 0.318038
[107]	valid_0's auc: 0.941474	valid_0's binary_logloss: 0.266307	valid_1's auc: 0.906898	valid_1's binary_logloss: 0.318199
[108]	valid_0's auc: 0.94175	valid_0's binary_logloss: 0.26582	valid_1's auc: 0.906779	valid_1's binary_logloss: 0.318366
[109]	valid_0's auc: 0.942117	valid_0's binary_logloss: 0.265207	valid_1's auc: 0.906579	valid_1's binary_logloss: 0.318655
[110]	valid_0's auc: 0.942383	valid_0's binary_logloss: 0.264702	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.318811
[111]	valid_0's auc: 0.942648	valid_0's binary_logloss: 0.264201	valid_1's auc: 0.906419	valid_1's binary_logloss: 0.318918
[112]	valid_0's auc: 0.942792	valid_0's binary_logloss: 0.26391	valid_1's auc: 0.906335	valid_1's binary_logloss: 0.319095
[113]	valid_0's auc: 0.942935	valid_0's binary_logloss: 0.263606	valid_1's auc: 0.906287	valid_1's binary_logloss: 0.319201
[114]	valid_0's auc: 0.94312	valid_0's binary_logloss: 0.263239	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.319282
[115]	valid_0's auc: 0.94333	valid_0's binary_logloss: 0.262866	valid_1's auc: 0.906171	valid_1's binary_logloss: 0.319407
[116]	valid_0's auc: 0.943532	valid_0's binary_logloss: 0.26252	valid_1's auc: 0.906085	valid_1's binary_logloss: 0.319512
[117]	valid_0's auc: 0.943773	valid_0's binary_logloss: 0.262109	valid_1's auc: 0.905938	valid_1's binary_logloss: 0.319731
[118]	valid_0's auc: 0.94406	valid_0's binary_logloss: 0.261512	valid_1's auc: 0.905769	valid_1's binary_logloss: 0.319982
[119]	valid_0's auc: 0.944252	valid_0's binary_logloss: 0.26117	valid_1's auc: 0.905578	valid_1's binary_logloss: 0.320289
[120]	valid_0's auc: 0.94443	valid_0's binary_logloss: 0.260805	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.320332
[121]	valid_0's auc: 0.94462	valid_0's binary_logloss: 0.260436	valid_1's auc: 0.905563	valid_1's binary_logloss: 0.320315
[122]	valid_0's auc: 0.944777	valid_0's binary_logloss: 0.26014	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.32036
[123]	valid_0's auc: 0.944979	valid_0's binary_logloss: 0.259752	valid_1's auc: 0.905487	valid_1's binary_logloss: 0.320496
[124]	valid_0's auc: 0.945153	valid_0's binary_logloss: 0.259404	valid_1's auc: 0.905414	valid_1's binary_logloss: 0.320608
[125]	valid_0's auc: 0.945359	valid_0's binary_logloss: 0.258941	valid_1's auc: 0.905357	valid_1's binary_logloss: 0.320733
[126]	valid_0's auc: 0.945515	valid_0's binary_logloss: 0.258649	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.320855
[127]	valid_0's auc: 0.945652	valid_0's binary_logloss: 0.258366	valid_1's auc: 0.905271	valid_1's binary_logloss: 0.320992
[128]	valid_0's auc: 0.945942	valid_0's binary_logloss: 0.257852	valid_1's auc: 0.905257	valid_1's binary_logloss: 0.321043
[129]	valid_0's auc: 0.946094	valid_0's binary_logloss: 0.257524	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.321026
[130]	valid_0's auc: 0.946302	valid_0's binary_logloss: 0.257141	valid_1's auc: 0.905273	valid_1's binary_logloss: 0.321023
[131]	valid_0's auc: 0.946472	valid_0's binary_logloss: 0.256797	valid_1's auc: 0.905221	valid_1's binary_logloss: 0.321181
[132]	valid_0's auc: 0.946576	valid_0's binary_logloss: 0.256549	valid_1's auc: 0.905266	valid_1's binary_logloss: 0.321158
[133]	valid_0's auc: 0.946675	valid_0's binary_logloss: 0.256344	valid_1's auc: 0.905266	valid_1's binary_logloss: 0.321207
[134]	valid_0's auc: 0.946862	valid_0's binary_logloss: 0.255981	valid_1's auc: 0.905167	valid_1's binary_logloss: 0.321417
[135]	valid_0's auc: 0.946999	valid_0's binary_logloss: 0.255725	valid_1's auc: 0.90507	valid_1's binary_logloss: 0.321615
[136]	valid_0's auc: 0.947152	valid_0's binary_logloss: 0.255429	valid_1's auc: 0.905063	valid_1's binary_logloss: 0.321662
[137]	valid_0's auc: 0.947329	valid_0's binary_logloss: 0.255096	valid_1's auc: 0.90497	valid_1's binary_logloss: 0.321794
[138]	valid_0's auc: 0.947418	valid_0's binary_logloss: 0.254873	valid_1's auc: 0.904886	valid_1's binary_logloss: 0.321971
[139]	valid_0's auc: 0.947593	valid_0's binary_logloss: 0.254562	valid_1's auc: 0.904858	valid_1's binary_logloss: 0.322029
[140]	valid_0's auc: 0.947754	valid_0's binary_logloss: 0.254233	valid_1's auc: 0.904843	valid_1's binary_logloss: 0.322119
[141]	valid_0's auc: 0.948003	valid_0's binary_logloss: 0.253773	valid_1's auc: 0.904805	valid_1's binary_logloss: 0.322169
[142]	valid_0's auc: 0.948131	valid_0's binary_logloss: 0.253474	valid_1's auc: 0.90472	valid_1's binary_logloss: 0.322373
[143]	valid_0's auc: 0.948368	valid_0's binary_logloss: 0.253047	valid_1's auc: 0.904639	valid_1's binary_logloss: 0.322552
[144]	valid_0's auc: 0.948615	valid_0's binary_logloss: 0.252575	valid_1's auc: 0.904727	valid_1's binary_logloss: 0.322417
[145]	valid_0's auc: 0.948801	valid_0's binary_logloss: 0.252229	valid_1's auc: 0.904731	valid_1's binary_logloss: 0.322465
[146]	valid_0's auc: 0.948975	valid_0's binary_logloss: 0.251896	valid_1's auc: 0.904737	valid_1's binary_logloss: 0.322505
[147]	valid_0's auc: 0.949207	valid_0's binary_logloss: 0.251457	valid_1's auc: 0.904691	valid_1's binary_logloss: 0.322608
[148]	valid_0's auc: 0.949423	valid_0's binary_logloss: 0.251035	valid_1's auc: 0.904708	valid_1's binary_logloss: 0.322606
Early stopping, best iteration is:
[48]	valid_0's auc: 0.92418	valid_0's binary_logloss: 0.297239	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.31489
[1]	valid_0's auc: 0.889031	valid_0's binary_logloss: 0.516579	valid_1's auc: 0.896723	valid_1's binary_logloss: 0.507458
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892164	valid_0's binary_logloss: 0.487355	valid_1's auc: 0.898379	valid_1's binary_logloss: 0.477426
[3]	valid_0's auc: 0.893991	valid_0's binary_logloss: 0.463908	valid_1's auc: 0.900966	valid_1's binary_logloss: 0.453477
[4]	valid_0's auc: 0.895536	valid_0's binary_logloss: 0.444506	valid_1's auc: 0.900916	valid_1's binary_logloss: 0.43446
[5]	valid_0's auc: 0.895846	valid_0's binary_logloss: 0.428496	valid_1's auc: 0.900658	valid_1's binary_logloss: 0.41849
[6]	valid_0's auc: 0.897167	valid_0's binary_logloss: 0.414703	valid_1's auc: 0.901702	valid_1's binary_logloss: 0.404942
[7]	valid_0's auc: 0.897784	valid_0's binary_logloss: 0.403095	valid_1's auc: 0.902279	valid_1's binary_logloss: 0.393273
[8]	valid_0's auc: 0.898713	valid_0's binary_logloss: 0.393054	valid_1's auc: 0.902347	valid_1's binary_logloss: 0.383885
[9]	valid_0's auc: 0.902294	valid_0's binary_logloss: 0.38416	valid_1's auc: 0.904294	valid_1's binary_logloss: 0.375629
[10]	valid_0's auc: 0.903355	valid_0's binary_logloss: 0.376336	valid_1's auc: 0.904676	valid_1's binary_logloss: 0.368481
[11]	valid_0's auc: 0.903988	valid_0's binary_logloss: 0.369543	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.362239
[12]	valid_0's auc: 0.904553	valid_0's binary_logloss: 0.363566	valid_1's auc: 0.904913	valid_1's binary_logloss: 0.356787
[13]	valid_0's auc: 0.905538	valid_0's binary_logloss: 0.35817	valid_1's auc: 0.905471	valid_1's binary_logloss: 0.351875
[14]	valid_0's auc: 0.906094	valid_0's binary_logloss: 0.353414	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.347498
[15]	valid_0's auc: 0.906689	valid_0's binary_logloss: 0.349218	valid_1's auc: 0.905742	valid_1's binary_logloss: 0.344195
[16]	valid_0's auc: 0.907549	valid_0's binary_logloss: 0.345324	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.341113
[17]	valid_0's auc: 0.908451	valid_0's binary_logloss: 0.341791	valid_1's auc: 0.906324	valid_1's binary_logloss: 0.338325
[18]	valid_0's auc: 0.909157	valid_0's binary_logloss: 0.338598	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.335633
[19]	valid_0's auc: 0.910038	valid_0's binary_logloss: 0.335529	valid_1's auc: 0.906706	valid_1's binary_logloss: 0.333723
[20]	valid_0's auc: 0.910713	valid_0's binary_logloss: 0.332831	valid_1's auc: 0.906867	valid_1's binary_logloss: 0.331714
[21]	valid_0's auc: 0.911634	valid_0's binary_logloss: 0.330075	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.329824
[22]	valid_0's auc: 0.912278	valid_0's binary_logloss: 0.327816	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.328227
[23]	valid_0's auc: 0.912991	valid_0's binary_logloss: 0.325524	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.326579
[24]	valid_0's auc: 0.913625	valid_0's binary_logloss: 0.323469	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.325444
[25]	valid_0's auc: 0.914248	valid_0's binary_logloss: 0.321489	valid_1's auc: 0.908274	valid_1's binary_logloss: 0.324004
[26]	valid_0's auc: 0.914868	valid_0's binary_logloss: 0.319685	valid_1's auc: 0.908371	valid_1's binary_logloss: 0.323014
[27]	valid_0's auc: 0.915371	valid_0's binary_logloss: 0.318143	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.32196
[28]	valid_0's auc: 0.916013	valid_0's binary_logloss: 0.316508	valid_1's auc: 0.908739	valid_1's binary_logloss: 0.321156
[29]	valid_0's auc: 0.9165	valid_0's binary_logloss: 0.315094	valid_1's auc: 0.908702	valid_1's binary_logloss: 0.320628
[30]	valid_0's auc: 0.916968	valid_0's binary_logloss: 0.313842	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.319954
[31]	valid_0's auc: 0.917477	valid_0's binary_logloss: 0.312456	valid_1's auc: 0.909088	valid_1's binary_logloss: 0.319123
[32]	valid_0's auc: 0.917927	valid_0's binary_logloss: 0.311173	valid_1's auc: 0.90924	valid_1's binary_logloss: 0.318445
[33]	valid_0's auc: 0.918412	valid_0's binary_logloss: 0.309891	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.317731
[34]	valid_0's auc: 0.918856	valid_0's binary_logloss: 0.308845	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.317449
[35]	valid_0's auc: 0.919242	valid_0's binary_logloss: 0.30776	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.317064
[36]	valid_0's auc: 0.919636	valid_0's binary_logloss: 0.306756	valid_1's auc: 0.909324	valid_1's binary_logloss: 0.316776
[37]	valid_0's auc: 0.920134	valid_0's binary_logloss: 0.305665	valid_1's auc: 0.909257	valid_1's binary_logloss: 0.316698
[38]	valid_0's auc: 0.920609	valid_0's binary_logloss: 0.304655	valid_1's auc: 0.909326	valid_1's binary_logloss: 0.31641
[39]	valid_0's auc: 0.921002	valid_0's binary_logloss: 0.303746	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316348
[40]	valid_0's auc: 0.921495	valid_0's binary_logloss: 0.302707	valid_1's auc: 0.909433	valid_1's binary_logloss: 0.31593
[41]	valid_0's auc: 0.921908	valid_0's binary_logloss: 0.301861	valid_1's auc: 0.909337	valid_1's binary_logloss: 0.315878
[42]	valid_0's auc: 0.922423	valid_0's binary_logloss: 0.300876	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.315729
[43]	valid_0's auc: 0.922847	valid_0's binary_logloss: 0.299958	valid_1's auc: 0.909474	valid_1's binary_logloss: 0.31542
[44]	valid_0's auc: 0.923235	valid_0's binary_logloss: 0.29914	valid_1's auc: 0.909496	valid_1's binary_logloss: 0.315238
[45]	valid_0's auc: 0.923566	valid_0's binary_logloss: 0.298438	valid_1's auc: 0.909643	valid_1's binary_logloss: 0.314977
[46]	valid_0's auc: 0.923915	valid_0's binary_logloss: 0.297727	valid_1's auc: 0.909614	valid_1's binary_logloss: 0.314969
[47]	valid_0's auc: 0.924265	valid_0's binary_logloss: 0.297041	valid_1's auc: 0.909587	valid_1's binary_logloss: 0.314904
[48]	valid_0's auc: 0.924709	valid_0's binary_logloss: 0.296159	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314773
[49]	valid_0's auc: 0.925106	valid_0's binary_logloss: 0.295397	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.314654
[50]	valid_0's auc: 0.925476	valid_0's binary_logloss: 0.294712	valid_1's auc: 0.909534	valid_1's binary_logloss: 0.314853
[51]	valid_0's auc: 0.925824	valid_0's binary_logloss: 0.294027	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314817
[52]	valid_0's auc: 0.926122	valid_0's binary_logloss: 0.293495	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314756
[53]	valid_0's auc: 0.926487	valid_0's binary_logloss: 0.292777	valid_1's auc: 0.909578	valid_1's binary_logloss: 0.314687
[54]	valid_0's auc: 0.926757	valid_0's binary_logloss: 0.292188	valid_1's auc: 0.909616	valid_1's binary_logloss: 0.314586
[55]	valid_0's auc: 0.927077	valid_0's binary_logloss: 0.291593	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314447
[56]	valid_0's auc: 0.927471	valid_0's binary_logloss: 0.290865	valid_1's auc: 0.90965	valid_1's binary_logloss: 0.314491
[57]	valid_0's auc: 0.927818	valid_0's binary_logloss: 0.290232	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.314482
[58]	valid_0's auc: 0.928086	valid_0's binary_logloss: 0.289699	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.31454
[59]	valid_0's auc: 0.928488	valid_0's binary_logloss: 0.28898	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.31455
[60]	valid_0's auc: 0.928775	valid_0's binary_logloss: 0.288429	valid_1's auc: 0.909538	valid_1's binary_logloss: 0.314625
[61]	valid_0's auc: 0.929162	valid_0's binary_logloss: 0.287728	valid_1's auc: 0.909589	valid_1's binary_logloss: 0.314539
[62]	valid_0's auc: 0.929604	valid_0's binary_logloss: 0.287018	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.314722
[63]	valid_0's auc: 0.929952	valid_0's binary_logloss: 0.286422	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.314802
[64]	valid_0's auc: 0.930248	valid_0's binary_logloss: 0.285901	valid_1's auc: 0.909232	valid_1's binary_logloss: 0.315051
[65]	valid_0's auc: 0.930539	valid_0's binary_logloss: 0.285381	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31524
[66]	valid_0's auc: 0.930859	valid_0's binary_logloss: 0.284803	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.315131
[67]	valid_0's auc: 0.931146	valid_0's binary_logloss: 0.284241	valid_1's auc: 0.908983	valid_1's binary_logloss: 0.315413
[68]	valid_0's auc: 0.931571	valid_0's binary_logloss: 0.283554	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.315561
[69]	valid_0's auc: 0.931886	valid_0's binary_logloss: 0.283024	valid_1's auc: 0.908878	valid_1's binary_logloss: 0.315626
[70]	valid_0's auc: 0.932168	valid_0's binary_logloss: 0.282496	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.315751
[71]	valid_0's auc: 0.932471	valid_0's binary_logloss: 0.281921	valid_1's auc: 0.908811	valid_1's binary_logloss: 0.315777
[72]	valid_0's auc: 0.932789	valid_0's binary_logloss: 0.281355	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.315795
[73]	valid_0's auc: 0.933146	valid_0's binary_logloss: 0.280779	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.316064
[74]	valid_0's auc: 0.93344	valid_0's binary_logloss: 0.280261	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.31615
[75]	valid_0's auc: 0.933611	valid_0's binary_logloss: 0.279841	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315964
[76]	valid_0's auc: 0.933837	valid_0's binary_logloss: 0.27939	valid_1's auc: 0.908695	valid_1's binary_logloss: 0.315919
[77]	valid_0's auc: 0.934116	valid_0's binary_logloss: 0.278947	valid_1's auc: 0.908686	valid_1's binary_logloss: 0.315926
[78]	valid_0's auc: 0.934391	valid_0's binary_logloss: 0.278469	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.316043
[79]	valid_0's auc: 0.934704	valid_0's binary_logloss: 0.277891	valid_1's auc: 0.908499	valid_1's binary_logloss: 0.316303
[80]	valid_0's auc: 0.934897	valid_0's binary_logloss: 0.277476	valid_1's auc: 0.908447	valid_1's binary_logloss: 0.316355
[81]	valid_0's auc: 0.935218	valid_0's binary_logloss: 0.276925	valid_1's auc: 0.908424	valid_1's binary_logloss: 0.316429
[82]	valid_0's auc: 0.935446	valid_0's binary_logloss: 0.276461	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.316526
[83]	valid_0's auc: 0.935717	valid_0's binary_logloss: 0.27601	valid_1's auc: 0.908496	valid_1's binary_logloss: 0.316329
[84]	valid_0's auc: 0.935997	valid_0's binary_logloss: 0.275559	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316415
[85]	valid_0's auc: 0.936359	valid_0's binary_logloss: 0.274987	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.316217
[86]	valid_0's auc: 0.936629	valid_0's binary_logloss: 0.274545	valid_1's auc: 0.908503	valid_1's binary_logloss: 0.316244
[87]	valid_0's auc: 0.936842	valid_0's binary_logloss: 0.274134	valid_1's auc: 0.908378	valid_1's binary_logloss: 0.316459
[88]	valid_0's auc: 0.937084	valid_0's binary_logloss: 0.273721	valid_1's auc: 0.908353	valid_1's binary_logloss: 0.316478
[89]	valid_0's auc: 0.937334	valid_0's binary_logloss: 0.273258	valid_1's auc: 0.908335	valid_1's binary_logloss: 0.316523
[90]	valid_0's auc: 0.93752	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.908264	valid_1's binary_logloss: 0.316655
[91]	valid_0's auc: 0.93778	valid_0's binary_logloss: 0.272463	valid_1's auc: 0.908155	valid_1's binary_logloss: 0.316889
[92]	valid_0's auc: 0.938109	valid_0's binary_logloss: 0.271912	valid_1's auc: 0.908064	valid_1's binary_logloss: 0.31704
[93]	valid_0's auc: 0.938301	valid_0's binary_logloss: 0.271506	valid_1's auc: 0.908165	valid_1's binary_logloss: 0.316845
[94]	valid_0's auc: 0.938574	valid_0's binary_logloss: 0.271049	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.316724
[95]	valid_0's auc: 0.938831	valid_0's binary_logloss: 0.270617	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.316538
[96]	valid_0's auc: 0.938989	valid_0's binary_logloss: 0.270247	valid_1's auc: 0.908291	valid_1's binary_logloss: 0.316662
[97]	valid_0's auc: 0.939363	valid_0's binary_logloss: 0.269571	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316925
[98]	valid_0's auc: 0.939648	valid_0's binary_logloss: 0.269072	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.31696
[99]	valid_0's auc: 0.939855	valid_0's binary_logloss: 0.268664	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.317031
[100]	valid_0's auc: 0.940126	valid_0's binary_logloss: 0.268181	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.317212
[101]	valid_0's auc: 0.940435	valid_0's binary_logloss: 0.267675	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.317394
[102]	valid_0's auc: 0.940697	valid_0's binary_logloss: 0.267238	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.317579
[103]	valid_0's auc: 0.940958	valid_0's binary_logloss: 0.266773	valid_1's auc: 0.907711	valid_1's binary_logloss: 0.317707
[104]	valid_0's auc: 0.941198	valid_0's binary_logloss: 0.266341	valid_1's auc: 0.90765	valid_1's binary_logloss: 0.31785
[105]	valid_0's auc: 0.9414	valid_0's binary_logloss: 0.265922	valid_1's auc: 0.907632	valid_1's binary_logloss: 0.317866
[106]	valid_0's auc: 0.941665	valid_0's binary_logloss: 0.265441	valid_1's auc: 0.907555	valid_1's binary_logloss: 0.318049
[107]	valid_0's auc: 0.941982	valid_0's binary_logloss: 0.264838	valid_1's auc: 0.907359	valid_1's binary_logloss: 0.318445
[108]	valid_0's auc: 0.942163	valid_0's binary_logloss: 0.264447	valid_1's auc: 0.907241	valid_1's binary_logloss: 0.318673
[109]	valid_0's auc: 0.942443	valid_0's binary_logloss: 0.263923	valid_1's auc: 0.90725	valid_1's binary_logloss: 0.318661
[110]	valid_0's auc: 0.942667	valid_0's binary_logloss: 0.263477	valid_1's auc: 0.907244	valid_1's binary_logloss: 0.318654
[111]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.262934	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318711
[112]	valid_0's auc: 0.943205	valid_0's binary_logloss: 0.262527	valid_1's auc: 0.90725	valid_1's binary_logloss: 0.318762
[113]	valid_0's auc: 0.943417	valid_0's binary_logloss: 0.262151	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318951
[114]	valid_0's auc: 0.9436	valid_0's binary_logloss: 0.261796	valid_1's auc: 0.907191	valid_1's binary_logloss: 0.318882
[115]	valid_0's auc: 0.94381	valid_0's binary_logloss: 0.261434	valid_1's auc: 0.907168	valid_1's binary_logloss: 0.318937
[116]	valid_0's auc: 0.943938	valid_0's binary_logloss: 0.261187	valid_1's auc: 0.907157	valid_1's binary_logloss: 0.318953
[117]	valid_0's auc: 0.944117	valid_0's binary_logloss: 0.260838	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.319024
[118]	valid_0's auc: 0.944258	valid_0's binary_logloss: 0.260561	valid_1's auc: 0.907103	valid_1's binary_logloss: 0.31907
[119]	valid_0's auc: 0.944462	valid_0's binary_logloss: 0.260174	valid_1's auc: 0.906947	valid_1's binary_logloss: 0.319334
[120]	valid_0's auc: 0.944622	valid_0's binary_logloss: 0.259853	valid_1's auc: 0.906871	valid_1's binary_logloss: 0.319482
[121]	valid_0's auc: 0.944842	valid_0's binary_logloss: 0.259447	valid_1's auc: 0.90682	valid_1's binary_logloss: 0.319603
[122]	valid_0's auc: 0.944951	valid_0's binary_logloss: 0.259244	valid_1's auc: 0.906772	valid_1's binary_logloss: 0.31969
[123]	valid_0's auc: 0.94514	valid_0's binary_logloss: 0.25886	valid_1's auc: 0.906763	valid_1's binary_logloss: 0.319732
[124]	valid_0's auc: 0.945274	valid_0's binary_logloss: 0.258594	valid_1's auc: 0.906728	valid_1's binary_logloss: 0.319808
[125]	valid_0's auc: 0.945415	valid_0's binary_logloss: 0.25831	valid_1's auc: 0.906697	valid_1's binary_logloss: 0.319892
[126]	valid_0's auc: 0.945612	valid_0's binary_logloss: 0.257959	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.320089
[127]	valid_0's auc: 0.945829	valid_0's binary_logloss: 0.257571	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.320055
[128]	valid_0's auc: 0.94611	valid_0's binary_logloss: 0.257035	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320114
[129]	valid_0's auc: 0.946377	valid_0's binary_logloss: 0.256539	valid_1's auc: 0.906599	valid_1's binary_logloss: 0.320193
[130]	valid_0's auc: 0.946636	valid_0's binary_logloss: 0.256038	valid_1's auc: 0.906413	valid_1's binary_logloss: 0.320506
[131]	valid_0's auc: 0.946813	valid_0's binary_logloss: 0.255686	valid_1's auc: 0.906319	valid_1's binary_logloss: 0.320679
[132]	valid_0's auc: 0.947044	valid_0's binary_logloss: 0.255266	valid_1's auc: 0.906368	valid_1's binary_logloss: 0.320661
[133]	valid_0's auc: 0.947154	valid_0's binary_logloss: 0.25504	valid_1's auc: 0.906418	valid_1's binary_logloss: 0.320569
[134]	valid_0's auc: 0.947312	valid_0's binary_logloss: 0.254733	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.320621
[135]	valid_0's auc: 0.947434	valid_0's binary_logloss: 0.254504	valid_1's auc: 0.906347	valid_1's binary_logloss: 0.320712
[136]	valid_0's auc: 0.947551	valid_0's binary_logloss: 0.254246	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.320997
[137]	valid_0's auc: 0.94776	valid_0's binary_logloss: 0.253837	valid_1's auc: 0.906172	valid_1's binary_logloss: 0.321128
[138]	valid_0's auc: 0.947923	valid_0's binary_logloss: 0.253515	valid_1's auc: 0.906112	valid_1's binary_logloss: 0.321222
[139]	valid_0's auc: 0.948251	valid_0's binary_logloss: 0.252921	valid_1's auc: 0.906227	valid_1's binary_logloss: 0.321089
[140]	valid_0's auc: 0.948378	valid_0's binary_logloss: 0.252614	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.321136
[141]	valid_0's auc: 0.948539	valid_0's binary_logloss: 0.252302	valid_1's auc: 0.906081	valid_1's binary_logloss: 0.321339
[142]	valid_0's auc: 0.948718	valid_0's binary_logloss: 0.251942	valid_1's auc: 0.906054	valid_1's binary_logloss: 0.321403
[143]	valid_0's auc: 0.948984	valid_0's binary_logloss: 0.251466	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.321482
[144]	valid_0's auc: 0.949255	valid_0's binary_logloss: 0.250997	valid_1's auc: 0.906143	valid_1's binary_logloss: 0.321313
[145]	valid_0's auc: 0.949399	valid_0's binary_logloss: 0.250701	valid_1's auc: 0.906083	valid_1's binary_logloss: 0.321442
[146]	valid_0's auc: 0.949633	valid_0's binary_logloss: 0.250241	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.32167
[147]	valid_0's auc: 0.949774	valid_0's binary_logloss: 0.249945	valid_1's auc: 0.905981	valid_1's binary_logloss: 0.321676
[148]	valid_0's auc: 0.949919	valid_0's binary_logloss: 0.249615	valid_1's auc: 0.905992	valid_1's binary_logloss: 0.321656
[149]	valid_0's auc: 0.950048	valid_0's binary_logloss: 0.249366	valid_1's auc: 0.905952	valid_1's binary_logloss: 0.321717
Early stopping, best iteration is:
[49]	valid_0's auc: 0.925106	valid_0's binary_logloss: 0.295397	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.314654
[1]	valid_0's auc: 0.888084	valid_0's binary_logloss: 0.516884	valid_1's auc: 0.893464	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890797	valid_0's binary_logloss: 0.487718	valid_1's auc: 0.897592	valid_1's binary_logloss: 0.478465
[3]	valid_0's auc: 0.892513	valid_0's binary_logloss: 0.464334	valid_1's auc: 0.898665	valid_1's binary_logloss: 0.454805
[4]	valid_0's auc: 0.894815	valid_0's binary_logloss: 0.444821	valid_1's auc: 0.899433	valid_1's binary_logloss: 0.435394
[5]	valid_0's auc: 0.896021	valid_0's binary_logloss: 0.428702	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419476
[6]	valid_0's auc: 0.89928	valid_0's binary_logloss: 0.415058	valid_1's auc: 0.902649	valid_1's binary_logloss: 0.405991
[7]	valid_0's auc: 0.900439	valid_0's binary_logloss: 0.403201	valid_1's auc: 0.902605	valid_1's binary_logloss: 0.394544
[8]	valid_0's auc: 0.901538	valid_0's binary_logloss: 0.393166	valid_1's auc: 0.903058	valid_1's binary_logloss: 0.384843
[9]	valid_0's auc: 0.902204	valid_0's binary_logloss: 0.384401	valid_1's auc: 0.903156	valid_1's binary_logloss: 0.376624
[10]	valid_0's auc: 0.903221	valid_0's binary_logloss: 0.376758	valid_1's auc: 0.903175	valid_1's binary_logloss: 0.369696
[11]	valid_0's auc: 0.904073	valid_0's binary_logloss: 0.369858	valid_1's auc: 0.90337	valid_1's binary_logloss: 0.36353
[12]	valid_0's auc: 0.9048	valid_0's binary_logloss: 0.363903	valid_1's auc: 0.904	valid_1's binary_logloss: 0.357996
[13]	valid_0's auc: 0.905852	valid_0's binary_logloss: 0.358528	valid_1's auc: 0.904463	valid_1's binary_logloss: 0.353176
[14]	valid_0's auc: 0.906544	valid_0's binary_logloss: 0.353777	valid_1's auc: 0.904775	valid_1's binary_logloss: 0.348981
[15]	valid_0's auc: 0.907501	valid_0's binary_logloss: 0.349288	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.345392
[16]	valid_0's auc: 0.908224	valid_0's binary_logloss: 0.345361	valid_1's auc: 0.905819	valid_1's binary_logloss: 0.341971
[17]	valid_0's auc: 0.908902	valid_0's binary_logloss: 0.341809	valid_1's auc: 0.905831	valid_1's binary_logloss: 0.339271
[18]	valid_0's auc: 0.909407	valid_0's binary_logloss: 0.338728	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.336615
[19]	valid_0's auc: 0.910331	valid_0's binary_logloss: 0.33564	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.334456
[20]	valid_0's auc: 0.910901	valid_0's binary_logloss: 0.332967	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.332309
[21]	valid_0's auc: 0.911538	valid_0's binary_logloss: 0.330566	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.330669
[22]	valid_0's auc: 0.912064	valid_0's binary_logloss: 0.328361	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.329121
[23]	valid_0's auc: 0.912885	valid_0's binary_logloss: 0.326088	valid_1's auc: 0.907117	valid_1's binary_logloss: 0.32779
[24]	valid_0's auc: 0.913529	valid_0's binary_logloss: 0.323942	valid_1's auc: 0.907317	valid_1's binary_logloss: 0.326314
[25]	valid_0's auc: 0.914062	valid_0's binary_logloss: 0.322036	valid_1's auc: 0.907398	valid_1's binary_logloss: 0.325299
[26]	valid_0's auc: 0.914586	valid_0's binary_logloss: 0.320323	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.324142
[27]	valid_0's auc: 0.915109	valid_0's binary_logloss: 0.318676	valid_1's auc: 0.907677	valid_1's binary_logloss: 0.323322
[28]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.317074	valid_1's auc: 0.907512	valid_1's binary_logloss: 0.322839
[29]	valid_0's auc: 0.916231	valid_0's binary_logloss: 0.315562	valid_1's auc: 0.907548	valid_1's binary_logloss: 0.322137
[30]	valid_0's auc: 0.916764	valid_0's binary_logloss: 0.314118	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.321508
[31]	valid_0's auc: 0.917363	valid_0's binary_logloss: 0.312626	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.320864
[32]	valid_0's auc: 0.917866	valid_0's binary_logloss: 0.311379	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.320495
[33]	valid_0's auc: 0.918423	valid_0's binary_logloss: 0.310066	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.320319
[34]	valid_0's auc: 0.918943	valid_0's binary_logloss: 0.308859	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.320047
[35]	valid_0's auc: 0.919479	valid_0's binary_logloss: 0.307644	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.319762
[36]	valid_0's auc: 0.920042	valid_0's binary_logloss: 0.306443	valid_1's auc: 0.907741	valid_1's binary_logloss: 0.319378
[37]	valid_0's auc: 0.920618	valid_0's binary_logloss: 0.305329	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.319344
[38]	valid_0's auc: 0.921094	valid_0's binary_logloss: 0.304269	valid_1's auc: 0.90753	valid_1's binary_logloss: 0.319331
[39]	valid_0's auc: 0.921495	valid_0's binary_logloss: 0.303341	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.319278
[40]	valid_0's auc: 0.921992	valid_0's binary_logloss: 0.302363	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.319064
[41]	valid_0's auc: 0.92246	valid_0's binary_logloss: 0.301364	valid_1's auc: 0.907618	valid_1's binary_logloss: 0.318754
[42]	valid_0's auc: 0.922914	valid_0's binary_logloss: 0.300405	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.318491
[43]	valid_0's auc: 0.923272	valid_0's binary_logloss: 0.299597	valid_1's auc: 0.907829	valid_1's binary_logloss: 0.318247
[44]	valid_0's auc: 0.923698	valid_0's binary_logloss: 0.298756	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.318189
[45]	valid_0's auc: 0.924137	valid_0's binary_logloss: 0.297894	valid_1's auc: 0.907621	valid_1's binary_logloss: 0.318336
[46]	valid_0's auc: 0.924454	valid_0's binary_logloss: 0.297225	valid_1's auc: 0.907634	valid_1's binary_logloss: 0.318217
[47]	valid_0's auc: 0.924878	valid_0's binary_logloss: 0.296435	valid_1's auc: 0.907569	valid_1's binary_logloss: 0.318201
[48]	valid_0's auc: 0.925247	valid_0's binary_logloss: 0.295698	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317998
[49]	valid_0's auc: 0.925601	valid_0's binary_logloss: 0.295045	valid_1's auc: 0.907648	valid_1's binary_logloss: 0.317992
[50]	valid_0's auc: 0.926042	valid_0's binary_logloss: 0.294282	valid_1's auc: 0.907637	valid_1's binary_logloss: 0.317905
[51]	valid_0's auc: 0.926443	valid_0's binary_logloss: 0.293488	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317894
[52]	valid_0's auc: 0.926768	valid_0's binary_logloss: 0.292808	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317849
[53]	valid_0's auc: 0.927053	valid_0's binary_logloss: 0.292247	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.317869
[54]	valid_0's auc: 0.927414	valid_0's binary_logloss: 0.291576	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317797
[55]	valid_0's auc: 0.927746	valid_0's binary_logloss: 0.290957	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.317979
[56]	valid_0's auc: 0.928103	valid_0's binary_logloss: 0.290298	valid_1's auc: 0.907421	valid_1's binary_logloss: 0.317903
[57]	valid_0's auc: 0.928408	valid_0's binary_logloss: 0.289733	valid_1's auc: 0.907381	valid_1's binary_logloss: 0.317986
[58]	valid_0's auc: 0.928677	valid_0's binary_logloss: 0.289255	valid_1's auc: 0.907292	valid_1's binary_logloss: 0.318151
[59]	valid_0's auc: 0.928959	valid_0's binary_logloss: 0.28874	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.318223
[60]	valid_0's auc: 0.929419	valid_0's binary_logloss: 0.287974	valid_1's auc: 0.907166	valid_1's binary_logloss: 0.318271
[61]	valid_0's auc: 0.929747	valid_0's binary_logloss: 0.287367	valid_1's auc: 0.907061	valid_1's binary_logloss: 0.318443
[62]	valid_0's auc: 0.930107	valid_0's binary_logloss: 0.286665	valid_1's auc: 0.907051	valid_1's binary_logloss: 0.318496
[63]	valid_0's auc: 0.930363	valid_0's binary_logloss: 0.286153	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318513
[64]	valid_0's auc: 0.930884	valid_0's binary_logloss: 0.285287	valid_1's auc: 0.906964	valid_1's binary_logloss: 0.318665
[65]	valid_0's auc: 0.931208	valid_0's binary_logloss: 0.28474	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.318666
[66]	valid_0's auc: 0.93161	valid_0's binary_logloss: 0.284063	valid_1's auc: 0.90683	valid_1's binary_logloss: 0.318818
[67]	valid_0's auc: 0.932005	valid_0's binary_logloss: 0.283433	valid_1's auc: 0.906719	valid_1's binary_logloss: 0.319017
[68]	valid_0's auc: 0.932234	valid_0's binary_logloss: 0.282989	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.31896
[69]	valid_0's auc: 0.932532	valid_0's binary_logloss: 0.282459	valid_1's auc: 0.906718	valid_1's binary_logloss: 0.319051
[70]	valid_0's auc: 0.932851	valid_0's binary_logloss: 0.281905	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319261
[71]	valid_0's auc: 0.933203	valid_0's binary_logloss: 0.281336	valid_1's auc: 0.906564	valid_1's binary_logloss: 0.319306
[72]	valid_0's auc: 0.933431	valid_0's binary_logloss: 0.280894	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.31932
[73]	valid_0's auc: 0.933727	valid_0's binary_logloss: 0.280387	valid_1's auc: 0.906539	valid_1's binary_logloss: 0.319411
[74]	valid_0's auc: 0.934042	valid_0's binary_logloss: 0.279796	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.31948
[75]	valid_0's auc: 0.934394	valid_0's binary_logloss: 0.27917	valid_1's auc: 0.906495	valid_1's binary_logloss: 0.319511
[76]	valid_0's auc: 0.934695	valid_0's binary_logloss: 0.278645	valid_1's auc: 0.906547	valid_1's binary_logloss: 0.319479
[77]	valid_0's auc: 0.934944	valid_0's binary_logloss: 0.278168	valid_1's auc: 0.906468	valid_1's binary_logloss: 0.319624
[78]	valid_0's auc: 0.935173	valid_0's binary_logloss: 0.277762	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319689
[79]	valid_0's auc: 0.93554	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.31983
[80]	valid_0's auc: 0.935807	valid_0's binary_logloss: 0.276634	valid_1's auc: 0.906268	valid_1's binary_logloss: 0.320015
[81]	valid_0's auc: 0.936023	valid_0's binary_logloss: 0.276149	valid_1's auc: 0.90618	valid_1's binary_logloss: 0.320191
[82]	valid_0's auc: 0.936238	valid_0's binary_logloss: 0.275725	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.320173
[83]	valid_0's auc: 0.936413	valid_0's binary_logloss: 0.275363	valid_1's auc: 0.906154	valid_1's binary_logloss: 0.320239
[84]	valid_0's auc: 0.936647	valid_0's binary_logloss: 0.274935	valid_1's auc: 0.906111	valid_1's binary_logloss: 0.320317
[85]	valid_0's auc: 0.936899	valid_0's binary_logloss: 0.274474	valid_1's auc: 0.906003	valid_1's binary_logloss: 0.320526
[86]	valid_0's auc: 0.937216	valid_0's binary_logloss: 0.273966	valid_1's auc: 0.905982	valid_1's binary_logloss: 0.320597
[87]	valid_0's auc: 0.937491	valid_0's binary_logloss: 0.273486	valid_1's auc: 0.905997	valid_1's binary_logloss: 0.320563
[88]	valid_0's auc: 0.937709	valid_0's binary_logloss: 0.273036	valid_1's auc: 0.905951	valid_1's binary_logloss: 0.320615
[89]	valid_0's auc: 0.937895	valid_0's binary_logloss: 0.272677	valid_1's auc: 0.905905	valid_1's binary_logloss: 0.320696
[90]	valid_0's auc: 0.938111	valid_0's binary_logloss: 0.272272	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.320848
[91]	valid_0's auc: 0.93837	valid_0's binary_logloss: 0.271827	valid_1's auc: 0.905725	valid_1's binary_logloss: 0.321086
[92]	valid_0's auc: 0.93861	valid_0's binary_logloss: 0.271409	valid_1's auc: 0.905726	valid_1's binary_logloss: 0.321074
[93]	valid_0's auc: 0.938874	valid_0's binary_logloss: 0.270956	valid_1's auc: 0.905792	valid_1's binary_logloss: 0.32098
[94]	valid_0's auc: 0.939119	valid_0's binary_logloss: 0.270462	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.321035
[95]	valid_0's auc: 0.93943	valid_0's binary_logloss: 0.269887	valid_1's auc: 0.905779	valid_1's binary_logloss: 0.321089
[96]	valid_0's auc: 0.939637	valid_0's binary_logloss: 0.269504	valid_1's auc: 0.905731	valid_1's binary_logloss: 0.3212
[97]	valid_0's auc: 0.939819	valid_0's binary_logloss: 0.269107	valid_1's auc: 0.905578	valid_1's binary_logloss: 0.321459
[98]	valid_0's auc: 0.940151	valid_0's binary_logloss: 0.268548	valid_1's auc: 0.905365	valid_1's binary_logloss: 0.321814
[99]	valid_0's auc: 0.940369	valid_0's binary_logloss: 0.26817	valid_1's auc: 0.905271	valid_1's binary_logloss: 0.322006
[100]	valid_0's auc: 0.940622	valid_0's binary_logloss: 0.267724	valid_1's auc: 0.905313	valid_1's binary_logloss: 0.321967
[101]	valid_0's auc: 0.940873	valid_0's binary_logloss: 0.267265	valid_1's auc: 0.905192	valid_1's binary_logloss: 0.322163
[102]	valid_0's auc: 0.941073	valid_0's binary_logloss: 0.266896	valid_1's auc: 0.905099	valid_1's binary_logloss: 0.32232
[103]	valid_0's auc: 0.941367	valid_0's binary_logloss: 0.266401	valid_1's auc: 0.904994	valid_1's binary_logloss: 0.322516
[104]	valid_0's auc: 0.941577	valid_0's binary_logloss: 0.265981	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.322435
[105]	valid_0's auc: 0.941797	valid_0's binary_logloss: 0.265561	valid_1's auc: 0.904876	valid_1's binary_logloss: 0.322698
[106]	valid_0's auc: 0.942068	valid_0's binary_logloss: 0.26511	valid_1's auc: 0.90486	valid_1's binary_logloss: 0.32275
[107]	valid_0's auc: 0.942208	valid_0's binary_logloss: 0.264839	valid_1's auc: 0.904748	valid_1's binary_logloss: 0.322953
[108]	valid_0's auc: 0.942494	valid_0's binary_logloss: 0.264328	valid_1's auc: 0.904639	valid_1's binary_logloss: 0.323115
[109]	valid_0's auc: 0.942693	valid_0's binary_logloss: 0.263899	valid_1's auc: 0.904549	valid_1's binary_logloss: 0.323284
[110]	valid_0's auc: 0.942909	valid_0's binary_logloss: 0.263468	valid_1's auc: 0.904541	valid_1's binary_logloss: 0.323317
[111]	valid_0's auc: 0.943273	valid_0's binary_logloss: 0.262819	valid_1's auc: 0.904461	valid_1's binary_logloss: 0.323456
[112]	valid_0's auc: 0.943554	valid_0's binary_logloss: 0.2623	valid_1's auc: 0.904389	valid_1's binary_logloss: 0.323616
[113]	valid_0's auc: 0.943732	valid_0's binary_logloss: 0.261984	valid_1's auc: 0.90433	valid_1's binary_logloss: 0.323727
[114]	valid_0's auc: 0.943941	valid_0's binary_logloss: 0.261612	valid_1's auc: 0.904261	valid_1's binary_logloss: 0.323904
[115]	valid_0's auc: 0.944269	valid_0's binary_logloss: 0.261049	valid_1's auc: 0.904154	valid_1's binary_logloss: 0.324049
[116]	valid_0's auc: 0.944444	valid_0's binary_logloss: 0.260706	valid_1's auc: 0.904131	valid_1's binary_logloss: 0.324053
[117]	valid_0's auc: 0.944621	valid_0's binary_logloss: 0.260389	valid_1's auc: 0.904019	valid_1's binary_logloss: 0.32424
[118]	valid_0's auc: 0.944826	valid_0's binary_logloss: 0.260018	valid_1's auc: 0.904016	valid_1's binary_logloss: 0.324247
[119]	valid_0's auc: 0.944978	valid_0's binary_logloss: 0.259724	valid_1's auc: 0.9039	valid_1's binary_logloss: 0.324443
[120]	valid_0's auc: 0.945168	valid_0's binary_logloss: 0.25931	valid_1's auc: 0.903939	valid_1's binary_logloss: 0.324359
[121]	valid_0's auc: 0.945453	valid_0's binary_logloss: 0.258777	valid_1's auc: 0.90389	valid_1's binary_logloss: 0.324491
[122]	valid_0's auc: 0.945625	valid_0's binary_logloss: 0.258411	valid_1's auc: 0.903877	valid_1's binary_logloss: 0.324549
[123]	valid_0's auc: 0.945753	valid_0's binary_logloss: 0.258163	valid_1's auc: 0.903828	valid_1's binary_logloss: 0.324668
[124]	valid_0's auc: 0.945907	valid_0's binary_logloss: 0.257827	valid_1's auc: 0.903669	valid_1's binary_logloss: 0.324984
[125]	valid_0's auc: 0.94607	valid_0's binary_logloss: 0.257504	valid_1's auc: 0.903676	valid_1's binary_logloss: 0.32499
[126]	valid_0's auc: 0.946247	valid_0's binary_logloss: 0.257108	valid_1's auc: 0.903828	valid_1's binary_logloss: 0.324773
[127]	valid_0's auc: 0.946499	valid_0's binary_logloss: 0.256599	valid_1's auc: 0.903795	valid_1's binary_logloss: 0.324875
[128]	valid_0's auc: 0.946763	valid_0's binary_logloss: 0.256131	valid_1's auc: 0.903687	valid_1's binary_logloss: 0.325075
[129]	valid_0's auc: 0.946949	valid_0's binary_logloss: 0.255779	valid_1's auc: 0.903525	valid_1's binary_logloss: 0.325361
[130]	valid_0's auc: 0.947079	valid_0's binary_logloss: 0.255495	valid_1's auc: 0.903493	valid_1's binary_logloss: 0.325464
[131]	valid_0's auc: 0.947194	valid_0's binary_logloss: 0.255262	valid_1's auc: 0.903417	valid_1's binary_logloss: 0.325622
[132]	valid_0's auc: 0.947382	valid_0's binary_logloss: 0.254878	valid_1's auc: 0.903373	valid_1's binary_logloss: 0.325732
[133]	valid_0's auc: 0.947514	valid_0's binary_logloss: 0.254627	valid_1's auc: 0.903179	valid_1's binary_logloss: 0.326044
[134]	valid_0's auc: 0.94766	valid_0's binary_logloss: 0.254319	valid_1's auc: 0.903139	valid_1's binary_logloss: 0.326086
[135]	valid_0's auc: 0.947883	valid_0's binary_logloss: 0.253913	valid_1's auc: 0.903003	valid_1's binary_logloss: 0.326332
[136]	valid_0's auc: 0.948009	valid_0's binary_logloss: 0.253649	valid_1's auc: 0.902964	valid_1's binary_logloss: 0.326447
[137]	valid_0's auc: 0.948243	valid_0's binary_logloss: 0.253216	valid_1's auc: 0.902963	valid_1's binary_logloss: 0.326507
[138]	valid_0's auc: 0.948381	valid_0's binary_logloss: 0.252937	valid_1's auc: 0.903034	valid_1's binary_logloss: 0.326404
[139]	valid_0's auc: 0.948549	valid_0's binary_logloss: 0.252612	valid_1's auc: 0.902994	valid_1's binary_logloss: 0.326515
[140]	valid_0's auc: 0.948818	valid_0's binary_logloss: 0.252142	valid_1's auc: 0.902975	valid_1's binary_logloss: 0.32662
[141]	valid_0's auc: 0.94901	valid_0's binary_logloss: 0.251734	valid_1's auc: 0.90284	valid_1's binary_logloss: 0.326897
[142]	valid_0's auc: 0.949147	valid_0's binary_logloss: 0.251425	valid_1's auc: 0.902947	valid_1's binary_logloss: 0.326821
[143]	valid_0's auc: 0.949269	valid_0's binary_logloss: 0.251161	valid_1's auc: 0.902898	valid_1's binary_logloss: 0.326949
Early stopping, best iteration is:
[43]	valid_0's auc: 0.923272	valid_0's binary_logloss: 0.299597	valid_1's auc: 0.907829	valid_1's binary_logloss: 0.318247
[1]	valid_0's auc: 0.889368	valid_0's binary_logloss: 0.516586	valid_1's auc: 0.894755	valid_1's binary_logloss: 0.507927
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892369	valid_0's binary_logloss: 0.487665	valid_1's auc: 0.897729	valid_1's binary_logloss: 0.478425
[3]	valid_0's auc: 0.892766	valid_0's binary_logloss: 0.46459	valid_1's auc: 0.8987	valid_1's binary_logloss: 0.454891
[4]	valid_0's auc: 0.894658	valid_0's binary_logloss: 0.445432	valid_1's auc: 0.899309	valid_1's binary_logloss: 0.435927
[5]	valid_0's auc: 0.897216	valid_0's binary_logloss: 0.429343	valid_1's auc: 0.901673	valid_1's binary_logloss: 0.420055
[6]	valid_0's auc: 0.898836	valid_0's binary_logloss: 0.415681	valid_1's auc: 0.902175	valid_1's binary_logloss: 0.40664
[7]	valid_0's auc: 0.900089	valid_0's binary_logloss: 0.403962	valid_1's auc: 0.903133	valid_1's binary_logloss: 0.394925
[8]	valid_0's auc: 0.900532	valid_0's binary_logloss: 0.393959	valid_1's auc: 0.903189	valid_1's binary_logloss: 0.38526
[9]	valid_0's auc: 0.90162	valid_0's binary_logloss: 0.385233	valid_1's auc: 0.903527	valid_1's binary_logloss: 0.376973
[10]	valid_0's auc: 0.902597	valid_0's binary_logloss: 0.377488	valid_1's auc: 0.904084	valid_1's binary_logloss: 0.369513
[11]	valid_0's auc: 0.903448	valid_0's binary_logloss: 0.370593	valid_1's auc: 0.904405	valid_1's binary_logloss: 0.363339
[12]	valid_0's auc: 0.904159	valid_0's binary_logloss: 0.364575	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.357511
[13]	valid_0's auc: 0.905188	valid_0's binary_logloss: 0.359049	valid_1's auc: 0.90489	valid_1's binary_logloss: 0.352976
[14]	valid_0's auc: 0.906232	valid_0's binary_logloss: 0.354214	valid_1's auc: 0.905694	valid_1's binary_logloss: 0.348766
[15]	valid_0's auc: 0.907064	valid_0's binary_logloss: 0.349752	valid_1's auc: 0.906	valid_1's binary_logloss: 0.345008
[16]	valid_0's auc: 0.907672	valid_0's binary_logloss: 0.345873	valid_1's auc: 0.906296	valid_1's binary_logloss: 0.341642
[17]	valid_0's auc: 0.908273	valid_0's binary_logloss: 0.342296	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.338802
[18]	valid_0's auc: 0.908878	valid_0's binary_logloss: 0.339094	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336013
[19]	valid_0's auc: 0.909576	valid_0's binary_logloss: 0.336175	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.333894
[20]	valid_0's auc: 0.910455	valid_0's binary_logloss: 0.333445	valid_1's auc: 0.906931	valid_1's binary_logloss: 0.332059
[21]	valid_0's auc: 0.911273	valid_0's binary_logloss: 0.330787	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.330109
[22]	valid_0's auc: 0.912074	valid_0's binary_logloss: 0.328439	valid_1's auc: 0.907317	valid_1's binary_logloss: 0.32877
[23]	valid_0's auc: 0.912686	valid_0's binary_logloss: 0.326339	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.327636
[24]	valid_0's auc: 0.913571	valid_0's binary_logloss: 0.324128	valid_1's auc: 0.907432	valid_1's binary_logloss: 0.326242
[25]	valid_0's auc: 0.914116	valid_0's binary_logloss: 0.322264	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.32551
[26]	valid_0's auc: 0.914708	valid_0's binary_logloss: 0.320488	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.324633
[27]	valid_0's auc: 0.91518	valid_0's binary_logloss: 0.318816	valid_1's auc: 0.907321	valid_1's binary_logloss: 0.32384
[28]	valid_0's auc: 0.915702	valid_0's binary_logloss: 0.317272	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.323304
[29]	valid_0's auc: 0.916415	valid_0's binary_logloss: 0.315625	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.322952
[30]	valid_0's auc: 0.916801	valid_0's binary_logloss: 0.314325	valid_1's auc: 0.907132	valid_1's binary_logloss: 0.322293
[31]	valid_0's auc: 0.917206	valid_0's binary_logloss: 0.313086	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.321811
[32]	valid_0's auc: 0.917656	valid_0's binary_logloss: 0.311898	valid_1's auc: 0.907343	valid_1's binary_logloss: 0.321211
[33]	valid_0's auc: 0.918178	valid_0's binary_logloss: 0.310518	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.32082
[34]	valid_0's auc: 0.918631	valid_0's binary_logloss: 0.309331	valid_1's auc: 0.907341	valid_1's binary_logloss: 0.320465
[35]	valid_0's auc: 0.919037	valid_0's binary_logloss: 0.308261	valid_1's auc: 0.907426	valid_1's binary_logloss: 0.319981
[36]	valid_0's auc: 0.919468	valid_0's binary_logloss: 0.307212	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.319661
[37]	valid_0's auc: 0.919844	valid_0's binary_logloss: 0.306237	valid_1's auc: 0.90738	valid_1's binary_logloss: 0.31961
[38]	valid_0's auc: 0.920349	valid_0's binary_logloss: 0.305123	valid_1's auc: 0.907299	valid_1's binary_logloss: 0.319397
[39]	valid_0's auc: 0.920788	valid_0's binary_logloss: 0.304184	valid_1's auc: 0.907283	valid_1's binary_logloss: 0.319256
[40]	valid_0's auc: 0.921133	valid_0's binary_logloss: 0.303349	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.319157
[41]	valid_0's auc: 0.92166	valid_0's binary_logloss: 0.302297	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.318916
[42]	valid_0's auc: 0.922152	valid_0's binary_logloss: 0.301268	valid_1's auc: 0.907401	valid_1's binary_logloss: 0.318656
[43]	valid_0's auc: 0.922665	valid_0's binary_logloss: 0.300317	valid_1's auc: 0.90753	valid_1's binary_logloss: 0.318355
[44]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.299625	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.318043
[45]	valid_0's auc: 0.923343	valid_0's binary_logloss: 0.298888	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.318157
[46]	valid_0's auc: 0.923757	valid_0's binary_logloss: 0.298114	valid_1's auc: 0.907425	valid_1's binary_logloss: 0.318073
[47]	valid_0's auc: 0.924211	valid_0's binary_logloss: 0.297279	valid_1's auc: 0.907393	valid_1's binary_logloss: 0.318047
[48]	valid_0's auc: 0.924601	valid_0's binary_logloss: 0.296483	valid_1's auc: 0.907399	valid_1's binary_logloss: 0.317973
[49]	valid_0's auc: 0.925153	valid_0's binary_logloss: 0.295574	valid_1's auc: 0.907352	valid_1's binary_logloss: 0.318005
[50]	valid_0's auc: 0.92558	valid_0's binary_logloss: 0.294749	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.318067
[51]	valid_0's auc: 0.925978	valid_0's binary_logloss: 0.294049	valid_1's auc: 0.907281	valid_1's binary_logloss: 0.318027
[52]	valid_0's auc: 0.926402	valid_0's binary_logloss: 0.293351	valid_1's auc: 0.907414	valid_1's binary_logloss: 0.317854
[53]	valid_0's auc: 0.926775	valid_0's binary_logloss: 0.292651	valid_1's auc: 0.907348	valid_1's binary_logloss: 0.317922
[54]	valid_0's auc: 0.927093	valid_0's binary_logloss: 0.292067	valid_1's auc: 0.907474	valid_1's binary_logloss: 0.317656
[55]	valid_0's auc: 0.927547	valid_0's binary_logloss: 0.291229	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.317629
[56]	valid_0's auc: 0.927892	valid_0's binary_logloss: 0.290597	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.317593
[57]	valid_0's auc: 0.928257	valid_0's binary_logloss: 0.289952	valid_1's auc: 0.907417	valid_1's binary_logloss: 0.317672
[58]	valid_0's auc: 0.928574	valid_0's binary_logloss: 0.289375	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.31761
[59]	valid_0's auc: 0.928998	valid_0's binary_logloss: 0.288588	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317717
[60]	valid_0's auc: 0.929325	valid_0's binary_logloss: 0.288029	valid_1's auc: 0.907459	valid_1's binary_logloss: 0.317616
[61]	valid_0's auc: 0.92968	valid_0's binary_logloss: 0.287356	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.317585
[62]	valid_0's auc: 0.930031	valid_0's binary_logloss: 0.286794	valid_1's auc: 0.907473	valid_1's binary_logloss: 0.317605
[63]	valid_0's auc: 0.930357	valid_0's binary_logloss: 0.286241	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317703
[64]	valid_0's auc: 0.930635	valid_0's binary_logloss: 0.285766	valid_1's auc: 0.907456	valid_1's binary_logloss: 0.317606
[65]	valid_0's auc: 0.93106	valid_0's binary_logloss: 0.285048	valid_1's auc: 0.907463	valid_1's binary_logloss: 0.317558
[66]	valid_0's auc: 0.931405	valid_0's binary_logloss: 0.284433	valid_1's auc: 0.907349	valid_1's binary_logloss: 0.31776
[67]	valid_0's auc: 0.931731	valid_0's binary_logloss: 0.283831	valid_1's auc: 0.90729	valid_1's binary_logloss: 0.317901
[68]	valid_0's auc: 0.932049	valid_0's binary_logloss: 0.283241	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.317877
[69]	valid_0's auc: 0.932381	valid_0's binary_logloss: 0.282698	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.318154
[70]	valid_0's auc: 0.932691	valid_0's binary_logloss: 0.282134	valid_1's auc: 0.907224	valid_1's binary_logloss: 0.318021
[71]	valid_0's auc: 0.932943	valid_0's binary_logloss: 0.281649	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.318097
[72]	valid_0's auc: 0.933218	valid_0's binary_logloss: 0.281141	valid_1's auc: 0.907081	valid_1's binary_logloss: 0.318177
[73]	valid_0's auc: 0.933531	valid_0's binary_logloss: 0.280638	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.318188
[74]	valid_0's auc: 0.933742	valid_0's binary_logloss: 0.280173	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318187
[75]	valid_0's auc: 0.934057	valid_0's binary_logloss: 0.279617	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318295
[76]	valid_0's auc: 0.934279	valid_0's binary_logloss: 0.279176	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.318397
[77]	valid_0's auc: 0.934596	valid_0's binary_logloss: 0.278654	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.31833
[78]	valid_0's auc: 0.93485	valid_0's binary_logloss: 0.278215	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.31847
[79]	valid_0's auc: 0.935126	valid_0's binary_logloss: 0.277719	valid_1's auc: 0.907014	valid_1's binary_logloss: 0.318454
[80]	valid_0's auc: 0.935419	valid_0's binary_logloss: 0.277261	valid_1's auc: 0.907022	valid_1's binary_logloss: 0.318455
[81]	valid_0's auc: 0.935742	valid_0's binary_logloss: 0.276751	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.318558
[82]	valid_0's auc: 0.935973	valid_0's binary_logloss: 0.276331	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.318398
[83]	valid_0's auc: 0.936358	valid_0's binary_logloss: 0.275673	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.3185
[84]	valid_0's auc: 0.936625	valid_0's binary_logloss: 0.275194	valid_1's auc: 0.907014	valid_1's binary_logloss: 0.318523
[85]	valid_0's auc: 0.936949	valid_0's binary_logloss: 0.274613	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.318477
[86]	valid_0's auc: 0.937172	valid_0's binary_logloss: 0.274222	valid_1's auc: 0.906924	valid_1's binary_logloss: 0.318724
[87]	valid_0's auc: 0.93734	valid_0's binary_logloss: 0.27388	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.318732
[88]	valid_0's auc: 0.93764	valid_0's binary_logloss: 0.273377	valid_1's auc: 0.906955	valid_1's binary_logloss: 0.318652
[89]	valid_0's auc: 0.937857	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.90689	valid_1's binary_logloss: 0.318769
[90]	valid_0's auc: 0.938155	valid_0's binary_logloss: 0.272436	valid_1's auc: 0.906809	valid_1's binary_logloss: 0.318924
[91]	valid_0's auc: 0.938364	valid_0's binary_logloss: 0.272015	valid_1's auc: 0.906737	valid_1's binary_logloss: 0.31909
[92]	valid_0's auc: 0.938651	valid_0's binary_logloss: 0.271503	valid_1's auc: 0.906695	valid_1's binary_logloss: 0.319158
[93]	valid_0's auc: 0.938853	valid_0's binary_logloss: 0.271152	valid_1's auc: 0.906674	valid_1's binary_logloss: 0.319206
[94]	valid_0's auc: 0.939104	valid_0's binary_logloss: 0.270696	valid_1's auc: 0.906641	valid_1's binary_logloss: 0.319253
[95]	valid_0's auc: 0.939377	valid_0's binary_logloss: 0.270242	valid_1's auc: 0.906489	valid_1's binary_logloss: 0.319521
[96]	valid_0's auc: 0.939675	valid_0's binary_logloss: 0.269754	valid_1's auc: 0.906398	valid_1's binary_logloss: 0.319658
[97]	valid_0's auc: 0.939898	valid_0's binary_logloss: 0.26939	valid_1's auc: 0.906433	valid_1's binary_logloss: 0.319611
[98]	valid_0's auc: 0.940301	valid_0's binary_logloss: 0.268733	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.31952
[99]	valid_0's auc: 0.940487	valid_0's binary_logloss: 0.268323	valid_1's auc: 0.906351	valid_1's binary_logloss: 0.319709
[100]	valid_0's auc: 0.940684	valid_0's binary_logloss: 0.267966	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.319914
[101]	valid_0's auc: 0.940864	valid_0's binary_logloss: 0.267536	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.319888
[102]	valid_0's auc: 0.94102	valid_0's binary_logloss: 0.267175	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320074
[103]	valid_0's auc: 0.941195	valid_0's binary_logloss: 0.266812	valid_1's auc: 0.906306	valid_1's binary_logloss: 0.319989
[104]	valid_0's auc: 0.941338	valid_0's binary_logloss: 0.266494	valid_1's auc: 0.906282	valid_1's binary_logloss: 0.320094
[105]	valid_0's auc: 0.941478	valid_0's binary_logloss: 0.266194	valid_1's auc: 0.906191	valid_1's binary_logloss: 0.320248
[106]	valid_0's auc: 0.941737	valid_0's binary_logloss: 0.265719	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320327
[107]	valid_0's auc: 0.941926	valid_0's binary_logloss: 0.265387	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.320293
[108]	valid_0's auc: 0.942205	valid_0's binary_logloss: 0.264886	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320353
[109]	valid_0's auc: 0.94239	valid_0's binary_logloss: 0.264586	valid_1's auc: 0.90619	valid_1's binary_logloss: 0.320368
[110]	valid_0's auc: 0.942552	valid_0's binary_logloss: 0.264199	valid_1's auc: 0.906049	valid_1's binary_logloss: 0.320586
[111]	valid_0's auc: 0.942737	valid_0's binary_logloss: 0.263828	valid_1's auc: 0.906039	valid_1's binary_logloss: 0.320584
[112]	valid_0's auc: 0.943023	valid_0's binary_logloss: 0.263311	valid_1's auc: 0.90597	valid_1's binary_logloss: 0.320716
[113]	valid_0's auc: 0.943241	valid_0's binary_logloss: 0.262941	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.3208
[114]	valid_0's auc: 0.943462	valid_0's binary_logloss: 0.262526	valid_1's auc: 0.905888	valid_1's binary_logloss: 0.320928
[115]	valid_0's auc: 0.943755	valid_0's binary_logloss: 0.262022	valid_1's auc: 0.905861	valid_1's binary_logloss: 0.320989
[116]	valid_0's auc: 0.944045	valid_0's binary_logloss: 0.261487	valid_1's auc: 0.90579	valid_1's binary_logloss: 0.321123
[117]	valid_0's auc: 0.944248	valid_0's binary_logloss: 0.261086	valid_1's auc: 0.905841	valid_1's binary_logloss: 0.321138
[118]	valid_0's auc: 0.94446	valid_0's binary_logloss: 0.260664	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.321276
[119]	valid_0's auc: 0.944668	valid_0's binary_logloss: 0.260306	valid_1's auc: 0.905811	valid_1's binary_logloss: 0.32118
[120]	valid_0's auc: 0.944805	valid_0's binary_logloss: 0.260026	valid_1's auc: 0.905723	valid_1's binary_logloss: 0.321358
[121]	valid_0's auc: 0.945075	valid_0's binary_logloss: 0.259516	valid_1's auc: 0.905567	valid_1's binary_logloss: 0.32167
[122]	valid_0's auc: 0.945302	valid_0's binary_logloss: 0.259083	valid_1's auc: 0.905624	valid_1's binary_logloss: 0.321597
[123]	valid_0's auc: 0.945541	valid_0's binary_logloss: 0.258627	valid_1's auc: 0.905621	valid_1's binary_logloss: 0.321637
[124]	valid_0's auc: 0.945707	valid_0's binary_logloss: 0.258332	valid_1's auc: 0.905581	valid_1's binary_logloss: 0.321709
[125]	valid_0's auc: 0.94588	valid_0's binary_logloss: 0.25798	valid_1's auc: 0.905563	valid_1's binary_logloss: 0.321798
[126]	valid_0's auc: 0.946113	valid_0's binary_logloss: 0.257554	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.321939
[127]	valid_0's auc: 0.94628	valid_0's binary_logloss: 0.257213	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.321984
[128]	valid_0's auc: 0.94649	valid_0's binary_logloss: 0.256786	valid_1's auc: 0.905372	valid_1's binary_logloss: 0.322167
[129]	valid_0's auc: 0.946719	valid_0's binary_logloss: 0.256328	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322155
[130]	valid_0's auc: 0.946867	valid_0's binary_logloss: 0.25604	valid_1's auc: 0.905365	valid_1's binary_logloss: 0.322178
[131]	valid_0's auc: 0.94708	valid_0's binary_logloss: 0.255653	valid_1's auc: 0.905246	valid_1's binary_logloss: 0.322337
[132]	valid_0's auc: 0.947412	valid_0's binary_logloss: 0.255069	valid_1's auc: 0.90526	valid_1's binary_logloss: 0.322373
[133]	valid_0's auc: 0.947537	valid_0's binary_logloss: 0.25479	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.322414
[134]	valid_0's auc: 0.94771	valid_0's binary_logloss: 0.254426	valid_1's auc: 0.905241	valid_1's binary_logloss: 0.322468
[135]	valid_0's auc: 0.947872	valid_0's binary_logloss: 0.254109	valid_1's auc: 0.905226	valid_1's binary_logloss: 0.322507
[136]	valid_0's auc: 0.948043	valid_0's binary_logloss: 0.253782	valid_1's auc: 0.905114	valid_1's binary_logloss: 0.322691
[137]	valid_0's auc: 0.948265	valid_0's binary_logloss: 0.253378	valid_1's auc: 0.905057	valid_1's binary_logloss: 0.322831
[138]	valid_0's auc: 0.948417	valid_0's binary_logloss: 0.253083	valid_1's auc: 0.905034	valid_1's binary_logloss: 0.322968
[139]	valid_0's auc: 0.948591	valid_0's binary_logloss: 0.252767	valid_1's auc: 0.905094	valid_1's binary_logloss: 0.322893
[140]	valid_0's auc: 0.948675	valid_0's binary_logloss: 0.252549	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323132
[141]	valid_0's auc: 0.948869	valid_0's binary_logloss: 0.252154	valid_1's auc: 0.904892	valid_1's binary_logloss: 0.323301
[142]	valid_0's auc: 0.949082	valid_0's binary_logloss: 0.251727	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.323075
[143]	valid_0's auc: 0.949271	valid_0's binary_logloss: 0.251369	valid_1's auc: 0.904933	valid_1's binary_logloss: 0.323202
[144]	valid_0's auc: 0.949451	valid_0's binary_logloss: 0.250989	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.323288
Early stopping, best iteration is:
[44]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.299625	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.318043
[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893965	valid_0's binary_logloss: 0.48775	valid_1's auc: 0.898564	valid_1's binary_logloss: 0.47888
[3]	valid_0's auc: 0.895655	valid_0's binary_logloss: 0.464581	valid_1's auc: 0.900964	valid_1's binary_logloss: 0.455298
[4]	valid_0's auc: 0.897539	valid_0's binary_logloss: 0.445277	valid_1's auc: 0.902035	valid_1's binary_logloss: 0.435832
[5]	valid_0's auc: 0.898387	valid_0's binary_logloss: 0.429396	valid_1's auc: 0.902551	valid_1's binary_logloss: 0.419909
[6]	valid_0's auc: 0.899784	valid_0's binary_logloss: 0.415601	valid_1's auc: 0.903665	valid_1's binary_logloss: 0.405988
[7]	valid_0's auc: 0.900831	valid_0's binary_logloss: 0.403734	valid_1's auc: 0.904525	valid_1's binary_logloss: 0.394007
[8]	valid_0's auc: 0.902074	valid_0's binary_logloss: 0.393454	valid_1's auc: 0.904554	valid_1's binary_logloss: 0.384534
[9]	valid_0's auc: 0.902691	valid_0's binary_logloss: 0.384773	valid_1's auc: 0.904903	valid_1's binary_logloss: 0.376052
[10]	valid_0's auc: 0.903406	valid_0's binary_logloss: 0.377125	valid_1's auc: 0.905336	valid_1's binary_logloss: 0.36871
[11]	valid_0's auc: 0.904104	valid_0's binary_logloss: 0.370202	valid_1's auc: 0.905376	valid_1's binary_logloss: 0.36243
[12]	valid_0's auc: 0.904891	valid_0's binary_logloss: 0.364111	valid_1's auc: 0.905619	valid_1's binary_logloss: 0.356926
[13]	valid_0's auc: 0.905957	valid_0's binary_logloss: 0.358664	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.351824
[14]	valid_0's auc: 0.906835	valid_0's binary_logloss: 0.35382	valid_1's auc: 0.907068	valid_1's binary_logloss: 0.347514
[15]	valid_0's auc: 0.907499	valid_0's binary_logloss: 0.349488	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.34372
[16]	valid_0's auc: 0.908278	valid_0's binary_logloss: 0.345434	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.340404
[17]	valid_0's auc: 0.908963	valid_0's binary_logloss: 0.341925	valid_1's auc: 0.90786	valid_1's binary_logloss: 0.337467
[18]	valid_0's auc: 0.909506	valid_0's binary_logloss: 0.33877	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.334924
[19]	valid_0's auc: 0.910325	valid_0's binary_logloss: 0.335693	valid_1's auc: 0.908188	valid_1's binary_logloss: 0.332695
[20]	valid_0's auc: 0.910811	valid_0's binary_logloss: 0.333061	valid_1's auc: 0.908235	valid_1's binary_logloss: 0.330738
[21]	valid_0's auc: 0.911457	valid_0's binary_logloss: 0.33059	valid_1's auc: 0.908285	valid_1's binary_logloss: 0.329008
[22]	valid_0's auc: 0.91208	valid_0's binary_logloss: 0.328273	valid_1's auc: 0.908597	valid_1's binary_logloss: 0.327193
[23]	valid_0's auc: 0.912696	valid_0's binary_logloss: 0.326188	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.325776
[24]	valid_0's auc: 0.913437	valid_0's binary_logloss: 0.324096	valid_1's auc: 0.909015	valid_1's binary_logloss: 0.324428
[25]	valid_0's auc: 0.914099	valid_0's binary_logloss: 0.322178	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.323024
[26]	valid_0's auc: 0.914848	valid_0's binary_logloss: 0.320278	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.322028
[27]	valid_0's auc: 0.915368	valid_0's binary_logloss: 0.318709	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.321119
[28]	valid_0's auc: 0.915901	valid_0's binary_logloss: 0.317124	valid_1's auc: 0.909502	valid_1's binary_logloss: 0.320442
[29]	valid_0's auc: 0.916539	valid_0's binary_logloss: 0.315481	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.319912
[30]	valid_0's auc: 0.917199	valid_0's binary_logloss: 0.313941	valid_1's auc: 0.909411	valid_1's binary_logloss: 0.319377
[31]	valid_0's auc: 0.917762	valid_0's binary_logloss: 0.312489	valid_1's auc: 0.909552	valid_1's binary_logloss: 0.31874
[32]	valid_0's auc: 0.918363	valid_0's binary_logloss: 0.311025	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.318411
[33]	valid_0's auc: 0.918787	valid_0's binary_logloss: 0.309888	valid_1's auc: 0.909489	valid_1's binary_logloss: 0.317904
[34]	valid_0's auc: 0.919222	valid_0's binary_logloss: 0.308721	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.317581
[35]	valid_0's auc: 0.919692	valid_0's binary_logloss: 0.307598	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.31723
[36]	valid_0's auc: 0.920165	valid_0's binary_logloss: 0.306529	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.316949
[37]	valid_0's auc: 0.920518	valid_0's binary_logloss: 0.305578	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.316719
[38]	valid_0's auc: 0.920964	valid_0's binary_logloss: 0.304573	valid_1's auc: 0.909618	valid_1's binary_logloss: 0.316259
[39]	valid_0's auc: 0.921413	valid_0's binary_logloss: 0.303538	valid_1's auc: 0.90968	valid_1's binary_logloss: 0.31597
[40]	valid_0's auc: 0.921827	valid_0's binary_logloss: 0.302604	valid_1's auc: 0.909769	valid_1's binary_logloss: 0.315659
[41]	valid_0's auc: 0.922248	valid_0's binary_logloss: 0.301637	valid_1's auc: 0.910064	valid_1's binary_logloss: 0.315096
[42]	valid_0's auc: 0.92268	valid_0's binary_logloss: 0.300781	valid_1's auc: 0.910248	valid_1's binary_logloss: 0.314713
[43]	valid_0's auc: 0.923159	valid_0's binary_logloss: 0.299782	valid_1's auc: 0.910295	valid_1's binary_logloss: 0.314557
[44]	valid_0's auc: 0.923571	valid_0's binary_logloss: 0.298949	valid_1's auc: 0.910375	valid_1's binary_logloss: 0.314362
[45]	valid_0's auc: 0.923957	valid_0's binary_logloss: 0.298126	valid_1's auc: 0.910473	valid_1's binary_logloss: 0.314007
[46]	valid_0's auc: 0.92435	valid_0's binary_logloss: 0.297349	valid_1's auc: 0.91047	valid_1's binary_logloss: 0.313925
[47]	valid_0's auc: 0.924713	valid_0's binary_logloss: 0.296625	valid_1's auc: 0.910288	valid_1's binary_logloss: 0.314068
[48]	valid_0's auc: 0.925081	valid_0's binary_logloss: 0.295895	valid_1's auc: 0.910327	valid_1's binary_logloss: 0.313981
[49]	valid_0's auc: 0.925486	valid_0's binary_logloss: 0.295234	valid_1's auc: 0.91031	valid_1's binary_logloss: 0.31392
[50]	valid_0's auc: 0.925864	valid_0's binary_logloss: 0.294542	valid_1's auc: 0.91023	valid_1's binary_logloss: 0.313957
[51]	valid_0's auc: 0.926162	valid_0's binary_logloss: 0.293987	valid_1's auc: 0.910083	valid_1's binary_logloss: 0.314078
[52]	valid_0's auc: 0.926656	valid_0's binary_logloss: 0.293165	valid_1's auc: 0.910125	valid_1's binary_logloss: 0.313957
[53]	valid_0's auc: 0.92702	valid_0's binary_logloss: 0.292483	valid_1's auc: 0.910159	valid_1's binary_logloss: 0.313865
[54]	valid_0's auc: 0.927388	valid_0's binary_logloss: 0.291784	valid_1's auc: 0.910105	valid_1's binary_logloss: 0.313926
[55]	valid_0's auc: 0.927743	valid_0's binary_logloss: 0.291075	valid_1's auc: 0.910236	valid_1's binary_logloss: 0.313686
[56]	valid_0's auc: 0.928161	valid_0's binary_logloss: 0.29034	valid_1's auc: 0.910356	valid_1's binary_logloss: 0.313502
[57]	valid_0's auc: 0.928568	valid_0's binary_logloss: 0.289642	valid_1's auc: 0.910246	valid_1's binary_logloss: 0.313583
[58]	valid_0's auc: 0.928869	valid_0's binary_logloss: 0.289132	valid_1's auc: 0.910163	valid_1's binary_logloss: 0.313662
[59]	valid_0's auc: 0.929294	valid_0's binary_logloss: 0.288419	valid_1's auc: 0.910043	valid_1's binary_logloss: 0.313812
[60]	valid_0's auc: 0.929718	valid_0's binary_logloss: 0.287745	valid_1's auc: 0.910005	valid_1's binary_logloss: 0.313816
[61]	valid_0's auc: 0.930139	valid_0's binary_logloss: 0.287021	valid_1's auc: 0.910146	valid_1's binary_logloss: 0.313558
[62]	valid_0's auc: 0.930571	valid_0's binary_logloss: 0.28629	valid_1's auc: 0.910101	valid_1's binary_logloss: 0.313647
[63]	valid_0's auc: 0.93084	valid_0's binary_logloss: 0.285798	valid_1's auc: 0.910121	valid_1's binary_logloss: 0.313557
[64]	valid_0's auc: 0.931204	valid_0's binary_logloss: 0.285154	valid_1's auc: 0.910041	valid_1's binary_logloss: 0.313733
[65]	valid_0's auc: 0.931571	valid_0's binary_logloss: 0.284514	valid_1's auc: 0.909906	valid_1's binary_logloss: 0.313987
[66]	valid_0's auc: 0.931838	valid_0's binary_logloss: 0.284033	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.314104
[67]	valid_0's auc: 0.932112	valid_0's binary_logloss: 0.283505	valid_1's auc: 0.909743	valid_1's binary_logloss: 0.314247
[68]	valid_0's auc: 0.932416	valid_0's binary_logloss: 0.282919	valid_1's auc: 0.909736	valid_1's binary_logloss: 0.314236
[69]	valid_0's auc: 0.932769	valid_0's binary_logloss: 0.282291	valid_1's auc: 0.909849	valid_1's binary_logloss: 0.314079
[70]	valid_0's auc: 0.933092	valid_0's binary_logloss: 0.281764	valid_1's auc: 0.909697	valid_1's binary_logloss: 0.314311
[71]	valid_0's auc: 0.933456	valid_0's binary_logloss: 0.281123	valid_1's auc: 0.90969	valid_1's binary_logloss: 0.314301
[72]	valid_0's auc: 0.933786	valid_0's binary_logloss: 0.280537	valid_1's auc: 0.909724	valid_1's binary_logloss: 0.314299
[73]	valid_0's auc: 0.934014	valid_0's binary_logloss: 0.280053	valid_1's auc: 0.909614	valid_1's binary_logloss: 0.314448
[74]	valid_0's auc: 0.934294	valid_0's binary_logloss: 0.279571	valid_1's auc: 0.909529	valid_1's binary_logloss: 0.31456
[75]	valid_0's auc: 0.93471	valid_0's binary_logloss: 0.278858	valid_1's auc: 0.909491	valid_1's binary_logloss: 0.314579
[76]	valid_0's auc: 0.934963	valid_0's binary_logloss: 0.278416	valid_1's auc: 0.909428	valid_1's binary_logloss: 0.314662
[77]	valid_0's auc: 0.935162	valid_0's binary_logloss: 0.278073	valid_1's auc: 0.909187	valid_1's binary_logloss: 0.315032
[78]	valid_0's auc: 0.935572	valid_0's binary_logloss: 0.277355	valid_1's auc: 0.909107	valid_1's binary_logloss: 0.315119
[79]	valid_0's auc: 0.935833	valid_0's binary_logloss: 0.276878	valid_1's auc: 0.909091	valid_1's binary_logloss: 0.315151
[80]	valid_0's auc: 0.936089	valid_0's binary_logloss: 0.276374	valid_1's auc: 0.909104	valid_1's binary_logloss: 0.315185
[81]	valid_0's auc: 0.936339	valid_0's binary_logloss: 0.275936	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.315308
[82]	valid_0's auc: 0.936495	valid_0's binary_logloss: 0.275682	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.315611
[83]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.275276	valid_1's auc: 0.908765	valid_1's binary_logloss: 0.31579
[84]	valid_0's auc: 0.937002	valid_0's binary_logloss: 0.274721	valid_1's auc: 0.908742	valid_1's binary_logloss: 0.315785
[85]	valid_0's auc: 0.937259	valid_0's binary_logloss: 0.274285	valid_1's auc: 0.908752	valid_1's binary_logloss: 0.315775
[86]	valid_0's auc: 0.937473	valid_0's binary_logloss: 0.273799	valid_1's auc: 0.908738	valid_1's binary_logloss: 0.315823
[87]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.273317	valid_1's auc: 0.908719	valid_1's binary_logloss: 0.31583
[88]	valid_0's auc: 0.937893	valid_0's binary_logloss: 0.272969	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.316114
[89]	valid_0's auc: 0.938071	valid_0's binary_logloss: 0.272584	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.316094
[90]	valid_0's auc: 0.938384	valid_0's binary_logloss: 0.272057	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.316209
[91]	valid_0's auc: 0.938713	valid_0's binary_logloss: 0.271461	valid_1's auc: 0.908592	valid_1's binary_logloss: 0.316161
[92]	valid_0's auc: 0.938927	valid_0's binary_logloss: 0.270985	valid_1's auc: 0.908525	valid_1's binary_logloss: 0.316219
[93]	valid_0's auc: 0.939251	valid_0's binary_logloss: 0.270397	valid_1's auc: 0.908375	valid_1's binary_logloss: 0.316456
[94]	valid_0's auc: 0.939444	valid_0's binary_logloss: 0.270047	valid_1's auc: 0.908288	valid_1's binary_logloss: 0.316567
[95]	valid_0's auc: 0.93964	valid_0's binary_logloss: 0.269703	valid_1's auc: 0.908333	valid_1's binary_logloss: 0.316515
[96]	valid_0's auc: 0.93981	valid_0's binary_logloss: 0.269332	valid_1's auc: 0.908222	valid_1's binary_logloss: 0.316712
[97]	valid_0's auc: 0.940066	valid_0's binary_logloss: 0.268872	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.316877
[98]	valid_0's auc: 0.940238	valid_0's binary_logloss: 0.268531	valid_1's auc: 0.908051	valid_1's binary_logloss: 0.317097
[99]	valid_0's auc: 0.940582	valid_0's binary_logloss: 0.267968	valid_1's auc: 0.907989	valid_1's binary_logloss: 0.317212
[100]	valid_0's auc: 0.940784	valid_0's binary_logloss: 0.267537	valid_1's auc: 0.907983	valid_1's binary_logloss: 0.317208
[101]	valid_0's auc: 0.940996	valid_0's binary_logloss: 0.26718	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317335
[102]	valid_0's auc: 0.941186	valid_0's binary_logloss: 0.266768	valid_1's auc: 0.907955	valid_1's binary_logloss: 0.317285
[103]	valid_0's auc: 0.941446	valid_0's binary_logloss: 0.266308	valid_1's auc: 0.907801	valid_1's binary_logloss: 0.3176
[104]	valid_0's auc: 0.941663	valid_0's binary_logloss: 0.265849	valid_1's auc: 0.907797	valid_1's binary_logloss: 0.317633
[105]	valid_0's auc: 0.941861	valid_0's binary_logloss: 0.265473	valid_1's auc: 0.907767	valid_1's binary_logloss: 0.317711
[106]	valid_0's auc: 0.94219	valid_0's binary_logloss: 0.264897	valid_1's auc: 0.907788	valid_1's binary_logloss: 0.317689
[107]	valid_0's auc: 0.942315	valid_0's binary_logloss: 0.264613	valid_1's auc: 0.90775	valid_1's binary_logloss: 0.317765
[108]	valid_0's auc: 0.942556	valid_0's binary_logloss: 0.264181	valid_1's auc: 0.907728	valid_1's binary_logloss: 0.317789
[109]	valid_0's auc: 0.942729	valid_0's binary_logloss: 0.26389	valid_1's auc: 0.907689	valid_1's binary_logloss: 0.317876
[110]	valid_0's auc: 0.942944	valid_0's binary_logloss: 0.263509	valid_1's auc: 0.907737	valid_1's binary_logloss: 0.317831
[111]	valid_0's auc: 0.943158	valid_0's binary_logloss: 0.263108	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317844
[112]	valid_0's auc: 0.943453	valid_0's binary_logloss: 0.262613	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.317807
[113]	valid_0's auc: 0.943648	valid_0's binary_logloss: 0.262268	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317779
[114]	valid_0's auc: 0.943804	valid_0's binary_logloss: 0.261914	valid_1's auc: 0.907781	valid_1's binary_logloss: 0.317837
[115]	valid_0's auc: 0.944071	valid_0's binary_logloss: 0.261404	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.31802
[116]	valid_0's auc: 0.944224	valid_0's binary_logloss: 0.261089	valid_1's auc: 0.907623	valid_1's binary_logloss: 0.318207
[117]	valid_0's auc: 0.944503	valid_0's binary_logloss: 0.260612	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.318462
[118]	valid_0's auc: 0.944698	valid_0's binary_logloss: 0.26025	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.318634
[119]	valid_0's auc: 0.944867	valid_0's binary_logloss: 0.259948	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.318809
[120]	valid_0's auc: 0.94505	valid_0's binary_logloss: 0.259568	valid_1's auc: 0.907304	valid_1's binary_logloss: 0.318769
[121]	valid_0's auc: 0.945347	valid_0's binary_logloss: 0.258982	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318959
[122]	valid_0's auc: 0.945536	valid_0's binary_logloss: 0.258641	valid_1's auc: 0.907201	valid_1's binary_logloss: 0.319004
[123]	valid_0's auc: 0.945727	valid_0's binary_logloss: 0.258278	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.319318
[124]	valid_0's auc: 0.945946	valid_0's binary_logloss: 0.257886	valid_1's auc: 0.906923	valid_1's binary_logloss: 0.3195
[125]	valid_0's auc: 0.946076	valid_0's binary_logloss: 0.257628	valid_1's auc: 0.90691	valid_1's binary_logloss: 0.319492
[126]	valid_0's auc: 0.946299	valid_0's binary_logloss: 0.257211	valid_1's auc: 0.906892	valid_1's binary_logloss: 0.319499
[127]	valid_0's auc: 0.946494	valid_0's binary_logloss: 0.256828	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.319445
[128]	valid_0's auc: 0.946785	valid_0's binary_logloss: 0.256324	valid_1's auc: 0.906988	valid_1's binary_logloss: 0.319338
[129]	valid_0's auc: 0.946951	valid_0's binary_logloss: 0.25596	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.319526
[130]	valid_0's auc: 0.947072	valid_0's binary_logloss: 0.25569	valid_1's auc: 0.906869	valid_1's binary_logloss: 0.319609
[131]	valid_0's auc: 0.94721	valid_0's binary_logloss: 0.255416	valid_1's auc: 0.906816	valid_1's binary_logloss: 0.319682
[132]	valid_0's auc: 0.947377	valid_0's binary_logloss: 0.255084	valid_1's auc: 0.906746	valid_1's binary_logloss: 0.319828
[133]	valid_0's auc: 0.947613	valid_0's binary_logloss: 0.254648	valid_1's auc: 0.906606	valid_1's binary_logloss: 0.320084
[134]	valid_0's auc: 0.947812	valid_0's binary_logloss: 0.254261	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.320032
[135]	valid_0's auc: 0.947997	valid_0's binary_logloss: 0.253907	valid_1's auc: 0.906556	valid_1's binary_logloss: 0.320237
[136]	valid_0's auc: 0.948131	valid_0's binary_logloss: 0.253582	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.320121
[137]	valid_0's auc: 0.948254	valid_0's binary_logloss: 0.25333	valid_1's auc: 0.906604	valid_1's binary_logloss: 0.320167
[138]	valid_0's auc: 0.948437	valid_0's binary_logloss: 0.252955	valid_1's auc: 0.906663	valid_1's binary_logloss: 0.320131
[139]	valid_0's auc: 0.948623	valid_0's binary_logloss: 0.252624	valid_1's auc: 0.906604	valid_1's binary_logloss: 0.320245
[140]	valid_0's auc: 0.948722	valid_0's binary_logloss: 0.252391	valid_1's auc: 0.906519	valid_1's binary_logloss: 0.320346
[141]	valid_0's auc: 0.948873	valid_0's binary_logloss: 0.252106	valid_1's auc: 0.90639	valid_1's binary_logloss: 0.320531
[142]	valid_0's auc: 0.949089	valid_0's binary_logloss: 0.251688	valid_1's auc: 0.9063	valid_1's binary_logloss: 0.320703
[143]	valid_0's auc: 0.949202	valid_0's binary_logloss: 0.251417	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.32093
[144]	valid_0's auc: 0.94938	valid_0's binary_logloss: 0.251061	valid_1's auc: 0.906265	valid_1's binary_logloss: 0.320934
[145]	valid_0's auc: 0.949575	valid_0's binary_logloss: 0.250724	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.321002
Early stopping, best iteration is:
[45]	valid_0's auc: 0.923957	valid_0's binary_logloss: 0.298126	valid_1's auc: 0.910473	valid_1's binary_logloss: 0.314007
[1]	valid_0's auc: 0.883716	valid_0's binary_logloss: 0.517437	valid_1's auc: 0.891829	valid_1's binary_logloss: 0.508331
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890073	valid_0's binary_logloss: 0.488559	valid_1's auc: 0.895643	valid_1's binary_logloss: 0.47903
[3]	valid_0's auc: 0.89469	valid_0's binary_logloss: 0.465046	valid_1's auc: 0.899849	valid_1's binary_logloss: 0.455412
[4]	valid_0's auc: 0.896069	valid_0's binary_logloss: 0.445806	valid_1's auc: 0.901287	valid_1's binary_logloss: 0.435833
[5]	valid_0's auc: 0.897389	valid_0's binary_logloss: 0.429622	valid_1's auc: 0.901269	valid_1's binary_logloss: 0.419878
[6]	valid_0's auc: 0.898537	valid_0's binary_logloss: 0.415829	valid_1's auc: 0.90164	valid_1's binary_logloss: 0.406518
[7]	valid_0's auc: 0.899913	valid_0's binary_logloss: 0.404082	valid_1's auc: 0.90253	valid_1's binary_logloss: 0.394728
[8]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.394009	valid_1's auc: 0.90316	valid_1's binary_logloss: 0.384967
[9]	valid_0's auc: 0.901575	valid_0's binary_logloss: 0.385168	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.376241
[10]	valid_0's auc: 0.902151	valid_0's binary_logloss: 0.377494	valid_1's auc: 0.904329	valid_1's binary_logloss: 0.368945
[11]	valid_0's auc: 0.903157	valid_0's binary_logloss: 0.370649	valid_1's auc: 0.904521	valid_1's binary_logloss: 0.362422
[12]	valid_0's auc: 0.904146	valid_0's binary_logloss: 0.364509	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.357161
[13]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.358996	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.352531
[14]	valid_0's auc: 0.905821	valid_0's binary_logloss: 0.354303	valid_1's auc: 0.905235	valid_1's binary_logloss: 0.348331
[15]	valid_0's auc: 0.906501	valid_0's binary_logloss: 0.350005	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.344659
[16]	valid_0's auc: 0.907197	valid_0's binary_logloss: 0.346171	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.341413
[17]	valid_0's auc: 0.907706	valid_0's binary_logloss: 0.342767	valid_1's auc: 0.906119	valid_1's binary_logloss: 0.33838
[18]	valid_0's auc: 0.908317	valid_0's binary_logloss: 0.339542	valid_1's auc: 0.906532	valid_1's binary_logloss: 0.335615
[19]	valid_0's auc: 0.909294	valid_0's binary_logloss: 0.336599	valid_1's auc: 0.907164	valid_1's binary_logloss: 0.333169
[20]	valid_0's auc: 0.90999	valid_0's binary_logloss: 0.333889	valid_1's auc: 0.907187	valid_1's binary_logloss: 0.331401
[21]	valid_0's auc: 0.910796	valid_0's binary_logloss: 0.331319	valid_1's auc: 0.907442	valid_1's binary_logloss: 0.329573
[22]	valid_0's auc: 0.911382	valid_0's binary_logloss: 0.329005	valid_1's auc: 0.907783	valid_1's binary_logloss: 0.327861
[23]	valid_0's auc: 0.912164	valid_0's binary_logloss: 0.326684	valid_1's auc: 0.908088	valid_1's binary_logloss: 0.326044
[24]	valid_0's auc: 0.912839	valid_0's binary_logloss: 0.324613	valid_1's auc: 0.908199	valid_1's binary_logloss: 0.32477
[25]	valid_0's auc: 0.913549	valid_0's binary_logloss: 0.322611	valid_1's auc: 0.908385	valid_1's binary_logloss: 0.323644
[26]	valid_0's auc: 0.914061	valid_0's binary_logloss: 0.320916	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.322746
[27]	valid_0's auc: 0.914646	valid_0's binary_logloss: 0.31926	valid_1's auc: 0.908704	valid_1's binary_logloss: 0.321783
[28]	valid_0's auc: 0.91518	valid_0's binary_logloss: 0.31762	valid_1's auc: 0.908938	valid_1's binary_logloss: 0.320791
[29]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.316177	valid_1's auc: 0.908731	valid_1's binary_logloss: 0.320349
[30]	valid_0's auc: 0.916273	valid_0's binary_logloss: 0.314667	valid_1's auc: 0.908747	valid_1's binary_logloss: 0.319864
[31]	valid_0's auc: 0.91676	valid_0's binary_logloss: 0.313286	valid_1's auc: 0.908683	valid_1's binary_logloss: 0.31936
[32]	valid_0's auc: 0.917204	valid_0's binary_logloss: 0.312006	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.318635
[33]	valid_0's auc: 0.917713	valid_0's binary_logloss: 0.310731	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.318135
[34]	valid_0's auc: 0.918131	valid_0's binary_logloss: 0.309675	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.31799
[35]	valid_0's auc: 0.918582	valid_0's binary_logloss: 0.308584	valid_1's auc: 0.908977	valid_1's binary_logloss: 0.31743
[36]	valid_0's auc: 0.919153	valid_0's binary_logloss: 0.307488	valid_1's auc: 0.909043	valid_1's binary_logloss: 0.317176
[37]	valid_0's auc: 0.919574	valid_0's binary_logloss: 0.306567	valid_1's auc: 0.909248	valid_1's binary_logloss: 0.316736
[38]	valid_0's auc: 0.920034	valid_0's binary_logloss: 0.305538	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.316445
[39]	valid_0's auc: 0.920455	valid_0's binary_logloss: 0.304592	valid_1's auc: 0.909118	valid_1's binary_logloss: 0.316396
[40]	valid_0's auc: 0.920838	valid_0's binary_logloss: 0.303703	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.316239
[41]	valid_0's auc: 0.921195	valid_0's binary_logloss: 0.302819	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.316214
[42]	valid_0's auc: 0.921676	valid_0's binary_logloss: 0.301858	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.316114
[43]	valid_0's auc: 0.922118	valid_0's binary_logloss: 0.301017	valid_1's auc: 0.9091	valid_1's binary_logloss: 0.315848
[44]	valid_0's auc: 0.922509	valid_0's binary_logloss: 0.300328	valid_1's auc: 0.909201	valid_1's binary_logloss: 0.315603
[45]	valid_0's auc: 0.922973	valid_0's binary_logloss: 0.299474	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.315188
[46]	valid_0's auc: 0.923431	valid_0's binary_logloss: 0.298601	valid_1's auc: 0.90941	valid_1's binary_logloss: 0.31515
[47]	valid_0's auc: 0.923817	valid_0's binary_logloss: 0.297895	valid_1's auc: 0.909426	valid_1's binary_logloss: 0.315022
[48]	valid_0's auc: 0.92418	valid_0's binary_logloss: 0.297239	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.31489
[49]	valid_0's auc: 0.924611	valid_0's binary_logloss: 0.29649	valid_1's auc: 0.909316	valid_1's binary_logloss: 0.315043
[50]	valid_0's auc: 0.924958	valid_0's binary_logloss: 0.295842	valid_1's auc: 0.909349	valid_1's binary_logloss: 0.314937
[51]	valid_0's auc: 0.925351	valid_0's binary_logloss: 0.295085	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.314744
[52]	valid_0's auc: 0.925636	valid_0's binary_logloss: 0.294599	valid_1's auc: 0.909423	valid_1's binary_logloss: 0.314687
[53]	valid_0's auc: 0.926002	valid_0's binary_logloss: 0.293941	valid_1's auc: 0.909309	valid_1's binary_logloss: 0.314829
[54]	valid_0's auc: 0.926442	valid_0's binary_logloss: 0.293167	valid_1's auc: 0.909189	valid_1's binary_logloss: 0.314951
[55]	valid_0's auc: 0.92683	valid_0's binary_logloss: 0.292467	valid_1's auc: 0.909166	valid_1's binary_logloss: 0.314906
[56]	valid_0's auc: 0.927187	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.909139	valid_1's binary_logloss: 0.314933
[57]	valid_0's auc: 0.927533	valid_0's binary_logloss: 0.291189	valid_1's auc: 0.90898	valid_1's binary_logloss: 0.315139
[58]	valid_0's auc: 0.928016	valid_0's binary_logloss: 0.2904	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.314864
[59]	valid_0's auc: 0.928339	valid_0's binary_logloss: 0.289863	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.314928
[60]	valid_0's auc: 0.92875	valid_0's binary_logloss: 0.289194	valid_1's auc: 0.909001	valid_1's binary_logloss: 0.315072
[61]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.288403	valid_1's auc: 0.909023	valid_1's binary_logloss: 0.314983
[62]	valid_0's auc: 0.929678	valid_0's binary_logloss: 0.287572	valid_1's auc: 0.908998	valid_1's binary_logloss: 0.315016
[63]	valid_0's auc: 0.929988	valid_0's binary_logloss: 0.286969	valid_1's auc: 0.909103	valid_1's binary_logloss: 0.314867
[64]	valid_0's auc: 0.930369	valid_0's binary_logloss: 0.286292	valid_1's auc: 0.909085	valid_1's binary_logloss: 0.314911
[65]	valid_0's auc: 0.930682	valid_0's binary_logloss: 0.285697	valid_1's auc: 0.909126	valid_1's binary_logloss: 0.314869
[66]	valid_0's auc: 0.931088	valid_0's binary_logloss: 0.285091	valid_1's auc: 0.909065	valid_1's binary_logloss: 0.31499
[67]	valid_0's auc: 0.931411	valid_0's binary_logloss: 0.284547	valid_1's auc: 0.908957	valid_1's binary_logloss: 0.315145
[68]	valid_0's auc: 0.931742	valid_0's binary_logloss: 0.283919	valid_1's auc: 0.908886	valid_1's binary_logloss: 0.315191
[69]	valid_0's auc: 0.932053	valid_0's binary_logloss: 0.283427	valid_1's auc: 0.908939	valid_1's binary_logloss: 0.31508
[70]	valid_0's auc: 0.932375	valid_0's binary_logloss: 0.282863	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.315224
[71]	valid_0's auc: 0.932698	valid_0's binary_logloss: 0.2823	valid_1's auc: 0.90882	valid_1's binary_logloss: 0.315262
[72]	valid_0's auc: 0.932968	valid_0's binary_logloss: 0.281835	valid_1's auc: 0.908749	valid_1's binary_logloss: 0.315389
[73]	valid_0's auc: 0.933232	valid_0's binary_logloss: 0.281372	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.315687
[74]	valid_0's auc: 0.933466	valid_0's binary_logloss: 0.280948	valid_1's auc: 0.90843	valid_1's binary_logloss: 0.315869
[75]	valid_0's auc: 0.933773	valid_0's binary_logloss: 0.280406	valid_1's auc: 0.908514	valid_1's binary_logloss: 0.3157
[76]	valid_0's auc: 0.93402	valid_0's binary_logloss: 0.27993	valid_1's auc: 0.908559	valid_1's binary_logloss: 0.315583
[77]	valid_0's auc: 0.934265	valid_0's binary_logloss: 0.27944	valid_1's auc: 0.908501	valid_1's binary_logloss: 0.315647
[78]	valid_0's auc: 0.934593	valid_0's binary_logloss: 0.278892	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.315792
[79]	valid_0's auc: 0.934893	valid_0's binary_logloss: 0.278289	valid_1's auc: 0.908478	valid_1's binary_logloss: 0.315701
[80]	valid_0's auc: 0.93509	valid_0's binary_logloss: 0.277951	valid_1's auc: 0.908439	valid_1's binary_logloss: 0.315758
[81]	valid_0's auc: 0.935353	valid_0's binary_logloss: 0.277445	valid_1's auc: 0.908477	valid_1's binary_logloss: 0.315684
[82]	valid_0's auc: 0.935608	valid_0's binary_logloss: 0.277016	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.315691
[83]	valid_0's auc: 0.935862	valid_0's binary_logloss: 0.276597	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.315919
[84]	valid_0's auc: 0.936122	valid_0's binary_logloss: 0.276122	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.315985
[85]	valid_0's auc: 0.936368	valid_0's binary_logloss: 0.275658	valid_1's auc: 0.908257	valid_1's binary_logloss: 0.315952
[86]	valid_0's auc: 0.936636	valid_0's binary_logloss: 0.275201	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.31603
[87]	valid_0's auc: 0.937046	valid_0's binary_logloss: 0.274498	valid_1's auc: 0.908227	valid_1's binary_logloss: 0.316062
[88]	valid_0's auc: 0.937257	valid_0's binary_logloss: 0.274099	valid_1's auc: 0.908252	valid_1's binary_logloss: 0.315981
[89]	valid_0's auc: 0.93748	valid_0's binary_logloss: 0.273713	valid_1's auc: 0.908212	valid_1's binary_logloss: 0.31602
[90]	valid_0's auc: 0.937695	valid_0's binary_logloss: 0.273335	valid_1's auc: 0.908106	valid_1's binary_logloss: 0.316176
[91]	valid_0's auc: 0.937945	valid_0's binary_logloss: 0.272886	valid_1's auc: 0.90796	valid_1's binary_logloss: 0.316357
[92]	valid_0's auc: 0.938157	valid_0's binary_logloss: 0.272498	valid_1's auc: 0.907956	valid_1's binary_logloss: 0.316372
[93]	valid_0's auc: 0.938359	valid_0's binary_logloss: 0.272149	valid_1's auc: 0.907826	valid_1's binary_logloss: 0.316591
[94]	valid_0's auc: 0.938587	valid_0's binary_logloss: 0.271683	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.316631
[95]	valid_0's auc: 0.938759	valid_0's binary_logloss: 0.271307	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.31669
[96]	valid_0's auc: 0.939088	valid_0's binary_logloss: 0.270739	valid_1's auc: 0.90777	valid_1's binary_logloss: 0.316698
[97]	valid_0's auc: 0.939308	valid_0's binary_logloss: 0.270289	valid_1's auc: 0.907633	valid_1's binary_logloss: 0.316942
[98]	valid_0's auc: 0.939523	valid_0's binary_logloss: 0.269932	valid_1's auc: 0.907534	valid_1's binary_logloss: 0.317123
[99]	valid_0's auc: 0.939729	valid_0's binary_logloss: 0.269552	valid_1's auc: 0.907446	valid_1's binary_logloss: 0.317276
[100]	valid_0's auc: 0.939923	valid_0's binary_logloss: 0.26918	valid_1's auc: 0.907461	valid_1's binary_logloss: 0.317241
[101]	valid_0's auc: 0.94011	valid_0's binary_logloss: 0.26876	valid_1's auc: 0.907318	valid_1's binary_logloss: 0.317514
[102]	valid_0's auc: 0.940323	valid_0's binary_logloss: 0.268393	valid_1's auc: 0.907372	valid_1's binary_logloss: 0.317425
[103]	valid_0's auc: 0.94052	valid_0's binary_logloss: 0.268022	valid_1's auc: 0.907287	valid_1's binary_logloss: 0.317592
[104]	valid_0's auc: 0.940756	valid_0's binary_logloss: 0.267555	valid_1's auc: 0.907159	valid_1's binary_logloss: 0.317818
[105]	valid_0's auc: 0.940982	valid_0's binary_logloss: 0.267184	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.317877
[106]	valid_0's auc: 0.941179	valid_0's binary_logloss: 0.266827	valid_1's auc: 0.906989	valid_1's binary_logloss: 0.318038
[107]	valid_0's auc: 0.941474	valid_0's binary_logloss: 0.266307	valid_1's auc: 0.906898	valid_1's binary_logloss: 0.318199
[108]	valid_0's auc: 0.94175	valid_0's binary_logloss: 0.26582	valid_1's auc: 0.906779	valid_1's binary_logloss: 0.318366
[109]	valid_0's auc: 0.942117	valid_0's binary_logloss: 0.265207	valid_1's auc: 0.906579	valid_1's binary_logloss: 0.318655
[110]	valid_0's auc: 0.942383	valid_0's binary_logloss: 0.264702	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.318811
[111]	valid_0's auc: 0.942648	valid_0's binary_logloss: 0.264201	valid_1's auc: 0.906419	valid_1's binary_logloss: 0.318918
[112]	valid_0's auc: 0.942792	valid_0's binary_logloss: 0.26391	valid_1's auc: 0.906335	valid_1's binary_logloss: 0.319095
[113]	valid_0's auc: 0.942935	valid_0's binary_logloss: 0.263606	valid_1's auc: 0.906287	valid_1's binary_logloss: 0.319201
[114]	valid_0's auc: 0.94312	valid_0's binary_logloss: 0.263239	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.319282
[115]	valid_0's auc: 0.94333	valid_0's binary_logloss: 0.262866	valid_1's auc: 0.906171	valid_1's binary_logloss: 0.319407
[116]	valid_0's auc: 0.943532	valid_0's binary_logloss: 0.26252	valid_1's auc: 0.906085	valid_1's binary_logloss: 0.319512
[117]	valid_0's auc: 0.943773	valid_0's binary_logloss: 0.262109	valid_1's auc: 0.905938	valid_1's binary_logloss: 0.319731
[118]	valid_0's auc: 0.94406	valid_0's binary_logloss: 0.261512	valid_1's auc: 0.905769	valid_1's binary_logloss: 0.319982
[119]	valid_0's auc: 0.944252	valid_0's binary_logloss: 0.26117	valid_1's auc: 0.905578	valid_1's binary_logloss: 0.320289
[120]	valid_0's auc: 0.94443	valid_0's binary_logloss: 0.260805	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.320332
[121]	valid_0's auc: 0.94462	valid_0's binary_logloss: 0.260436	valid_1's auc: 0.905563	valid_1's binary_logloss: 0.320315
[122]	valid_0's auc: 0.944777	valid_0's binary_logloss: 0.26014	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.32036
[123]	valid_0's auc: 0.944979	valid_0's binary_logloss: 0.259752	valid_1's auc: 0.905487	valid_1's binary_logloss: 0.320496
[124]	valid_0's auc: 0.945153	valid_0's binary_logloss: 0.259404	valid_1's auc: 0.905414	valid_1's binary_logloss: 0.320608
[125]	valid_0's auc: 0.945359	valid_0's binary_logloss: 0.258941	valid_1's auc: 0.905357	valid_1's binary_logloss: 0.320733
[126]	valid_0's auc: 0.945515	valid_0's binary_logloss: 0.258649	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.320855
[127]	valid_0's auc: 0.945652	valid_0's binary_logloss: 0.258366	valid_1's auc: 0.905271	valid_1's binary_logloss: 0.320992
[128]	valid_0's auc: 0.945942	valid_0's binary_logloss: 0.257852	valid_1's auc: 0.905257	valid_1's binary_logloss: 0.321043
[129]	valid_0's auc: 0.946094	valid_0's binary_logloss: 0.257524	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.321026
[130]	valid_0's auc: 0.946302	valid_0's binary_logloss: 0.257141	valid_1's auc: 0.905273	valid_1's binary_logloss: 0.321023
[131]	valid_0's auc: 0.946472	valid_0's binary_logloss: 0.256797	valid_1's auc: 0.905221	valid_1's binary_logloss: 0.321181
[132]	valid_0's auc: 0.946576	valid_0's binary_logloss: 0.256549	valid_1's auc: 0.905266	valid_1's binary_logloss: 0.321158
[133]	valid_0's auc: 0.946675	valid_0's binary_logloss: 0.256344	valid_1's auc: 0.905266	valid_1's binary_logloss: 0.321207
[134]	valid_0's auc: 0.946862	valid_0's binary_logloss: 0.255981	valid_1's auc: 0.905167	valid_1's binary_logloss: 0.321417
[135]	valid_0's auc: 0.946999	valid_0's binary_logloss: 0.255725	valid_1's auc: 0.90507	valid_1's binary_logloss: 0.321615
[136]	valid_0's auc: 0.947152	valid_0's binary_logloss: 0.255429	valid_1's auc: 0.905063	valid_1's binary_logloss: 0.321662
[137]	valid_0's auc: 0.947329	valid_0's binary_logloss: 0.255096	valid_1's auc: 0.90497	valid_1's binary_logloss: 0.321794
[138]	valid_0's auc: 0.947418	valid_0's binary_logloss: 0.254873	valid_1's auc: 0.904886	valid_1's binary_logloss: 0.321971
[139]	valid_0's auc: 0.947593	valid_0's binary_logloss: 0.254562	valid_1's auc: 0.904858	valid_1's binary_logloss: 0.322029
[140]	valid_0's auc: 0.947754	valid_0's binary_logloss: 0.254233	valid_1's auc: 0.904843	valid_1's binary_logloss: 0.322119
[141]	valid_0's auc: 0.948003	valid_0's binary_logloss: 0.253773	valid_1's auc: 0.904805	valid_1's binary_logloss: 0.322169
[142]	valid_0's auc: 0.948131	valid_0's binary_logloss: 0.253474	valid_1's auc: 0.90472	valid_1's binary_logloss: 0.322373
[143]	valid_0's auc: 0.948368	valid_0's binary_logloss: 0.253047	valid_1's auc: 0.904639	valid_1's binary_logloss: 0.322552
[144]	valid_0's auc: 0.948615	valid_0's binary_logloss: 0.252575	valid_1's auc: 0.904727	valid_1's binary_logloss: 0.322417
[145]	valid_0's auc: 0.948801	valid_0's binary_logloss: 0.252229	valid_1's auc: 0.904731	valid_1's binary_logloss: 0.322465
[146]	valid_0's auc: 0.948975	valid_0's binary_logloss: 0.251896	valid_1's auc: 0.904737	valid_1's binary_logloss: 0.322505
[147]	valid_0's auc: 0.949207	valid_0's binary_logloss: 0.251457	valid_1's auc: 0.904691	valid_1's binary_logloss: 0.322608
[148]	valid_0's auc: 0.949423	valid_0's binary_logloss: 0.251035	valid_1's auc: 0.904708	valid_1's binary_logloss: 0.322606
Early stopping, best iteration is:
[48]	valid_0's auc: 0.92418	valid_0's binary_logloss: 0.297239	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.31489
[1]	valid_0's auc: 0.889031	valid_0's binary_logloss: 0.516579	valid_1's auc: 0.896723	valid_1's binary_logloss: 0.507458
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892164	valid_0's binary_logloss: 0.487355	valid_1's auc: 0.898379	valid_1's binary_logloss: 0.477426
[3]	valid_0's auc: 0.893991	valid_0's binary_logloss: 0.463908	valid_1's auc: 0.900966	valid_1's binary_logloss: 0.453477
[4]	valid_0's auc: 0.895536	valid_0's binary_logloss: 0.444506	valid_1's auc: 0.900916	valid_1's binary_logloss: 0.43446
[5]	valid_0's auc: 0.895846	valid_0's binary_logloss: 0.428496	valid_1's auc: 0.900658	valid_1's binary_logloss: 0.41849
[6]	valid_0's auc: 0.897167	valid_0's binary_logloss: 0.414703	valid_1's auc: 0.901702	valid_1's binary_logloss: 0.404942
[7]	valid_0's auc: 0.897784	valid_0's binary_logloss: 0.403095	valid_1's auc: 0.902279	valid_1's binary_logloss: 0.393273
[8]	valid_0's auc: 0.898713	valid_0's binary_logloss: 0.393054	valid_1's auc: 0.902347	valid_1's binary_logloss: 0.383885
[9]	valid_0's auc: 0.902294	valid_0's binary_logloss: 0.38416	valid_1's auc: 0.904294	valid_1's binary_logloss: 0.375629
[10]	valid_0's auc: 0.903355	valid_0's binary_logloss: 0.376336	valid_1's auc: 0.904676	valid_1's binary_logloss: 0.368481
[11]	valid_0's auc: 0.903988	valid_0's binary_logloss: 0.369543	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.362239
[12]	valid_0's auc: 0.904553	valid_0's binary_logloss: 0.363566	valid_1's auc: 0.904913	valid_1's binary_logloss: 0.356787
[13]	valid_0's auc: 0.905538	valid_0's binary_logloss: 0.35817	valid_1's auc: 0.905471	valid_1's binary_logloss: 0.351875
[14]	valid_0's auc: 0.906094	valid_0's binary_logloss: 0.353414	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.347498
[15]	valid_0's auc: 0.906689	valid_0's binary_logloss: 0.349218	valid_1's auc: 0.905742	valid_1's binary_logloss: 0.344195
[16]	valid_0's auc: 0.907549	valid_0's binary_logloss: 0.345324	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.341113
[17]	valid_0's auc: 0.908451	valid_0's binary_logloss: 0.341791	valid_1's auc: 0.906324	valid_1's binary_logloss: 0.338325
[18]	valid_0's auc: 0.909157	valid_0's binary_logloss: 0.338598	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.335633
[19]	valid_0's auc: 0.910038	valid_0's binary_logloss: 0.335529	valid_1's auc: 0.906706	valid_1's binary_logloss: 0.333723
[20]	valid_0's auc: 0.910713	valid_0's binary_logloss: 0.332831	valid_1's auc: 0.906867	valid_1's binary_logloss: 0.331714
[21]	valid_0's auc: 0.911634	valid_0's binary_logloss: 0.330075	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.329824
[22]	valid_0's auc: 0.912278	valid_0's binary_logloss: 0.327816	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.328227
[23]	valid_0's auc: 0.912991	valid_0's binary_logloss: 0.325524	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.326579
[24]	valid_0's auc: 0.913625	valid_0's binary_logloss: 0.323469	valid_1's auc: 0.907911	valid_1's binary_logloss: 0.325444
[25]	valid_0's auc: 0.914248	valid_0's binary_logloss: 0.321489	valid_1's auc: 0.908274	valid_1's binary_logloss: 0.324004
[26]	valid_0's auc: 0.914868	valid_0's binary_logloss: 0.319685	valid_1's auc: 0.908371	valid_1's binary_logloss: 0.323014
[27]	valid_0's auc: 0.915371	valid_0's binary_logloss: 0.318143	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.32196
[28]	valid_0's auc: 0.916013	valid_0's binary_logloss: 0.316508	valid_1's auc: 0.908739	valid_1's binary_logloss: 0.321156
[29]	valid_0's auc: 0.9165	valid_0's binary_logloss: 0.315094	valid_1's auc: 0.908702	valid_1's binary_logloss: 0.320628
[30]	valid_0's auc: 0.916968	valid_0's binary_logloss: 0.313842	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.319954
[31]	valid_0's auc: 0.917477	valid_0's binary_logloss: 0.312456	valid_1's auc: 0.909088	valid_1's binary_logloss: 0.319123
[32]	valid_0's auc: 0.917927	valid_0's binary_logloss: 0.311173	valid_1's auc: 0.90924	valid_1's binary_logloss: 0.318445
[33]	valid_0's auc: 0.918412	valid_0's binary_logloss: 0.309891	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.317731
[34]	valid_0's auc: 0.918856	valid_0's binary_logloss: 0.308845	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.317449
[35]	valid_0's auc: 0.919242	valid_0's binary_logloss: 0.30776	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.317064
[36]	valid_0's auc: 0.919636	valid_0's binary_logloss: 0.306756	valid_1's auc: 0.909324	valid_1's binary_logloss: 0.316776
[37]	valid_0's auc: 0.920134	valid_0's binary_logloss: 0.305665	valid_1's auc: 0.909257	valid_1's binary_logloss: 0.316698
[38]	valid_0's auc: 0.920609	valid_0's binary_logloss: 0.304655	valid_1's auc: 0.909326	valid_1's binary_logloss: 0.31641
[39]	valid_0's auc: 0.921002	valid_0's binary_logloss: 0.303746	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316348
[40]	valid_0's auc: 0.921495	valid_0's binary_logloss: 0.302707	valid_1's auc: 0.909433	valid_1's binary_logloss: 0.31593
[41]	valid_0's auc: 0.921908	valid_0's binary_logloss: 0.301861	valid_1's auc: 0.909337	valid_1's binary_logloss: 0.315878
[42]	valid_0's auc: 0.922423	valid_0's binary_logloss: 0.300876	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.315729
[43]	valid_0's auc: 0.922847	valid_0's binary_logloss: 0.299958	valid_1's auc: 0.909474	valid_1's binary_logloss: 0.31542
[44]	valid_0's auc: 0.923235	valid_0's binary_logloss: 0.29914	valid_1's auc: 0.909496	valid_1's binary_logloss: 0.315238
[45]	valid_0's auc: 0.923566	valid_0's binary_logloss: 0.298438	valid_1's auc: 0.909643	valid_1's binary_logloss: 0.314977
[46]	valid_0's auc: 0.923915	valid_0's binary_logloss: 0.297727	valid_1's auc: 0.909614	valid_1's binary_logloss: 0.314969
[47]	valid_0's auc: 0.924265	valid_0's binary_logloss: 0.297041	valid_1's auc: 0.909587	valid_1's binary_logloss: 0.314904
[48]	valid_0's auc: 0.924709	valid_0's binary_logloss: 0.296159	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314773
[49]	valid_0's auc: 0.925106	valid_0's binary_logloss: 0.295397	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.314654
[50]	valid_0's auc: 0.925476	valid_0's binary_logloss: 0.294712	valid_1's auc: 0.909534	valid_1's binary_logloss: 0.314853
[51]	valid_0's auc: 0.925824	valid_0's binary_logloss: 0.294027	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314817
[52]	valid_0's auc: 0.926122	valid_0's binary_logloss: 0.293495	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314756
[53]	valid_0's auc: 0.926487	valid_0's binary_logloss: 0.292777	valid_1's auc: 0.909578	valid_1's binary_logloss: 0.314687
[54]	valid_0's auc: 0.926757	valid_0's binary_logloss: 0.292188	valid_1's auc: 0.909616	valid_1's binary_logloss: 0.314586
[55]	valid_0's auc: 0.927077	valid_0's binary_logloss: 0.291593	valid_1's auc: 0.909671	valid_1's binary_logloss: 0.314447
[56]	valid_0's auc: 0.927471	valid_0's binary_logloss: 0.290865	valid_1's auc: 0.90965	valid_1's binary_logloss: 0.314491
[57]	valid_0's auc: 0.927818	valid_0's binary_logloss: 0.290232	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.314482
[58]	valid_0's auc: 0.928086	valid_0's binary_logloss: 0.289699	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.31454
[59]	valid_0's auc: 0.928488	valid_0's binary_logloss: 0.28898	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.31455
[60]	valid_0's auc: 0.928775	valid_0's binary_logloss: 0.288429	valid_1's auc: 0.909538	valid_1's binary_logloss: 0.314625
[61]	valid_0's auc: 0.929162	valid_0's binary_logloss: 0.287728	valid_1's auc: 0.909589	valid_1's binary_logloss: 0.314539
[62]	valid_0's auc: 0.929604	valid_0's binary_logloss: 0.287018	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.314722
[63]	valid_0's auc: 0.929952	valid_0's binary_logloss: 0.286422	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.314802
[64]	valid_0's auc: 0.930248	valid_0's binary_logloss: 0.285901	valid_1's auc: 0.909232	valid_1's binary_logloss: 0.315051
[65]	valid_0's auc: 0.930539	valid_0's binary_logloss: 0.285381	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.31524
[66]	valid_0's auc: 0.930859	valid_0's binary_logloss: 0.284803	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.315131
[67]	valid_0's auc: 0.931146	valid_0's binary_logloss: 0.284241	valid_1's auc: 0.908983	valid_1's binary_logloss: 0.315413
[68]	valid_0's auc: 0.931571	valid_0's binary_logloss: 0.283554	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.315561
[69]	valid_0's auc: 0.931886	valid_0's binary_logloss: 0.283024	valid_1's auc: 0.908878	valid_1's binary_logloss: 0.315626
[70]	valid_0's auc: 0.932168	valid_0's binary_logloss: 0.282496	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.315751
[71]	valid_0's auc: 0.932471	valid_0's binary_logloss: 0.281921	valid_1's auc: 0.908811	valid_1's binary_logloss: 0.315777
[72]	valid_0's auc: 0.932789	valid_0's binary_logloss: 0.281355	valid_1's auc: 0.908817	valid_1's binary_logloss: 0.315795
[73]	valid_0's auc: 0.933146	valid_0's binary_logloss: 0.280779	valid_1's auc: 0.908675	valid_1's binary_logloss: 0.316064
[74]	valid_0's auc: 0.93344	valid_0's binary_logloss: 0.280261	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.31615
[75]	valid_0's auc: 0.933611	valid_0's binary_logloss: 0.279841	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315964
[76]	valid_0's auc: 0.933837	valid_0's binary_logloss: 0.27939	valid_1's auc: 0.908695	valid_1's binary_logloss: 0.315919
[77]	valid_0's auc: 0.934116	valid_0's binary_logloss: 0.278947	valid_1's auc: 0.908686	valid_1's binary_logloss: 0.315926
[78]	valid_0's auc: 0.934391	valid_0's binary_logloss: 0.278469	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.316043
[79]	valid_0's auc: 0.934704	valid_0's binary_logloss: 0.277891	valid_1's auc: 0.908499	valid_1's binary_logloss: 0.316303
[80]	valid_0's auc: 0.934897	valid_0's binary_logloss: 0.277476	valid_1's auc: 0.908447	valid_1's binary_logloss: 0.316355
[81]	valid_0's auc: 0.935218	valid_0's binary_logloss: 0.276925	valid_1's auc: 0.908424	valid_1's binary_logloss: 0.316429
[82]	valid_0's auc: 0.935446	valid_0's binary_logloss: 0.276461	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.316526
[83]	valid_0's auc: 0.935717	valid_0's binary_logloss: 0.27601	valid_1's auc: 0.908496	valid_1's binary_logloss: 0.316329
[84]	valid_0's auc: 0.935997	valid_0's binary_logloss: 0.275559	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316415
[85]	valid_0's auc: 0.936359	valid_0's binary_logloss: 0.274987	valid_1's auc: 0.908543	valid_1's binary_logloss: 0.316217
[86]	valid_0's auc: 0.936629	valid_0's binary_logloss: 0.274545	valid_1's auc: 0.908503	valid_1's binary_logloss: 0.316244
[87]	valid_0's auc: 0.936842	valid_0's binary_logloss: 0.274134	valid_1's auc: 0.908378	valid_1's binary_logloss: 0.316459
[88]	valid_0's auc: 0.937084	valid_0's binary_logloss: 0.273721	valid_1's auc: 0.908353	valid_1's binary_logloss: 0.316478
[89]	valid_0's auc: 0.937334	valid_0's binary_logloss: 0.273258	valid_1's auc: 0.908335	valid_1's binary_logloss: 0.316523
[90]	valid_0's auc: 0.93752	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.908264	valid_1's binary_logloss: 0.316655
[91]	valid_0's auc: 0.93778	valid_0's binary_logloss: 0.272463	valid_1's auc: 0.908155	valid_1's binary_logloss: 0.316889
[92]	valid_0's auc: 0.938109	valid_0's binary_logloss: 0.271912	valid_1's auc: 0.908064	valid_1's binary_logloss: 0.31704
[93]	valid_0's auc: 0.938301	valid_0's binary_logloss: 0.271506	valid_1's auc: 0.908165	valid_1's binary_logloss: 0.316845
[94]	valid_0's auc: 0.938574	valid_0's binary_logloss: 0.271049	valid_1's auc: 0.908245	valid_1's binary_logloss: 0.316724
[95]	valid_0's auc: 0.938831	valid_0's binary_logloss: 0.270617	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.316538
[96]	valid_0's auc: 0.938989	valid_0's binary_logloss: 0.270247	valid_1's auc: 0.908291	valid_1's binary_logloss: 0.316662
[97]	valid_0's auc: 0.939363	valid_0's binary_logloss: 0.269571	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316925
[98]	valid_0's auc: 0.939648	valid_0's binary_logloss: 0.269072	valid_1's auc: 0.908139	valid_1's binary_logloss: 0.31696
[99]	valid_0's auc: 0.939855	valid_0's binary_logloss: 0.268664	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.317031
[100]	valid_0's auc: 0.940126	valid_0's binary_logloss: 0.268181	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.317212
[101]	valid_0's auc: 0.940435	valid_0's binary_logloss: 0.267675	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.317394
[102]	valid_0's auc: 0.940697	valid_0's binary_logloss: 0.267238	valid_1's auc: 0.907798	valid_1's binary_logloss: 0.317579
[103]	valid_0's auc: 0.940958	valid_0's binary_logloss: 0.266773	valid_1's auc: 0.907711	valid_1's binary_logloss: 0.317707
[104]	valid_0's auc: 0.941198	valid_0's binary_logloss: 0.266341	valid_1's auc: 0.90765	valid_1's binary_logloss: 0.31785
[105]	valid_0's auc: 0.9414	valid_0's binary_logloss: 0.265922	valid_1's auc: 0.907632	valid_1's binary_logloss: 0.317866
[106]	valid_0's auc: 0.941665	valid_0's binary_logloss: 0.265441	valid_1's auc: 0.907555	valid_1's binary_logloss: 0.318049
[107]	valid_0's auc: 0.941982	valid_0's binary_logloss: 0.264838	valid_1's auc: 0.907359	valid_1's binary_logloss: 0.318445
[108]	valid_0's auc: 0.942163	valid_0's binary_logloss: 0.264447	valid_1's auc: 0.907241	valid_1's binary_logloss: 0.318673
[109]	valid_0's auc: 0.942443	valid_0's binary_logloss: 0.263923	valid_1's auc: 0.90725	valid_1's binary_logloss: 0.318661
[110]	valid_0's auc: 0.942667	valid_0's binary_logloss: 0.263477	valid_1's auc: 0.907244	valid_1's binary_logloss: 0.318654
[111]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.262934	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318711
[112]	valid_0's auc: 0.943205	valid_0's binary_logloss: 0.262527	valid_1's auc: 0.90725	valid_1's binary_logloss: 0.318762
[113]	valid_0's auc: 0.943417	valid_0's binary_logloss: 0.262151	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318951
[114]	valid_0's auc: 0.9436	valid_0's binary_logloss: 0.261796	valid_1's auc: 0.907191	valid_1's binary_logloss: 0.318882
[115]	valid_0's auc: 0.94381	valid_0's binary_logloss: 0.261434	valid_1's auc: 0.907168	valid_1's binary_logloss: 0.318937
[116]	valid_0's auc: 0.943938	valid_0's binary_logloss: 0.261187	valid_1's auc: 0.907157	valid_1's binary_logloss: 0.318953
[117]	valid_0's auc: 0.944117	valid_0's binary_logloss: 0.260838	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.319024
[118]	valid_0's auc: 0.944258	valid_0's binary_logloss: 0.260561	valid_1's auc: 0.907103	valid_1's binary_logloss: 0.31907
[119]	valid_0's auc: 0.944462	valid_0's binary_logloss: 0.260174	valid_1's auc: 0.906947	valid_1's binary_logloss: 0.319334
[120]	valid_0's auc: 0.944622	valid_0's binary_logloss: 0.259853	valid_1's auc: 0.906871	valid_1's binary_logloss: 0.319482
[121]	valid_0's auc: 0.944842	valid_0's binary_logloss: 0.259447	valid_1's auc: 0.90682	valid_1's binary_logloss: 0.319603
[122]	valid_0's auc: 0.944951	valid_0's binary_logloss: 0.259244	valid_1's auc: 0.906772	valid_1's binary_logloss: 0.31969
[123]	valid_0's auc: 0.94514	valid_0's binary_logloss: 0.25886	valid_1's auc: 0.906763	valid_1's binary_logloss: 0.319732
[124]	valid_0's auc: 0.945274	valid_0's binary_logloss: 0.258594	valid_1's auc: 0.906728	valid_1's binary_logloss: 0.319808
[125]	valid_0's auc: 0.945415	valid_0's binary_logloss: 0.25831	valid_1's auc: 0.906697	valid_1's binary_logloss: 0.319892
[126]	valid_0's auc: 0.945612	valid_0's binary_logloss: 0.257959	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.320089
[127]	valid_0's auc: 0.945829	valid_0's binary_logloss: 0.257571	valid_1's auc: 0.906618	valid_1's binary_logloss: 0.320055
[128]	valid_0's auc: 0.94611	valid_0's binary_logloss: 0.257035	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320114
[129]	valid_0's auc: 0.946377	valid_0's binary_logloss: 0.256539	valid_1's auc: 0.906599	valid_1's binary_logloss: 0.320193
[130]	valid_0's auc: 0.946636	valid_0's binary_logloss: 0.256038	valid_1's auc: 0.906413	valid_1's binary_logloss: 0.320506
[131]	valid_0's auc: 0.946813	valid_0's binary_logloss: 0.255686	valid_1's auc: 0.906319	valid_1's binary_logloss: 0.320679
[132]	valid_0's auc: 0.947044	valid_0's binary_logloss: 0.255266	valid_1's auc: 0.906368	valid_1's binary_logloss: 0.320661
[133]	valid_0's auc: 0.947154	valid_0's binary_logloss: 0.25504	valid_1's auc: 0.906418	valid_1's binary_logloss: 0.320569
[134]	valid_0's auc: 0.947312	valid_0's binary_logloss: 0.254733	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.320621
[135]	valid_0's auc: 0.947434	valid_0's binary_logloss: 0.254504	valid_1's auc: 0.906347	valid_1's binary_logloss: 0.320712
[136]	valid_0's auc: 0.947551	valid_0's binary_logloss: 0.254246	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.320997
[137]	valid_0's auc: 0.94776	valid_0's binary_logloss: 0.253837	valid_1's auc: 0.906172	valid_1's binary_logloss: 0.321128
[138]	valid_0's auc: 0.947923	valid_0's binary_logloss: 0.253515	valid_1's auc: 0.906112	valid_1's binary_logloss: 0.321222
[139]	valid_0's auc: 0.948251	valid_0's binary_logloss: 0.252921	valid_1's auc: 0.906227	valid_1's binary_logloss: 0.321089
[140]	valid_0's auc: 0.948378	valid_0's binary_logloss: 0.252614	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.321136
[141]	valid_0's auc: 0.948539	valid_0's binary_logloss: 0.252302	valid_1's auc: 0.906081	valid_1's binary_logloss: 0.321339
[142]	valid_0's auc: 0.948718	valid_0's binary_logloss: 0.251942	valid_1's auc: 0.906054	valid_1's binary_logloss: 0.321403
[143]	valid_0's auc: 0.948984	valid_0's binary_logloss: 0.251466	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.321482
[144]	valid_0's auc: 0.949255	valid_0's binary_logloss: 0.250997	valid_1's auc: 0.906143	valid_1's binary_logloss: 0.321313
[145]	valid_0's auc: 0.949399	valid_0's binary_logloss: 0.250701	valid_1's auc: 0.906083	valid_1's binary_logloss: 0.321442
[146]	valid_0's auc: 0.949633	valid_0's binary_logloss: 0.250241	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.32167
[147]	valid_0's auc: 0.949774	valid_0's binary_logloss: 0.249945	valid_1's auc: 0.905981	valid_1's binary_logloss: 0.321676
[148]	valid_0's auc: 0.949919	valid_0's binary_logloss: 0.249615	valid_1's auc: 0.905992	valid_1's binary_logloss: 0.321656
[149]	valid_0's auc: 0.950048	valid_0's binary_logloss: 0.249366	valid_1's auc: 0.905952	valid_1's binary_logloss: 0.321717
Early stopping, best iteration is:
[49]	valid_0's auc: 0.925106	valid_0's binary_logloss: 0.295397	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.314654
[1]	valid_0's auc: 0.888084	valid_0's binary_logloss: 0.516884	valid_1's auc: 0.893464	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890797	valid_0's binary_logloss: 0.487718	valid_1's auc: 0.897592	valid_1's binary_logloss: 0.478465
[3]	valid_0's auc: 0.892513	valid_0's binary_logloss: 0.464334	valid_1's auc: 0.898665	valid_1's binary_logloss: 0.454805
[4]	valid_0's auc: 0.894815	valid_0's binary_logloss: 0.444821	valid_1's auc: 0.899433	valid_1's binary_logloss: 0.435394
[5]	valid_0's auc: 0.896021	valid_0's binary_logloss: 0.428702	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419476
[6]	valid_0's auc: 0.89928	valid_0's binary_logloss: 0.415058	valid_1's auc: 0.902649	valid_1's binary_logloss: 0.405991
[7]	valid_0's auc: 0.900439	valid_0's binary_logloss: 0.403201	valid_1's auc: 0.902605	valid_1's binary_logloss: 0.394544
[8]	valid_0's auc: 0.901538	valid_0's binary_logloss: 0.393166	valid_1's auc: 0.903058	valid_1's binary_logloss: 0.384843
[9]	valid_0's auc: 0.902204	valid_0's binary_logloss: 0.384401	valid_1's auc: 0.903156	valid_1's binary_logloss: 0.376624
[10]	valid_0's auc: 0.903221	valid_0's binary_logloss: 0.376758	valid_1's auc: 0.903175	valid_1's binary_logloss: 0.369696
[11]	valid_0's auc: 0.904073	valid_0's binary_logloss: 0.369858	valid_1's auc: 0.90337	valid_1's binary_logloss: 0.36353
[12]	valid_0's auc: 0.9048	valid_0's binary_logloss: 0.363903	valid_1's auc: 0.904	valid_1's binary_logloss: 0.357996
[13]	valid_0's auc: 0.905852	valid_0's binary_logloss: 0.358528	valid_1's auc: 0.904463	valid_1's binary_logloss: 0.353176
[14]	valid_0's auc: 0.906544	valid_0's binary_logloss: 0.353777	valid_1's auc: 0.904775	valid_1's binary_logloss: 0.348981
[15]	valid_0's auc: 0.907501	valid_0's binary_logloss: 0.349288	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.345392
[16]	valid_0's auc: 0.908224	valid_0's binary_logloss: 0.345361	valid_1's auc: 0.905819	valid_1's binary_logloss: 0.341971
[17]	valid_0's auc: 0.908902	valid_0's binary_logloss: 0.341809	valid_1's auc: 0.905831	valid_1's binary_logloss: 0.339271
[18]	valid_0's auc: 0.909407	valid_0's binary_logloss: 0.338728	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.336615
[19]	valid_0's auc: 0.910331	valid_0's binary_logloss: 0.33564	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.334456
[20]	valid_0's auc: 0.910901	valid_0's binary_logloss: 0.332967	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.332309
[21]	valid_0's auc: 0.911538	valid_0's binary_logloss: 0.330566	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.330669
[22]	valid_0's auc: 0.912064	valid_0's binary_logloss: 0.328361	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.329121
[23]	valid_0's auc: 0.912885	valid_0's binary_logloss: 0.326088	valid_1's auc: 0.907117	valid_1's binary_logloss: 0.32779
[24]	valid_0's auc: 0.913529	valid_0's binary_logloss: 0.323942	valid_1's auc: 0.907317	valid_1's binary_logloss: 0.326314
[25]	valid_0's auc: 0.914062	valid_0's binary_logloss: 0.322036	valid_1's auc: 0.907398	valid_1's binary_logloss: 0.325299
[26]	valid_0's auc: 0.914586	valid_0's binary_logloss: 0.320323	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.324142
[27]	valid_0's auc: 0.915109	valid_0's binary_logloss: 0.318676	valid_1's auc: 0.907677	valid_1's binary_logloss: 0.323322
[28]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.317074	valid_1's auc: 0.907512	valid_1's binary_logloss: 0.322839
[29]	valid_0's auc: 0.916231	valid_0's binary_logloss: 0.315562	valid_1's auc: 0.907548	valid_1's binary_logloss: 0.322137
[30]	valid_0's auc: 0.916764	valid_0's binary_logloss: 0.314118	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.321508
[31]	valid_0's auc: 0.917363	valid_0's binary_logloss: 0.312626	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.320864
[32]	valid_0's auc: 0.917866	valid_0's binary_logloss: 0.311379	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.320495
[33]	valid_0's auc: 0.918423	valid_0's binary_logloss: 0.310066	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.320319
[34]	valid_0's auc: 0.918943	valid_0's binary_logloss: 0.308859	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.320047
[35]	valid_0's auc: 0.919479	valid_0's binary_logloss: 0.307644	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.319762
[36]	valid_0's auc: 0.920042	valid_0's binary_logloss: 0.306443	valid_1's auc: 0.907741	valid_1's binary_logloss: 0.319378
[37]	valid_0's auc: 0.920618	valid_0's binary_logloss: 0.305329	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.319344
[38]	valid_0's auc: 0.921094	valid_0's binary_logloss: 0.304269	valid_1's auc: 0.90753	valid_1's binary_logloss: 0.319331
[39]	valid_0's auc: 0.921495	valid_0's binary_logloss: 0.303341	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.319278
[40]	valid_0's auc: 0.921992	valid_0's binary_logloss: 0.302363	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.319064
[41]	valid_0's auc: 0.92246	valid_0's binary_logloss: 0.301364	valid_1's auc: 0.907618	valid_1's binary_logloss: 0.318754
[42]	valid_0's auc: 0.922914	valid_0's binary_logloss: 0.300405	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.318491
[43]	valid_0's auc: 0.923272	valid_0's binary_logloss: 0.299597	valid_1's auc: 0.907829	valid_1's binary_logloss: 0.318247
[44]	valid_0's auc: 0.923698	valid_0's binary_logloss: 0.298756	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.318189
[45]	valid_0's auc: 0.924137	valid_0's binary_logloss: 0.297894	valid_1's auc: 0.907621	valid_1's binary_logloss: 0.318336
[46]	valid_0's auc: 0.924454	valid_0's binary_logloss: 0.297225	valid_1's auc: 0.907634	valid_1's binary_logloss: 0.318217
[47]	valid_0's auc: 0.924878	valid_0's binary_logloss: 0.296435	valid_1's auc: 0.907569	valid_1's binary_logloss: 0.318201
[48]	valid_0's auc: 0.925247	valid_0's binary_logloss: 0.295698	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317998
[49]	valid_0's auc: 0.925601	valid_0's binary_logloss: 0.295045	valid_1's auc: 0.907648	valid_1's binary_logloss: 0.317992
[50]	valid_0's auc: 0.926042	valid_0's binary_logloss: 0.294282	valid_1's auc: 0.907637	valid_1's binary_logloss: 0.317905
[51]	valid_0's auc: 0.926443	valid_0's binary_logloss: 0.293488	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317894
[52]	valid_0's auc: 0.926768	valid_0's binary_logloss: 0.292808	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317849
[53]	valid_0's auc: 0.927053	valid_0's binary_logloss: 0.292247	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.317869
[54]	valid_0's auc: 0.927414	valid_0's binary_logloss: 0.291576	valid_1's auc: 0.907545	valid_1's binary_logloss: 0.317797
[55]	valid_0's auc: 0.927746	valid_0's binary_logloss: 0.290957	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.317979
[56]	valid_0's auc: 0.928103	valid_0's binary_logloss: 0.290298	valid_1's auc: 0.907421	valid_1's binary_logloss: 0.317903
[57]	valid_0's auc: 0.928408	valid_0's binary_logloss: 0.289733	valid_1's auc: 0.907381	valid_1's binary_logloss: 0.317986
[58]	valid_0's auc: 0.928677	valid_0's binary_logloss: 0.289255	valid_1's auc: 0.907292	valid_1's binary_logloss: 0.318151
[59]	valid_0's auc: 0.928959	valid_0's binary_logloss: 0.28874	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.318223
[60]	valid_0's auc: 0.929419	valid_0's binary_logloss: 0.287974	valid_1's auc: 0.907166	valid_1's binary_logloss: 0.318271
[61]	valid_0's auc: 0.929747	valid_0's binary_logloss: 0.287367	valid_1's auc: 0.907061	valid_1's binary_logloss: 0.318443
[62]	valid_0's auc: 0.930107	valid_0's binary_logloss: 0.286665	valid_1's auc: 0.907051	valid_1's binary_logloss: 0.318496
[63]	valid_0's auc: 0.930363	valid_0's binary_logloss: 0.286153	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318513
[64]	valid_0's auc: 0.930884	valid_0's binary_logloss: 0.285287	valid_1's auc: 0.906964	valid_1's binary_logloss: 0.318665
[65]	valid_0's auc: 0.931208	valid_0's binary_logloss: 0.28474	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.318666
[66]	valid_0's auc: 0.93161	valid_0's binary_logloss: 0.284063	valid_1's auc: 0.90683	valid_1's binary_logloss: 0.318818
[67]	valid_0's auc: 0.932005	valid_0's binary_logloss: 0.283433	valid_1's auc: 0.906719	valid_1's binary_logloss: 0.319017
[68]	valid_0's auc: 0.932234	valid_0's binary_logloss: 0.282989	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.31896
[69]	valid_0's auc: 0.932532	valid_0's binary_logloss: 0.282459	valid_1's auc: 0.906718	valid_1's binary_logloss: 0.319051
[70]	valid_0's auc: 0.932851	valid_0's binary_logloss: 0.281905	valid_1's auc: 0.906592	valid_1's binary_logloss: 0.319261
[71]	valid_0's auc: 0.933203	valid_0's binary_logloss: 0.281336	valid_1's auc: 0.906564	valid_1's binary_logloss: 0.319306
[72]	valid_0's auc: 0.933431	valid_0's binary_logloss: 0.280894	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.31932
[73]	valid_0's auc: 0.933727	valid_0's binary_logloss: 0.280387	valid_1's auc: 0.906539	valid_1's binary_logloss: 0.319411
[74]	valid_0's auc: 0.934042	valid_0's binary_logloss: 0.279796	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.31948
[75]	valid_0's auc: 0.934394	valid_0's binary_logloss: 0.27917	valid_1's auc: 0.906495	valid_1's binary_logloss: 0.319511
[76]	valid_0's auc: 0.934695	valid_0's binary_logloss: 0.278645	valid_1's auc: 0.906547	valid_1's binary_logloss: 0.319479
[77]	valid_0's auc: 0.934944	valid_0's binary_logloss: 0.278168	valid_1's auc: 0.906468	valid_1's binary_logloss: 0.319624
[78]	valid_0's auc: 0.935173	valid_0's binary_logloss: 0.277762	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.319689
[79]	valid_0's auc: 0.93554	valid_0's binary_logloss: 0.277139	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.31983
[80]	valid_0's auc: 0.935807	valid_0's binary_logloss: 0.276634	valid_1's auc: 0.906268	valid_1's binary_logloss: 0.320015
[81]	valid_0's auc: 0.936023	valid_0's binary_logloss: 0.276149	valid_1's auc: 0.90618	valid_1's binary_logloss: 0.320191
[82]	valid_0's auc: 0.936238	valid_0's binary_logloss: 0.275725	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.320173
[83]	valid_0's auc: 0.936413	valid_0's binary_logloss: 0.275363	valid_1's auc: 0.906154	valid_1's binary_logloss: 0.320239
[84]	valid_0's auc: 0.936647	valid_0's binary_logloss: 0.274935	valid_1's auc: 0.906111	valid_1's binary_logloss: 0.320317
[85]	valid_0's auc: 0.936899	valid_0's binary_logloss: 0.274474	valid_1's auc: 0.906003	valid_1's binary_logloss: 0.320526
[86]	valid_0's auc: 0.937216	valid_0's binary_logloss: 0.273966	valid_1's auc: 0.905982	valid_1's binary_logloss: 0.320597
[87]	valid_0's auc: 0.937491	valid_0's binary_logloss: 0.273486	valid_1's auc: 0.905997	valid_1's binary_logloss: 0.320563
[88]	valid_0's auc: 0.937709	valid_0's binary_logloss: 0.273036	valid_1's auc: 0.905951	valid_1's binary_logloss: 0.320615
[89]	valid_0's auc: 0.937895	valid_0's binary_logloss: 0.272677	valid_1's auc: 0.905905	valid_1's binary_logloss: 0.320696
[90]	valid_0's auc: 0.938111	valid_0's binary_logloss: 0.272272	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.320848
[91]	valid_0's auc: 0.93837	valid_0's binary_logloss: 0.271827	valid_1's auc: 0.905725	valid_1's binary_logloss: 0.321086
[92]	valid_0's auc: 0.93861	valid_0's binary_logloss: 0.271409	valid_1's auc: 0.905726	valid_1's binary_logloss: 0.321074
[93]	valid_0's auc: 0.938874	valid_0's binary_logloss: 0.270956	valid_1's auc: 0.905792	valid_1's binary_logloss: 0.32098
[94]	valid_0's auc: 0.939119	valid_0's binary_logloss: 0.270462	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.321035
[95]	valid_0's auc: 0.93943	valid_0's binary_logloss: 0.269887	valid_1's auc: 0.905779	valid_1's binary_logloss: 0.321089
[96]	valid_0's auc: 0.939637	valid_0's binary_logloss: 0.269504	valid_1's auc: 0.905731	valid_1's binary_logloss: 0.3212
[97]	valid_0's auc: 0.939819	valid_0's binary_logloss: 0.269107	valid_1's auc: 0.905578	valid_1's binary_logloss: 0.321459
[98]	valid_0's auc: 0.940151	valid_0's binary_logloss: 0.268548	valid_1's auc: 0.905365	valid_1's binary_logloss: 0.321814
[99]	valid_0's auc: 0.940369	valid_0's binary_logloss: 0.26817	valid_1's auc: 0.905271	valid_1's binary_logloss: 0.322006
[100]	valid_0's auc: 0.940622	valid_0's binary_logloss: 0.267724	valid_1's auc: 0.905313	valid_1's binary_logloss: 0.321967
[101]	valid_0's auc: 0.940873	valid_0's binary_logloss: 0.267265	valid_1's auc: 0.905192	valid_1's binary_logloss: 0.322163
[102]	valid_0's auc: 0.941073	valid_0's binary_logloss: 0.266896	valid_1's auc: 0.905099	valid_1's binary_logloss: 0.32232
[103]	valid_0's auc: 0.941367	valid_0's binary_logloss: 0.266401	valid_1's auc: 0.904994	valid_1's binary_logloss: 0.322516
[104]	valid_0's auc: 0.941577	valid_0's binary_logloss: 0.265981	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.322435
[105]	valid_0's auc: 0.941797	valid_0's binary_logloss: 0.265561	valid_1's auc: 0.904876	valid_1's binary_logloss: 0.322698
[106]	valid_0's auc: 0.942068	valid_0's binary_logloss: 0.26511	valid_1's auc: 0.90486	valid_1's binary_logloss: 0.32275
[107]	valid_0's auc: 0.942208	valid_0's binary_logloss: 0.264839	valid_1's auc: 0.904748	valid_1's binary_logloss: 0.322953
[108]	valid_0's auc: 0.942494	valid_0's binary_logloss: 0.264328	valid_1's auc: 0.904639	valid_1's binary_logloss: 0.323115
[109]	valid_0's auc: 0.942693	valid_0's binary_logloss: 0.263899	valid_1's auc: 0.904549	valid_1's binary_logloss: 0.323284
[110]	valid_0's auc: 0.942909	valid_0's binary_logloss: 0.263468	valid_1's auc: 0.904541	valid_1's binary_logloss: 0.323317
[111]	valid_0's auc: 0.943273	valid_0's binary_logloss: 0.262819	valid_1's auc: 0.904461	valid_1's binary_logloss: 0.323456
[112]	valid_0's auc: 0.943554	valid_0's binary_logloss: 0.2623	valid_1's auc: 0.904389	valid_1's binary_logloss: 0.323616
[113]	valid_0's auc: 0.943732	valid_0's binary_logloss: 0.261984	valid_1's auc: 0.90433	valid_1's binary_logloss: 0.323727
[114]	valid_0's auc: 0.943941	valid_0's binary_logloss: 0.261612	valid_1's auc: 0.904261	valid_1's binary_logloss: 0.323904
[115]	valid_0's auc: 0.944269	valid_0's binary_logloss: 0.261049	valid_1's auc: 0.904154	valid_1's binary_logloss: 0.324049
[116]	valid_0's auc: 0.944444	valid_0's binary_logloss: 0.260706	valid_1's auc: 0.904131	valid_1's binary_logloss: 0.324053
[117]	valid_0's auc: 0.944621	valid_0's binary_logloss: 0.260389	valid_1's auc: 0.904019	valid_1's binary_logloss: 0.32424
[118]	valid_0's auc: 0.944826	valid_0's binary_logloss: 0.260018	valid_1's auc: 0.904016	valid_1's binary_logloss: 0.324247
[119]	valid_0's auc: 0.944978	valid_0's binary_logloss: 0.259724	valid_1's auc: 0.9039	valid_1's binary_logloss: 0.324443
[120]	valid_0's auc: 0.945168	valid_0's binary_logloss: 0.25931	valid_1's auc: 0.903939	valid_1's binary_logloss: 0.324359
[121]	valid_0's auc: 0.945453	valid_0's binary_logloss: 0.258777	valid_1's auc: 0.90389	valid_1's binary_logloss: 0.324491
[122]	valid_0's auc: 0.945625	valid_0's binary_logloss: 0.258411	valid_1's auc: 0.903877	valid_1's binary_logloss: 0.324549
[123]	valid_0's auc: 0.945753	valid_0's binary_logloss: 0.258163	valid_1's auc: 0.903828	valid_1's binary_logloss: 0.324668
[124]	valid_0's auc: 0.945907	valid_0's binary_logloss: 0.257827	valid_1's auc: 0.903669	valid_1's binary_logloss: 0.324984
[125]	valid_0's auc: 0.94607	valid_0's binary_logloss: 0.257504	valid_1's auc: 0.903676	valid_1's binary_logloss: 0.32499
[126]	valid_0's auc: 0.946247	valid_0's binary_logloss: 0.257108	valid_1's auc: 0.903828	valid_1's binary_logloss: 0.324773
[127]	valid_0's auc: 0.946499	valid_0's binary_logloss: 0.256599	valid_1's auc: 0.903795	valid_1's binary_logloss: 0.324875
[128]	valid_0's auc: 0.946763	valid_0's binary_logloss: 0.256131	valid_1's auc: 0.903687	valid_1's binary_logloss: 0.325075
[129]	valid_0's auc: 0.946949	valid_0's binary_logloss: 0.255779	valid_1's auc: 0.903525	valid_1's binary_logloss: 0.325361
[130]	valid_0's auc: 0.947079	valid_0's binary_logloss: 0.255495	valid_1's auc: 0.903493	valid_1's binary_logloss: 0.325464
[131]	valid_0's auc: 0.947194	valid_0's binary_logloss: 0.255262	valid_1's auc: 0.903417	valid_1's binary_logloss: 0.325622
[132]	valid_0's auc: 0.947382	valid_0's binary_logloss: 0.254878	valid_1's auc: 0.903373	valid_1's binary_logloss: 0.325732
[133]	valid_0's auc: 0.947514	valid_0's binary_logloss: 0.254627	valid_1's auc: 0.903179	valid_1's binary_logloss: 0.326044
[134]	valid_0's auc: 0.94766	valid_0's binary_logloss: 0.254319	valid_1's auc: 0.903139	valid_1's binary_logloss: 0.326086
[135]	valid_0's auc: 0.947883	valid_0's binary_logloss: 0.253913	valid_1's auc: 0.903003	valid_1's binary_logloss: 0.326332
[136]	valid_0's auc: 0.948009	valid_0's binary_logloss: 0.253649	valid_1's auc: 0.902964	valid_1's binary_logloss: 0.326447
[137]	valid_0's auc: 0.948243	valid_0's binary_logloss: 0.253216	valid_1's auc: 0.902963	valid_1's binary_logloss: 0.326507
[138]	valid_0's auc: 0.948381	valid_0's binary_logloss: 0.252937	valid_1's auc: 0.903034	valid_1's binary_logloss: 0.326404
[139]	valid_0's auc: 0.948549	valid_0's binary_logloss: 0.252612	valid_1's auc: 0.902994	valid_1's binary_logloss: 0.326515
[140]	valid_0's auc: 0.948818	valid_0's binary_logloss: 0.252142	valid_1's auc: 0.902975	valid_1's binary_logloss: 0.32662
[141]	valid_0's auc: 0.94901	valid_0's binary_logloss: 0.251734	valid_1's auc: 0.90284	valid_1's binary_logloss: 0.326897
[142]	valid_0's auc: 0.949147	valid_0's binary_logloss: 0.251425	valid_1's auc: 0.902947	valid_1's binary_logloss: 0.326821
[143]	valid_0's auc: 0.949269	valid_0's binary_logloss: 0.251161	valid_1's auc: 0.902898	valid_1's binary_logloss: 0.326949
Early stopping, best iteration is:
[43]	valid_0's auc: 0.923272	valid_0's binary_logloss: 0.299597	valid_1's auc: 0.907829	valid_1's binary_logloss: 0.318247
[1]	valid_0's auc: 0.889368	valid_0's binary_logloss: 0.516586	valid_1's auc: 0.894755	valid_1's binary_logloss: 0.507927
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892369	valid_0's binary_logloss: 0.487665	valid_1's auc: 0.897729	valid_1's binary_logloss: 0.478425
[3]	valid_0's auc: 0.892766	valid_0's binary_logloss: 0.46459	valid_1's auc: 0.8987	valid_1's binary_logloss: 0.454891
[4]	valid_0's auc: 0.894658	valid_0's binary_logloss: 0.445432	valid_1's auc: 0.899309	valid_1's binary_logloss: 0.435927
[5]	valid_0's auc: 0.897216	valid_0's binary_logloss: 0.429343	valid_1's auc: 0.901673	valid_1's binary_logloss: 0.420055
[6]	valid_0's auc: 0.898836	valid_0's binary_logloss: 0.415681	valid_1's auc: 0.902175	valid_1's binary_logloss: 0.40664
[7]	valid_0's auc: 0.900089	valid_0's binary_logloss: 0.403962	valid_1's auc: 0.903133	valid_1's binary_logloss: 0.394925
[8]	valid_0's auc: 0.900532	valid_0's binary_logloss: 0.393959	valid_1's auc: 0.903189	valid_1's binary_logloss: 0.38526
[9]	valid_0's auc: 0.90162	valid_0's binary_logloss: 0.385233	valid_1's auc: 0.903527	valid_1's binary_logloss: 0.376973
[10]	valid_0's auc: 0.902597	valid_0's binary_logloss: 0.377488	valid_1's auc: 0.904084	valid_1's binary_logloss: 0.369513
[11]	valid_0's auc: 0.903448	valid_0's binary_logloss: 0.370593	valid_1's auc: 0.904405	valid_1's binary_logloss: 0.363339
[12]	valid_0's auc: 0.904159	valid_0's binary_logloss: 0.364575	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.357511
[13]	valid_0's auc: 0.905188	valid_0's binary_logloss: 0.359049	valid_1's auc: 0.90489	valid_1's binary_logloss: 0.352976
[14]	valid_0's auc: 0.906232	valid_0's binary_logloss: 0.354214	valid_1's auc: 0.905694	valid_1's binary_logloss: 0.348766
[15]	valid_0's auc: 0.907064	valid_0's binary_logloss: 0.349752	valid_1's auc: 0.906	valid_1's binary_logloss: 0.345008
[16]	valid_0's auc: 0.907672	valid_0's binary_logloss: 0.345873	valid_1's auc: 0.906296	valid_1's binary_logloss: 0.341642
[17]	valid_0's auc: 0.908273	valid_0's binary_logloss: 0.342296	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.338802
[18]	valid_0's auc: 0.908878	valid_0's binary_logloss: 0.339094	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336013
[19]	valid_0's auc: 0.909576	valid_0's binary_logloss: 0.336175	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.333894
[20]	valid_0's auc: 0.910455	valid_0's binary_logloss: 0.333445	valid_1's auc: 0.906931	valid_1's binary_logloss: 0.332059
[21]	valid_0's auc: 0.911273	valid_0's binary_logloss: 0.330787	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.330109
[22]	valid_0's auc: 0.912074	valid_0's binary_logloss: 0.328439	valid_1's auc: 0.907317	valid_1's binary_logloss: 0.32877
[23]	valid_0's auc: 0.912686	valid_0's binary_logloss: 0.326339	valid_1's auc: 0.907226	valid_1's binary_logloss: 0.327636
[24]	valid_0's auc: 0.913571	valid_0's binary_logloss: 0.324128	valid_1's auc: 0.907432	valid_1's binary_logloss: 0.326242
[25]	valid_0's auc: 0.914116	valid_0's binary_logloss: 0.322264	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.32551
[26]	valid_0's auc: 0.914708	valid_0's binary_logloss: 0.320488	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.324633
[27]	valid_0's auc: 0.91518	valid_0's binary_logloss: 0.318816	valid_1's auc: 0.907321	valid_1's binary_logloss: 0.32384
[28]	valid_0's auc: 0.915702	valid_0's binary_logloss: 0.317272	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.323304
[29]	valid_0's auc: 0.916415	valid_0's binary_logloss: 0.315625	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.322952
[30]	valid_0's auc: 0.916801	valid_0's binary_logloss: 0.314325	valid_1's auc: 0.907132	valid_1's binary_logloss: 0.322293
[31]	valid_0's auc: 0.917206	valid_0's binary_logloss: 0.313086	valid_1's auc: 0.907189	valid_1's binary_logloss: 0.321811
[32]	valid_0's auc: 0.917656	valid_0's binary_logloss: 0.311898	valid_1's auc: 0.907343	valid_1's binary_logloss: 0.321211
[33]	valid_0's auc: 0.918178	valid_0's binary_logloss: 0.310518	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.32082
[34]	valid_0's auc: 0.918631	valid_0's binary_logloss: 0.309331	valid_1's auc: 0.907341	valid_1's binary_logloss: 0.320465
[35]	valid_0's auc: 0.919037	valid_0's binary_logloss: 0.308261	valid_1's auc: 0.907426	valid_1's binary_logloss: 0.319981
[36]	valid_0's auc: 0.919468	valid_0's binary_logloss: 0.307212	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.319661
[37]	valid_0's auc: 0.919844	valid_0's binary_logloss: 0.306237	valid_1's auc: 0.90738	valid_1's binary_logloss: 0.31961
[38]	valid_0's auc: 0.920349	valid_0's binary_logloss: 0.305123	valid_1's auc: 0.907299	valid_1's binary_logloss: 0.319397
[39]	valid_0's auc: 0.920788	valid_0's binary_logloss: 0.304184	valid_1's auc: 0.907283	valid_1's binary_logloss: 0.319256
[40]	valid_0's auc: 0.921133	valid_0's binary_logloss: 0.303349	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.319157
[41]	valid_0's auc: 0.92166	valid_0's binary_logloss: 0.302297	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.318916
[42]	valid_0's auc: 0.922152	valid_0's binary_logloss: 0.301268	valid_1's auc: 0.907401	valid_1's binary_logloss: 0.318656
[43]	valid_0's auc: 0.922665	valid_0's binary_logloss: 0.300317	valid_1's auc: 0.90753	valid_1's binary_logloss: 0.318355
[44]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.299625	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.318043
[45]	valid_0's auc: 0.923343	valid_0's binary_logloss: 0.298888	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.318157
[46]	valid_0's auc: 0.923757	valid_0's binary_logloss: 0.298114	valid_1's auc: 0.907425	valid_1's binary_logloss: 0.318073
[47]	valid_0's auc: 0.924211	valid_0's binary_logloss: 0.297279	valid_1's auc: 0.907393	valid_1's binary_logloss: 0.318047
[48]	valid_0's auc: 0.924601	valid_0's binary_logloss: 0.296483	valid_1's auc: 0.907399	valid_1's binary_logloss: 0.317973
[49]	valid_0's auc: 0.925153	valid_0's binary_logloss: 0.295574	valid_1's auc: 0.907352	valid_1's binary_logloss: 0.318005
[50]	valid_0's auc: 0.92558	valid_0's binary_logloss: 0.294749	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.318067
[51]	valid_0's auc: 0.925978	valid_0's binary_logloss: 0.294049	valid_1's auc: 0.907281	valid_1's binary_logloss: 0.318027
[52]	valid_0's auc: 0.926402	valid_0's binary_logloss: 0.293351	valid_1's auc: 0.907414	valid_1's binary_logloss: 0.317854
[53]	valid_0's auc: 0.926775	valid_0's binary_logloss: 0.292651	valid_1's auc: 0.907348	valid_1's binary_logloss: 0.317922
[54]	valid_0's auc: 0.927093	valid_0's binary_logloss: 0.292067	valid_1's auc: 0.907474	valid_1's binary_logloss: 0.317656
[55]	valid_0's auc: 0.927547	valid_0's binary_logloss: 0.291229	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.317629
[56]	valid_0's auc: 0.927892	valid_0's binary_logloss: 0.290597	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.317593
[57]	valid_0's auc: 0.928257	valid_0's binary_logloss: 0.289952	valid_1's auc: 0.907417	valid_1's binary_logloss: 0.317672
[58]	valid_0's auc: 0.928574	valid_0's binary_logloss: 0.289375	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.31761
[59]	valid_0's auc: 0.928998	valid_0's binary_logloss: 0.288588	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317717
[60]	valid_0's auc: 0.929325	valid_0's binary_logloss: 0.288029	valid_1's auc: 0.907459	valid_1's binary_logloss: 0.317616
[61]	valid_0's auc: 0.92968	valid_0's binary_logloss: 0.287356	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.317585
[62]	valid_0's auc: 0.930031	valid_0's binary_logloss: 0.286794	valid_1's auc: 0.907473	valid_1's binary_logloss: 0.317605
[63]	valid_0's auc: 0.930357	valid_0's binary_logloss: 0.286241	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317703
[64]	valid_0's auc: 0.930635	valid_0's binary_logloss: 0.285766	valid_1's auc: 0.907456	valid_1's binary_logloss: 0.317606
[65]	valid_0's auc: 0.93106	valid_0's binary_logloss: 0.285048	valid_1's auc: 0.907463	valid_1's binary_logloss: 0.317558
[66]	valid_0's auc: 0.931405	valid_0's binary_logloss: 0.284433	valid_1's auc: 0.907349	valid_1's binary_logloss: 0.31776
[67]	valid_0's auc: 0.931731	valid_0's binary_logloss: 0.283831	valid_1's auc: 0.90729	valid_1's binary_logloss: 0.317901
[68]	valid_0's auc: 0.932049	valid_0's binary_logloss: 0.283241	valid_1's auc: 0.907312	valid_1's binary_logloss: 0.317877
[69]	valid_0's auc: 0.932381	valid_0's binary_logloss: 0.282698	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.318154
[70]	valid_0's auc: 0.932691	valid_0's binary_logloss: 0.282134	valid_1's auc: 0.907224	valid_1's binary_logloss: 0.318021
[71]	valid_0's auc: 0.932943	valid_0's binary_logloss: 0.281649	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.318097
[72]	valid_0's auc: 0.933218	valid_0's binary_logloss: 0.281141	valid_1's auc: 0.907081	valid_1's binary_logloss: 0.318177
[73]	valid_0's auc: 0.933531	valid_0's binary_logloss: 0.280638	valid_1's auc: 0.907073	valid_1's binary_logloss: 0.318188
[74]	valid_0's auc: 0.933742	valid_0's binary_logloss: 0.280173	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318187
[75]	valid_0's auc: 0.934057	valid_0's binary_logloss: 0.279617	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318295
[76]	valid_0's auc: 0.934279	valid_0's binary_logloss: 0.279176	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.318397
[77]	valid_0's auc: 0.934596	valid_0's binary_logloss: 0.278654	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.31833
[78]	valid_0's auc: 0.93485	valid_0's binary_logloss: 0.278215	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.31847
[79]	valid_0's auc: 0.935126	valid_0's binary_logloss: 0.277719	valid_1's auc: 0.907014	valid_1's binary_logloss: 0.318454
[80]	valid_0's auc: 0.935419	valid_0's binary_logloss: 0.277261	valid_1's auc: 0.907022	valid_1's binary_logloss: 0.318455
[81]	valid_0's auc: 0.935742	valid_0's binary_logloss: 0.276751	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.318558
[82]	valid_0's auc: 0.935973	valid_0's binary_logloss: 0.276331	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.318398
[83]	valid_0's auc: 0.936358	valid_0's binary_logloss: 0.275673	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.3185
[84]	valid_0's auc: 0.936625	valid_0's binary_logloss: 0.275194	valid_1's auc: 0.907014	valid_1's binary_logloss: 0.318523
[85]	valid_0's auc: 0.936949	valid_0's binary_logloss: 0.274613	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.318477
[86]	valid_0's auc: 0.937172	valid_0's binary_logloss: 0.274222	valid_1's auc: 0.906924	valid_1's binary_logloss: 0.318724
[87]	valid_0's auc: 0.93734	valid_0's binary_logloss: 0.27388	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.318732
[88]	valid_0's auc: 0.93764	valid_0's binary_logloss: 0.273377	valid_1's auc: 0.906955	valid_1's binary_logloss: 0.318652
[89]	valid_0's auc: 0.937857	valid_0's binary_logloss: 0.272923	valid_1's auc: 0.90689	valid_1's binary_logloss: 0.318769
[90]	valid_0's auc: 0.938155	valid_0's binary_logloss: 0.272436	valid_1's auc: 0.906809	valid_1's binary_logloss: 0.318924
[91]	valid_0's auc: 0.938364	valid_0's binary_logloss: 0.272015	valid_1's auc: 0.906737	valid_1's binary_logloss: 0.31909
[92]	valid_0's auc: 0.938651	valid_0's binary_logloss: 0.271503	valid_1's auc: 0.906695	valid_1's binary_logloss: 0.319158
[93]	valid_0's auc: 0.938853	valid_0's binary_logloss: 0.271152	valid_1's auc: 0.906674	valid_1's binary_logloss: 0.319206
[94]	valid_0's auc: 0.939104	valid_0's binary_logloss: 0.270696	valid_1's auc: 0.906641	valid_1's binary_logloss: 0.319253
[95]	valid_0's auc: 0.939377	valid_0's binary_logloss: 0.270242	valid_1's auc: 0.906489	valid_1's binary_logloss: 0.319521
[96]	valid_0's auc: 0.939675	valid_0's binary_logloss: 0.269754	valid_1's auc: 0.906398	valid_1's binary_logloss: 0.319658
[97]	valid_0's auc: 0.939898	valid_0's binary_logloss: 0.26939	valid_1's auc: 0.906433	valid_1's binary_logloss: 0.319611
[98]	valid_0's auc: 0.940301	valid_0's binary_logloss: 0.268733	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.31952
[99]	valid_0's auc: 0.940487	valid_0's binary_logloss: 0.268323	valid_1's auc: 0.906351	valid_1's binary_logloss: 0.319709
[100]	valid_0's auc: 0.940684	valid_0's binary_logloss: 0.267966	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.319914
[101]	valid_0's auc: 0.940864	valid_0's binary_logloss: 0.267536	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.319888
[102]	valid_0's auc: 0.94102	valid_0's binary_logloss: 0.267175	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320074
[103]	valid_0's auc: 0.941195	valid_0's binary_logloss: 0.266812	valid_1's auc: 0.906306	valid_1's binary_logloss: 0.319989
[104]	valid_0's auc: 0.941338	valid_0's binary_logloss: 0.266494	valid_1's auc: 0.906282	valid_1's binary_logloss: 0.320094
[105]	valid_0's auc: 0.941478	valid_0's binary_logloss: 0.266194	valid_1's auc: 0.906191	valid_1's binary_logloss: 0.320248
[106]	valid_0's auc: 0.941737	valid_0's binary_logloss: 0.265719	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320327
[107]	valid_0's auc: 0.941926	valid_0's binary_logloss: 0.265387	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.320293
[108]	valid_0's auc: 0.942205	valid_0's binary_logloss: 0.264886	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320353
[109]	valid_0's auc: 0.94239	valid_0's binary_logloss: 0.264586	valid_1's auc: 0.90619	valid_1's binary_logloss: 0.320368
[110]	valid_0's auc: 0.942552	valid_0's binary_logloss: 0.264199	valid_1's auc: 0.906049	valid_1's binary_logloss: 0.320586
[111]	valid_0's auc: 0.942737	valid_0's binary_logloss: 0.263828	valid_1's auc: 0.906039	valid_1's binary_logloss: 0.320584
[112]	valid_0's auc: 0.943023	valid_0's binary_logloss: 0.263311	valid_1's auc: 0.90597	valid_1's binary_logloss: 0.320716
[113]	valid_0's auc: 0.943241	valid_0's binary_logloss: 0.262941	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.3208
[114]	valid_0's auc: 0.943462	valid_0's binary_logloss: 0.262526	valid_1's auc: 0.905888	valid_1's binary_logloss: 0.320928
[115]	valid_0's auc: 0.943755	valid_0's binary_logloss: 0.262022	valid_1's auc: 0.905861	valid_1's binary_logloss: 0.320989
[116]	valid_0's auc: 0.944045	valid_0's binary_logloss: 0.261487	valid_1's auc: 0.90579	valid_1's binary_logloss: 0.321123
[117]	valid_0's auc: 0.944248	valid_0's binary_logloss: 0.261086	valid_1's auc: 0.905841	valid_1's binary_logloss: 0.321138
[118]	valid_0's auc: 0.94446	valid_0's binary_logloss: 0.260664	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.321276
[119]	valid_0's auc: 0.944668	valid_0's binary_logloss: 0.260306	valid_1's auc: 0.905811	valid_1's binary_logloss: 0.32118
[120]	valid_0's auc: 0.944805	valid_0's binary_logloss: 0.260026	valid_1's auc: 0.905723	valid_1's binary_logloss: 0.321358
[121]	valid_0's auc: 0.945075	valid_0's binary_logloss: 0.259516	valid_1's auc: 0.905567	valid_1's binary_logloss: 0.32167
[122]	valid_0's auc: 0.945302	valid_0's binary_logloss: 0.259083	valid_1's auc: 0.905624	valid_1's binary_logloss: 0.321597
[123]	valid_0's auc: 0.945541	valid_0's binary_logloss: 0.258627	valid_1's auc: 0.905621	valid_1's binary_logloss: 0.321637
[124]	valid_0's auc: 0.945707	valid_0's binary_logloss: 0.258332	valid_1's auc: 0.905581	valid_1's binary_logloss: 0.321709
[125]	valid_0's auc: 0.94588	valid_0's binary_logloss: 0.25798	valid_1's auc: 0.905563	valid_1's binary_logloss: 0.321798
[126]	valid_0's auc: 0.946113	valid_0's binary_logloss: 0.257554	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.321939
[127]	valid_0's auc: 0.94628	valid_0's binary_logloss: 0.257213	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.321984
[128]	valid_0's auc: 0.94649	valid_0's binary_logloss: 0.256786	valid_1's auc: 0.905372	valid_1's binary_logloss: 0.322167
[129]	valid_0's auc: 0.946719	valid_0's binary_logloss: 0.256328	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322155
[130]	valid_0's auc: 0.946867	valid_0's binary_logloss: 0.25604	valid_1's auc: 0.905365	valid_1's binary_logloss: 0.322178
[131]	valid_0's auc: 0.94708	valid_0's binary_logloss: 0.255653	valid_1's auc: 0.905246	valid_1's binary_logloss: 0.322337
[132]	valid_0's auc: 0.947412	valid_0's binary_logloss: 0.255069	valid_1's auc: 0.90526	valid_1's binary_logloss: 0.322373
[133]	valid_0's auc: 0.947537	valid_0's binary_logloss: 0.25479	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.322414
[134]	valid_0's auc: 0.94771	valid_0's binary_logloss: 0.254426	valid_1's auc: 0.905241	valid_1's binary_logloss: 0.322468
[135]	valid_0's auc: 0.947872	valid_0's binary_logloss: 0.254109	valid_1's auc: 0.905226	valid_1's binary_logloss: 0.322507
[136]	valid_0's auc: 0.948043	valid_0's binary_logloss: 0.253782	valid_1's auc: 0.905114	valid_1's binary_logloss: 0.322691
[137]	valid_0's auc: 0.948265	valid_0's binary_logloss: 0.253378	valid_1's auc: 0.905057	valid_1's binary_logloss: 0.322831
[138]	valid_0's auc: 0.948417	valid_0's binary_logloss: 0.253083	valid_1's auc: 0.905034	valid_1's binary_logloss: 0.322968
[139]	valid_0's auc: 0.948591	valid_0's binary_logloss: 0.252767	valid_1's auc: 0.905094	valid_1's binary_logloss: 0.322893
[140]	valid_0's auc: 0.948675	valid_0's binary_logloss: 0.252549	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323132
[141]	valid_0's auc: 0.948869	valid_0's binary_logloss: 0.252154	valid_1's auc: 0.904892	valid_1's binary_logloss: 0.323301
[142]	valid_0's auc: 0.949082	valid_0's binary_logloss: 0.251727	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.323075
[143]	valid_0's auc: 0.949271	valid_0's binary_logloss: 0.251369	valid_1's auc: 0.904933	valid_1's binary_logloss: 0.323202
[144]	valid_0's auc: 0.949451	valid_0's binary_logloss: 0.250989	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.323288
Early stopping, best iteration is:
[44]	valid_0's auc: 0.923005	valid_0's binary_logloss: 0.299625	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.318043
[1]	valid_0's auc: 0.888568	valid_0's binary_logloss: 0.517232	valid_1's auc: 0.893169	valid_1's binary_logloss: 0.508727
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893525	valid_0's binary_logloss: 0.48805	valid_1's auc: 0.898612	valid_1's binary_logloss: 0.479079
[3]	valid_0's auc: 0.895098	valid_0's binary_logloss: 0.465044	valid_1's auc: 0.899666	valid_1's binary_logloss: 0.45542
[4]	valid_0's auc: 0.897204	valid_0's binary_logloss: 0.445626	valid_1's auc: 0.9009	valid_1's binary_logloss: 0.436065
[5]	valid_0's auc: 0.898082	valid_0's binary_logloss: 0.429582	valid_1's auc: 0.901179	valid_1's binary_logloss: 0.420084
[6]	valid_0's auc: 0.899115	valid_0's binary_logloss: 0.416064	valid_1's auc: 0.902064	valid_1's binary_logloss: 0.406467
[7]	valid_0's auc: 0.900214	valid_0's binary_logloss: 0.404266	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.394517
[8]	valid_0's auc: 0.901071	valid_0's binary_logloss: 0.394186	valid_1's auc: 0.904674	valid_1's binary_logloss: 0.384528
[9]	valid_0's auc: 0.902053	valid_0's binary_logloss: 0.3852	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.375991
[10]	valid_0's auc: 0.902655	valid_0's binary_logloss: 0.377691	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.368542
[11]	valid_0's auc: 0.903721	valid_0's binary_logloss: 0.370845	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.36216
[12]	valid_0's auc: 0.90431	valid_0's binary_logloss: 0.364817	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.356697
[13]	valid_0's auc: 0.904899	valid_0's binary_logloss: 0.359461	valid_1's auc: 0.906267	valid_1's binary_logloss: 0.351973
[14]	valid_0's auc: 0.905421	valid_0's binary_logloss: 0.354711	valid_1's auc: 0.906457	valid_1's binary_logloss: 0.347712
[15]	valid_0's auc: 0.906567	valid_0's binary_logloss: 0.350371	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.344046
[16]	valid_0's auc: 0.907287	valid_0's binary_logloss: 0.346495	valid_1's auc: 0.907202	valid_1's binary_logloss: 0.340683
[17]	valid_0's auc: 0.908034	valid_0's binary_logloss: 0.342933	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.337698
[18]	valid_0's auc: 0.908689	valid_0's binary_logloss: 0.339662	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.334943
[19]	valid_0's auc: 0.90925	valid_0's binary_logloss: 0.336764	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.332678
[20]	valid_0's auc: 0.909644	valid_0's binary_logloss: 0.334259	valid_1's auc: 0.908146	valid_1's binary_logloss: 0.330645
[21]	valid_0's auc: 0.910185	valid_0's binary_logloss: 0.33188	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.328924
[22]	valid_0's auc: 0.910775	valid_0's binary_logloss: 0.329584	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.327448
[23]	valid_0's auc: 0.9114	valid_0's binary_logloss: 0.327507	valid_1's auc: 0.908415	valid_1's binary_logloss: 0.325926
[24]	valid_0's auc: 0.911995	valid_0's binary_logloss: 0.325544	valid_1's auc: 0.908411	valid_1's binary_logloss: 0.32485
[25]	valid_0's auc: 0.912518	valid_0's binary_logloss: 0.323699	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.323409
[26]	valid_0's auc: 0.913113	valid_0's binary_logloss: 0.321982	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.322563
[27]	valid_0's auc: 0.913619	valid_0's binary_logloss: 0.320428	valid_1's auc: 0.908773	valid_1's binary_logloss: 0.321857
[28]	valid_0's auc: 0.913997	valid_0's binary_logloss: 0.319038	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.321103
[29]	valid_0's auc: 0.914534	valid_0's binary_logloss: 0.317595	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.320133
[30]	valid_0's auc: 0.915119	valid_0's binary_logloss: 0.316097	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.319557
[31]	valid_0's auc: 0.915576	valid_0's binary_logloss: 0.314812	valid_1's auc: 0.909168	valid_1's binary_logloss: 0.319006
[32]	valid_0's auc: 0.916098	valid_0's binary_logloss: 0.31357	valid_1's auc: 0.909261	valid_1's binary_logloss: 0.318543
[33]	valid_0's auc: 0.916546	valid_0's binary_logloss: 0.312427	valid_1's auc: 0.909244	valid_1's binary_logloss: 0.318171
[34]	valid_0's auc: 0.917016	valid_0's binary_logloss: 0.311269	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.317923
[35]	valid_0's auc: 0.917414	valid_0's binary_logloss: 0.310243	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.317536
[36]	valid_0's auc: 0.917827	valid_0's binary_logloss: 0.309274	valid_1's auc: 0.909295	valid_1's binary_logloss: 0.317185
[37]	valid_0's auc: 0.918329	valid_0's binary_logloss: 0.308247	valid_1's auc: 0.909286	valid_1's binary_logloss: 0.316991
[38]	valid_0's auc: 0.918748	valid_0's binary_logloss: 0.307341	valid_1's auc: 0.90927	valid_1's binary_logloss: 0.316831
[39]	valid_0's auc: 0.919198	valid_0's binary_logloss: 0.306329	valid_1's auc: 0.909351	valid_1's binary_logloss: 0.316452
[40]	valid_0's auc: 0.91958	valid_0's binary_logloss: 0.305446	valid_1's auc: 0.909369	valid_1's binary_logloss: 0.316231
[41]	valid_0's auc: 0.919912	valid_0's binary_logloss: 0.304679	valid_1's auc: 0.909497	valid_1's binary_logloss: 0.315908
[42]	valid_0's auc: 0.920318	valid_0's binary_logloss: 0.303907	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.31578
[43]	valid_0's auc: 0.92061	valid_0's binary_logloss: 0.303231	valid_1's auc: 0.909653	valid_1's binary_logloss: 0.315452
[44]	valid_0's auc: 0.92103	valid_0's binary_logloss: 0.302464	valid_1's auc: 0.909752	valid_1's binary_logloss: 0.315177
[45]	valid_0's auc: 0.921317	valid_0's binary_logloss: 0.301808	valid_1's auc: 0.909747	valid_1's binary_logloss: 0.315096
[46]	valid_0's auc: 0.921666	valid_0's binary_logloss: 0.301107	valid_1's auc: 0.909736	valid_1's binary_logloss: 0.314978
[47]	valid_0's auc: 0.922041	valid_0's binary_logloss: 0.300378	valid_1's auc: 0.909613	valid_1's binary_logloss: 0.315075
[48]	valid_0's auc: 0.9224	valid_0's binary_logloss: 0.299711	valid_1's auc: 0.909529	valid_1's binary_logloss: 0.315117
[49]	valid_0's auc: 0.922826	valid_0's binary_logloss: 0.298972	valid_1's auc: 0.909437	valid_1's binary_logloss: 0.315143
[50]	valid_0's auc: 0.923229	valid_0's binary_logloss: 0.298196	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.315011
[51]	valid_0's auc: 0.923617	valid_0's binary_logloss: 0.297476	valid_1's auc: 0.909499	valid_1's binary_logloss: 0.314934
[52]	valid_0's auc: 0.923948	valid_0's binary_logloss: 0.296887	valid_1's auc: 0.90951	valid_1's binary_logloss: 0.314856
[53]	valid_0's auc: 0.92432	valid_0's binary_logloss: 0.296196	valid_1's auc: 0.909459	valid_1's binary_logloss: 0.314878
[54]	valid_0's auc: 0.924589	valid_0's binary_logloss: 0.29561	valid_1's auc: 0.909494	valid_1's binary_logloss: 0.314761
[55]	valid_0's auc: 0.92498	valid_0's binary_logloss: 0.294905	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314482
[56]	valid_0's auc: 0.925413	valid_0's binary_logloss: 0.294165	valid_1's auc: 0.909742	valid_1's binary_logloss: 0.31429
[57]	valid_0's auc: 0.925772	valid_0's binary_logloss: 0.29356	valid_1's auc: 0.909684	valid_1's binary_logloss: 0.314415
[58]	valid_0's auc: 0.926033	valid_0's binary_logloss: 0.293004	valid_1's auc: 0.909787	valid_1's binary_logloss: 0.314239
[59]	valid_0's auc: 0.926356	valid_0's binary_logloss: 0.292504	valid_1's auc: 0.909759	valid_1's binary_logloss: 0.314304
[60]	valid_0's auc: 0.92672	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.90976	valid_1's binary_logloss: 0.314252
[61]	valid_0's auc: 0.927024	valid_0's binary_logloss: 0.291257	valid_1's auc: 0.909764	valid_1's binary_logloss: 0.314209
[62]	valid_0's auc: 0.927374	valid_0's binary_logloss: 0.290674	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314096
[63]	valid_0's auc: 0.927719	valid_0's binary_logloss: 0.29011	valid_1's auc: 0.909692	valid_1's binary_logloss: 0.314267
[64]	valid_0's auc: 0.928134	valid_0's binary_logloss: 0.289391	valid_1's auc: 0.909651	valid_1's binary_logloss: 0.314316
[65]	valid_0's auc: 0.928387	valid_0's binary_logloss: 0.288941	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314409
[66]	valid_0's auc: 0.928855	valid_0's binary_logloss: 0.288203	valid_1's auc: 0.909694	valid_1's binary_logloss: 0.314209
[67]	valid_0's auc: 0.929177	valid_0's binary_logloss: 0.287633	valid_1's auc: 0.909634	valid_1's binary_logloss: 0.314345
[68]	valid_0's auc: 0.929458	valid_0's binary_logloss: 0.287132	valid_1's auc: 0.909613	valid_1's binary_logloss: 0.314345
[69]	valid_0's auc: 0.929734	valid_0's binary_logloss: 0.286629	valid_1's auc: 0.909472	valid_1's binary_logloss: 0.314557
[70]	valid_0's auc: 0.930035	valid_0's binary_logloss: 0.286128	valid_1's auc: 0.909472	valid_1's binary_logloss: 0.314571
[71]	valid_0's auc: 0.930261	valid_0's binary_logloss: 0.285711	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.314665
[72]	valid_0's auc: 0.930598	valid_0's binary_logloss: 0.28514	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.314585
[73]	valid_0's auc: 0.930924	valid_0's binary_logloss: 0.284596	valid_1's auc: 0.909418	valid_1's binary_logloss: 0.314589
[74]	valid_0's auc: 0.931099	valid_0's binary_logloss: 0.284258	valid_1's auc: 0.909409	valid_1's binary_logloss: 0.314637
[75]	valid_0's auc: 0.931447	valid_0's binary_logloss: 0.283673	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.314718
[76]	valid_0's auc: 0.931733	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.314674
[77]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.282801	valid_1's auc: 0.909225	valid_1's binary_logloss: 0.314931
[78]	valid_0's auc: 0.93215	valid_0's binary_logloss: 0.282385	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.315013
[79]	valid_0's auc: 0.932424	valid_0's binary_logloss: 0.28189	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.31497
[80]	valid_0's auc: 0.932659	valid_0's binary_logloss: 0.281455	valid_1's auc: 0.909217	valid_1's binary_logloss: 0.315074
[81]	valid_0's auc: 0.93292	valid_0's binary_logloss: 0.280986	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.315219
[82]	valid_0's auc: 0.933095	valid_0's binary_logloss: 0.280661	valid_1's auc: 0.90905	valid_1's binary_logloss: 0.315353
[83]	valid_0's auc: 0.933396	valid_0's binary_logloss: 0.280163	valid_1's auc: 0.908891	valid_1's binary_logloss: 0.315579
[84]	valid_0's auc: 0.933595	valid_0's binary_logloss: 0.279824	valid_1's auc: 0.908786	valid_1's binary_logloss: 0.315742
[85]	valid_0's auc: 0.933815	valid_0's binary_logloss: 0.279441	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.315859
[86]	valid_0's auc: 0.93401	valid_0's binary_logloss: 0.279074	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.316046
[87]	valid_0's auc: 0.934219	valid_0's binary_logloss: 0.278643	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.316197
[88]	valid_0's auc: 0.934476	valid_0's binary_logloss: 0.278207	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.316141
[89]	valid_0's auc: 0.934741	valid_0's binary_logloss: 0.277744	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316193
[90]	valid_0's auc: 0.935147	valid_0's binary_logloss: 0.277056	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.316144
[91]	valid_0's auc: 0.93532	valid_0's binary_logloss: 0.276732	valid_1's auc: 0.908633	valid_1's binary_logloss: 0.316096
[92]	valid_0's auc: 0.935472	valid_0's binary_logloss: 0.276442	valid_1's auc: 0.908571	valid_1's binary_logloss: 0.31622
[93]	valid_0's auc: 0.935703	valid_0's binary_logloss: 0.276022	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.316176
[94]	valid_0's auc: 0.93594	valid_0's binary_logloss: 0.275588	valid_1's auc: 0.908562	valid_1's binary_logloss: 0.316197
[95]	valid_0's auc: 0.936291	valid_0's binary_logloss: 0.275015	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.316158
[96]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.274641	valid_1's auc: 0.908593	valid_1's binary_logloss: 0.316111
[97]	valid_0's auc: 0.936735	valid_0's binary_logloss: 0.274231	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316374
[98]	valid_0's auc: 0.937018	valid_0's binary_logloss: 0.273734	valid_1's auc: 0.908403	valid_1's binary_logloss: 0.316395
[99]	valid_0's auc: 0.937234	valid_0's binary_logloss: 0.273339	valid_1's auc: 0.908348	valid_1's binary_logloss: 0.316523
[100]	valid_0's auc: 0.937589	valid_0's binary_logloss: 0.272761	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.31687
[101]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.272478	valid_1's auc: 0.908152	valid_1's binary_logloss: 0.316849
[102]	valid_0's auc: 0.937967	valid_0's binary_logloss: 0.272019	valid_1's auc: 0.908072	valid_1's binary_logloss: 0.317009
[103]	valid_0's auc: 0.938226	valid_0's binary_logloss: 0.271531	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.317149
[104]	valid_0's auc: 0.938481	valid_0's binary_logloss: 0.271108	valid_1's auc: 0.908021	valid_1's binary_logloss: 0.317125
[105]	valid_0's auc: 0.938759	valid_0's binary_logloss: 0.270662	valid_1's auc: 0.907968	valid_1's binary_logloss: 0.317208
[106]	valid_0's auc: 0.938967	valid_0's binary_logloss: 0.270241	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.317231
[107]	valid_0's auc: 0.939212	valid_0's binary_logloss: 0.269802	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317365
[108]	valid_0's auc: 0.939397	valid_0's binary_logloss: 0.269484	valid_1's auc: 0.907834	valid_1's binary_logloss: 0.317532
[109]	valid_0's auc: 0.9396	valid_0's binary_logloss: 0.269073	valid_1's auc: 0.907841	valid_1's binary_logloss: 0.317581
[110]	valid_0's auc: 0.939778	valid_0's binary_logloss: 0.268762	valid_1's auc: 0.907878	valid_1's binary_logloss: 0.317536
[111]	valid_0's auc: 0.939984	valid_0's binary_logloss: 0.268414	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317602
[112]	valid_0's auc: 0.94015	valid_0's binary_logloss: 0.268103	valid_1's auc: 0.907843	valid_1's binary_logloss: 0.317569
[113]	valid_0's auc: 0.94025	valid_0's binary_logloss: 0.267875	valid_1's auc: 0.907812	valid_1's binary_logloss: 0.317617
[114]	valid_0's auc: 0.940448	valid_0's binary_logloss: 0.267519	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317699
[115]	valid_0's auc: 0.940667	valid_0's binary_logloss: 0.267146	valid_1's auc: 0.907742	valid_1's binary_logloss: 0.317757
[116]	valid_0's auc: 0.940862	valid_0's binary_logloss: 0.266732	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317809
[117]	valid_0's auc: 0.941066	valid_0's binary_logloss: 0.266376	valid_1's auc: 0.907717	valid_1's binary_logloss: 0.317848
[118]	valid_0's auc: 0.941307	valid_0's binary_logloss: 0.265899	valid_1's auc: 0.907584	valid_1's binary_logloss: 0.318144
[119]	valid_0's auc: 0.941453	valid_0's binary_logloss: 0.265615	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318193
[120]	valid_0's auc: 0.941664	valid_0's binary_logloss: 0.265241	valid_1's auc: 0.907532	valid_1's binary_logloss: 0.318277
[121]	valid_0's auc: 0.941958	valid_0's binary_logloss: 0.264722	valid_1's auc: 0.907497	valid_1's binary_logloss: 0.31833
[122]	valid_0's auc: 0.942096	valid_0's binary_logloss: 0.264434	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.318353
[123]	valid_0's auc: 0.942368	valid_0's binary_logloss: 0.263978	valid_1's auc: 0.907438	valid_1's binary_logloss: 0.318436
[124]	valid_0's auc: 0.942576	valid_0's binary_logloss: 0.263606	valid_1's auc: 0.907506	valid_1's binary_logloss: 0.318334
[125]	valid_0's auc: 0.942728	valid_0's binary_logloss: 0.263258	valid_1's auc: 0.907429	valid_1's binary_logloss: 0.318527
[126]	valid_0's auc: 0.9429	valid_0's binary_logloss: 0.262939	valid_1's auc: 0.907361	valid_1's binary_logloss: 0.318664
[127]	valid_0's auc: 0.943004	valid_0's binary_logloss: 0.262723	valid_1's auc: 0.907288	valid_1's binary_logloss: 0.318843
[128]	valid_0's auc: 0.943191	valid_0's binary_logloss: 0.262383	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318961
[129]	valid_0's auc: 0.943339	valid_0's binary_logloss: 0.262074	valid_1's auc: 0.90726	valid_1's binary_logloss: 0.31884
[130]	valid_0's auc: 0.943579	valid_0's binary_logloss: 0.261651	valid_1's auc: 0.907241	valid_1's binary_logloss: 0.318891
[131]	valid_0's auc: 0.94375	valid_0's binary_logloss: 0.261266	valid_1's auc: 0.907225	valid_1's binary_logloss: 0.318982
[132]	valid_0's auc: 0.94397	valid_0's binary_logloss: 0.260881	valid_1's auc: 0.90723	valid_1's binary_logloss: 0.319071
[133]	valid_0's auc: 0.94415	valid_0's binary_logloss: 0.260583	valid_1's auc: 0.907007	valid_1's binary_logloss: 0.319464
[134]	valid_0's auc: 0.944336	valid_0's binary_logloss: 0.260224	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.319719
[135]	valid_0's auc: 0.94446	valid_0's binary_logloss: 0.259977	valid_1's auc: 0.906866	valid_1's binary_logloss: 0.319777
[136]	valid_0's auc: 0.944654	valid_0's binary_logloss: 0.25962	valid_1's auc: 0.906806	valid_1's binary_logloss: 0.319899
[137]	valid_0's auc: 0.944877	valid_0's binary_logloss: 0.25924	valid_1's auc: 0.906818	valid_1's binary_logloss: 0.319949
[138]	valid_0's auc: 0.945048	valid_0's binary_logloss: 0.258906	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.320018
[139]	valid_0's auc: 0.9452	valid_0's binary_logloss: 0.258583	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.32005
[140]	valid_0's auc: 0.945366	valid_0's binary_logloss: 0.258267	valid_1's auc: 0.90677	valid_1's binary_logloss: 0.320172
[141]	valid_0's auc: 0.945508	valid_0's binary_logloss: 0.257961	valid_1's auc: 0.906802	valid_1's binary_logloss: 0.320151
[142]	valid_0's auc: 0.945686	valid_0's binary_logloss: 0.257651	valid_1's auc: 0.906763	valid_1's binary_logloss: 0.320275
[143]	valid_0's auc: 0.945799	valid_0's binary_logloss: 0.257429	valid_1's auc: 0.906746	valid_1's binary_logloss: 0.320358
[144]	valid_0's auc: 0.94594	valid_0's binary_logloss: 0.257166	valid_1's auc: 0.906641	valid_1's binary_logloss: 0.320548
[145]	valid_0's auc: 0.946078	valid_0's binary_logloss: 0.256857	valid_1's auc: 0.906631	valid_1's binary_logloss: 0.32067
[146]	valid_0's auc: 0.946292	valid_0's binary_logloss: 0.256458	valid_1's auc: 0.906477	valid_1's binary_logloss: 0.32092
[147]	valid_0's auc: 0.946424	valid_0's binary_logloss: 0.256211	valid_1's auc: 0.906497	valid_1's binary_logloss: 0.320915
[148]	valid_0's auc: 0.946571	valid_0's binary_logloss: 0.255905	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.321128
[149]	valid_0's auc: 0.946695	valid_0's binary_logloss: 0.25567	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.32128
[150]	valid_0's auc: 0.946798	valid_0's binary_logloss: 0.255436	valid_1's auc: 0.906332	valid_1's binary_logloss: 0.321317
[151]	valid_0's auc: 0.946973	valid_0's binary_logloss: 0.255081	valid_1's auc: 0.906214	valid_1's binary_logloss: 0.321524
[152]	valid_0's auc: 0.947105	valid_0's binary_logloss: 0.254834	valid_1's auc: 0.906174	valid_1's binary_logloss: 0.321609
[153]	valid_0's auc: 0.947244	valid_0's binary_logloss: 0.254577	valid_1's auc: 0.906171	valid_1's binary_logloss: 0.321658
[154]	valid_0's auc: 0.94741	valid_0's binary_logloss: 0.254279	valid_1's auc: 0.906124	valid_1's binary_logloss: 0.321759
[155]	valid_0's auc: 0.947505	valid_0's binary_logloss: 0.254064	valid_1's auc: 0.906093	valid_1's binary_logloss: 0.321835
[156]	valid_0's auc: 0.947643	valid_0's binary_logloss: 0.253759	valid_1's auc: 0.905935	valid_1's binary_logloss: 0.322154
[157]	valid_0's auc: 0.947845	valid_0's binary_logloss: 0.253358	valid_1's auc: 0.905901	valid_1's binary_logloss: 0.322252
[158]	valid_0's auc: 0.947944	valid_0's binary_logloss: 0.253133	valid_1's auc: 0.905838	valid_1's binary_logloss: 0.322388
[159]	valid_0's auc: 0.948134	valid_0's binary_logloss: 0.252791	valid_1's auc: 0.905813	valid_1's binary_logloss: 0.322498
[160]	valid_0's auc: 0.948265	valid_0's binary_logloss: 0.252528	valid_1's auc: 0.90575	valid_1's binary_logloss: 0.322666
[161]	valid_0's auc: 0.948369	valid_0's binary_logloss: 0.252284	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.322672
[162]	valid_0's auc: 0.948479	valid_0's binary_logloss: 0.252079	valid_1's auc: 0.905747	valid_1's binary_logloss: 0.322745
Early stopping, best iteration is:
[62]	valid_0's auc: 0.927374	valid_0's binary_logloss: 0.290674	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314096
[1]	valid_0's auc: 0.883999	valid_0's binary_logloss: 0.517495	valid_1's auc: 0.891234	valid_1's binary_logloss: 0.508616
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891027	valid_0's binary_logloss: 0.488825	valid_1's auc: 0.896641	valid_1's binary_logloss: 0.479157
[3]	valid_0's auc: 0.894951	valid_0's binary_logloss: 0.465291	valid_1's auc: 0.899671	valid_1's binary_logloss: 0.455294
[4]	valid_0's auc: 0.89606	valid_0's binary_logloss: 0.4462	valid_1's auc: 0.900601	valid_1's binary_logloss: 0.435941
[5]	valid_0's auc: 0.897345	valid_0's binary_logloss: 0.43003	valid_1's auc: 0.900711	valid_1's binary_logloss: 0.419873
[6]	valid_0's auc: 0.898499	valid_0's binary_logloss: 0.41635	valid_1's auc: 0.901767	valid_1's binary_logloss: 0.406108
[7]	valid_0's auc: 0.89983	valid_0's binary_logloss: 0.404494	valid_1's auc: 0.903447	valid_1's binary_logloss: 0.394511
[8]	valid_0's auc: 0.900425	valid_0's binary_logloss: 0.394452	valid_1's auc: 0.903731	valid_1's binary_logloss: 0.38466
[9]	valid_0's auc: 0.901201	valid_0's binary_logloss: 0.385617	valid_1's auc: 0.903911	valid_1's binary_logloss: 0.376198
[10]	valid_0's auc: 0.901776	valid_0's binary_logloss: 0.378074	valid_1's auc: 0.904371	valid_1's binary_logloss: 0.368708
[11]	valid_0's auc: 0.902544	valid_0's binary_logloss: 0.37121	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.362032
[12]	valid_0's auc: 0.90366	valid_0's binary_logloss: 0.364887	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.356476
[13]	valid_0's auc: 0.904305	valid_0's binary_logloss: 0.359711	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.351728
[14]	valid_0's auc: 0.905262	valid_0's binary_logloss: 0.354826	valid_1's auc: 0.906348	valid_1's binary_logloss: 0.347409
[15]	valid_0's auc: 0.90587	valid_0's binary_logloss: 0.350644	valid_1's auc: 0.906499	valid_1's binary_logloss: 0.343687
[16]	valid_0's auc: 0.90626	valid_0's binary_logloss: 0.347097	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.34054
[17]	valid_0's auc: 0.906844	valid_0's binary_logloss: 0.343671	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.337526
[18]	valid_0's auc: 0.9076	valid_0's binary_logloss: 0.340386	valid_1's auc: 0.907114	valid_1's binary_logloss: 0.334877
[19]	valid_0's auc: 0.908461	valid_0's binary_logloss: 0.337529	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.332773
[20]	valid_0's auc: 0.909101	valid_0's binary_logloss: 0.334827	valid_1's auc: 0.908205	valid_1's binary_logloss: 0.33029
[21]	valid_0's auc: 0.909823	valid_0's binary_logloss: 0.33228	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.328521
[22]	valid_0's auc: 0.910415	valid_0's binary_logloss: 0.330045	valid_1's auc: 0.908359	valid_1's binary_logloss: 0.326994
[23]	valid_0's auc: 0.911018	valid_0's binary_logloss: 0.327874	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.325227
[24]	valid_0's auc: 0.911611	valid_0's binary_logloss: 0.325867	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.323868
[25]	valid_0's auc: 0.912178	valid_0's binary_logloss: 0.323949	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.322513
[26]	valid_0's auc: 0.912874	valid_0's binary_logloss: 0.322149	valid_1's auc: 0.909102	valid_1's binary_logloss: 0.321504
[27]	valid_0's auc: 0.913521	valid_0's binary_logloss: 0.320396	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.320248
[28]	valid_0's auc: 0.914034	valid_0's binary_logloss: 0.318902	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.319553
[29]	valid_0's auc: 0.91458	valid_0's binary_logloss: 0.317387	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.318551
[30]	valid_0's auc: 0.915144	valid_0's binary_logloss: 0.31595	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.318078
[31]	valid_0's auc: 0.915618	valid_0's binary_logloss: 0.314668	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.317556
[32]	valid_0's auc: 0.916234	valid_0's binary_logloss: 0.31331	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.317238
[33]	valid_0's auc: 0.916616	valid_0's binary_logloss: 0.312239	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.316716
[34]	valid_0's auc: 0.917182	valid_0's binary_logloss: 0.310978	valid_1's auc: 0.909633	valid_1's binary_logloss: 0.31641
[35]	valid_0's auc: 0.917599	valid_0's binary_logloss: 0.309913	valid_1's auc: 0.909573	valid_1's binary_logloss: 0.316209
[36]	valid_0's auc: 0.91806	valid_0's binary_logloss: 0.308908	valid_1's auc: 0.909355	valid_1's binary_logloss: 0.316188
[37]	valid_0's auc: 0.918485	valid_0's binary_logloss: 0.307974	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.315841
[38]	valid_0's auc: 0.918923	valid_0's binary_logloss: 0.307027	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.315497
[39]	valid_0's auc: 0.919254	valid_0's binary_logloss: 0.306203	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.31517
[40]	valid_0's auc: 0.919724	valid_0's binary_logloss: 0.305269	valid_1's auc: 0.909607	valid_1's binary_logloss: 0.31496
[41]	valid_0's auc: 0.920132	valid_0's binary_logloss: 0.304355	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.314901
[42]	valid_0's auc: 0.920468	valid_0's binary_logloss: 0.303619	valid_1's auc: 0.909536	valid_1's binary_logloss: 0.314833
[43]	valid_0's auc: 0.920768	valid_0's binary_logloss: 0.302947	valid_1's auc: 0.909577	valid_1's binary_logloss: 0.314618
[44]	valid_0's auc: 0.9211	valid_0's binary_logloss: 0.302216	valid_1's auc: 0.909551	valid_1's binary_logloss: 0.314493
[45]	valid_0's auc: 0.921442	valid_0's binary_logloss: 0.301494	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.314378
[46]	valid_0's auc: 0.921737	valid_0's binary_logloss: 0.300877	valid_1's auc: 0.909499	valid_1's binary_logloss: 0.314428
[47]	valid_0's auc: 0.922029	valid_0's binary_logloss: 0.300274	valid_1's auc: 0.90936	valid_1's binary_logloss: 0.314544
[48]	valid_0's auc: 0.922463	valid_0's binary_logloss: 0.299504	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314385
[49]	valid_0's auc: 0.922872	valid_0's binary_logloss: 0.298755	valid_1's auc: 0.909446	valid_1's binary_logloss: 0.314325
[50]	valid_0's auc: 0.923248	valid_0's binary_logloss: 0.298094	valid_1's auc: 0.909348	valid_1's binary_logloss: 0.314403
[51]	valid_0's auc: 0.923586	valid_0's binary_logloss: 0.297446	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.314606
[52]	valid_0's auc: 0.923987	valid_0's binary_logloss: 0.296759	valid_1's auc: 0.909141	valid_1's binary_logloss: 0.314704
[53]	valid_0's auc: 0.92426	valid_0's binary_logloss: 0.296197	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.314609
[54]	valid_0's auc: 0.924562	valid_0's binary_logloss: 0.295605	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.314465
[55]	valid_0's auc: 0.924869	valid_0's binary_logloss: 0.295	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314224
[56]	valid_0's auc: 0.925279	valid_0's binary_logloss: 0.294292	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.314067
[57]	valid_0's auc: 0.925561	valid_0's binary_logloss: 0.293757	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.31403
[58]	valid_0's auc: 0.92592	valid_0's binary_logloss: 0.293138	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.314024
[59]	valid_0's auc: 0.926256	valid_0's binary_logloss: 0.2925	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.313904
[60]	valid_0's auc: 0.926556	valid_0's binary_logloss: 0.29195	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314117
[61]	valid_0's auc: 0.926838	valid_0's binary_logloss: 0.291413	valid_1's auc: 0.9093	valid_1's binary_logloss: 0.314325
[62]	valid_0's auc: 0.927068	valid_0's binary_logloss: 0.290952	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314193
[63]	valid_0's auc: 0.927328	valid_0's binary_logloss: 0.290467	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.314056
[64]	valid_0's auc: 0.927659	valid_0's binary_logloss: 0.289899	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.314101
[65]	valid_0's auc: 0.927996	valid_0's binary_logloss: 0.289389	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.314191
[66]	valid_0's auc: 0.928271	valid_0's binary_logloss: 0.288891	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.31411
[67]	valid_0's auc: 0.928532	valid_0's binary_logloss: 0.288415	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.314048
[68]	valid_0's auc: 0.928911	valid_0's binary_logloss: 0.287732	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.313859
[69]	valid_0's auc: 0.929183	valid_0's binary_logloss: 0.287187	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.31389
[70]	valid_0's auc: 0.929476	valid_0's binary_logloss: 0.286642	valid_1's auc: 0.909594	valid_1's binary_logloss: 0.313744
[71]	valid_0's auc: 0.929733	valid_0's binary_logloss: 0.286216	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.313913
[72]	valid_0's auc: 0.929958	valid_0's binary_logloss: 0.285787	valid_1's auc: 0.909478	valid_1's binary_logloss: 0.31394
[73]	valid_0's auc: 0.930232	valid_0's binary_logloss: 0.285307	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.313891
[74]	valid_0's auc: 0.930479	valid_0's binary_logloss: 0.284855	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314013
[75]	valid_0's auc: 0.930786	valid_0's binary_logloss: 0.284295	valid_1's auc: 0.909488	valid_1's binary_logloss: 0.313936
[76]	valid_0's auc: 0.931028	valid_0's binary_logloss: 0.283918	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.31412
[77]	valid_0's auc: 0.931304	valid_0's binary_logloss: 0.283461	valid_1's auc: 0.909315	valid_1's binary_logloss: 0.314221
[78]	valid_0's auc: 0.931657	valid_0's binary_logloss: 0.282878	valid_1's auc: 0.909354	valid_1's binary_logloss: 0.314175
[79]	valid_0's auc: 0.931922	valid_0's binary_logloss: 0.282451	valid_1's auc: 0.909213	valid_1's binary_logloss: 0.314393
[80]	valid_0's auc: 0.932237	valid_0's binary_logloss: 0.281898	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.314307
[81]	valid_0's auc: 0.932473	valid_0's binary_logloss: 0.281482	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.31426
[82]	valid_0's auc: 0.932697	valid_0's binary_logloss: 0.281091	valid_1's auc: 0.909173	valid_1's binary_logloss: 0.314448
[83]	valid_0's auc: 0.932994	valid_0's binary_logloss: 0.280572	valid_1's auc: 0.909056	valid_1's binary_logloss: 0.314624
[84]	valid_0's auc: 0.933242	valid_0's binary_logloss: 0.280173	valid_1's auc: 0.908972	valid_1's binary_logloss: 0.314763
[85]	valid_0's auc: 0.933583	valid_0's binary_logloss: 0.279609	valid_1's auc: 0.908956	valid_1's binary_logloss: 0.31481
[86]	valid_0's auc: 0.933825	valid_0's binary_logloss: 0.279209	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.314884
[87]	valid_0's auc: 0.934027	valid_0's binary_logloss: 0.278833	valid_1's auc: 0.908942	valid_1's binary_logloss: 0.314877
[88]	valid_0's auc: 0.934291	valid_0's binary_logloss: 0.278403	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.314739
[89]	valid_0's auc: 0.93449	valid_0's binary_logloss: 0.278055	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.314726
[90]	valid_0's auc: 0.934723	valid_0's binary_logloss: 0.277683	valid_1's auc: 0.908973	valid_1's binary_logloss: 0.31491
[91]	valid_0's auc: 0.934916	valid_0's binary_logloss: 0.277339	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.315012
[92]	valid_0's auc: 0.935191	valid_0's binary_logloss: 0.276843	valid_1's auc: 0.908766	valid_1's binary_logloss: 0.315262
[93]	valid_0's auc: 0.935446	valid_0's binary_logloss: 0.276388	valid_1's auc: 0.908627	valid_1's binary_logloss: 0.315481
[94]	valid_0's auc: 0.935627	valid_0's binary_logloss: 0.27604	valid_1's auc: 0.908579	valid_1's binary_logloss: 0.315556
[95]	valid_0's auc: 0.935853	valid_0's binary_logloss: 0.275605	valid_1's auc: 0.908453	valid_1's binary_logloss: 0.315754
[96]	valid_0's auc: 0.936023	valid_0's binary_logloss: 0.275277	valid_1's auc: 0.908387	valid_1's binary_logloss: 0.315888
[97]	valid_0's auc: 0.936263	valid_0's binary_logloss: 0.274846	valid_1's auc: 0.90827	valid_1's binary_logloss: 0.316061
[98]	valid_0's auc: 0.936589	valid_0's binary_logloss: 0.274279	valid_1's auc: 0.908374	valid_1's binary_logloss: 0.315873
[99]	valid_0's auc: 0.936808	valid_0's binary_logloss: 0.27384	valid_1's auc: 0.908344	valid_1's binary_logloss: 0.315918
[100]	valid_0's auc: 0.937021	valid_0's binary_logloss: 0.273453	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.3161
[101]	valid_0's auc: 0.937236	valid_0's binary_logloss: 0.273064	valid_1's auc: 0.908234	valid_1's binary_logloss: 0.316164
[102]	valid_0's auc: 0.937404	valid_0's binary_logloss: 0.272751	valid_1's auc: 0.908176	valid_1's binary_logloss: 0.316287
[103]	valid_0's auc: 0.937575	valid_0's binary_logloss: 0.272407	valid_1's auc: 0.908033	valid_1's binary_logloss: 0.316594
[104]	valid_0's auc: 0.937762	valid_0's binary_logloss: 0.272079	valid_1's auc: 0.907979	valid_1's binary_logloss: 0.316706
[105]	valid_0's auc: 0.938052	valid_0's binary_logloss: 0.271611	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.316861
[106]	valid_0's auc: 0.938267	valid_0's binary_logloss: 0.27123	valid_1's auc: 0.90784	valid_1's binary_logloss: 0.316963
[107]	valid_0's auc: 0.938475	valid_0's binary_logloss: 0.270835	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.316896
[108]	valid_0's auc: 0.938695	valid_0's binary_logloss: 0.270455	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.316917
[109]	valid_0's auc: 0.938868	valid_0's binary_logloss: 0.270141	valid_1's auc: 0.907836	valid_1's binary_logloss: 0.31705
[110]	valid_0's auc: 0.939071	valid_0's binary_logloss: 0.269768	valid_1's auc: 0.907769	valid_1's binary_logloss: 0.317145
[111]	valid_0's auc: 0.939225	valid_0's binary_logloss: 0.269451	valid_1's auc: 0.907782	valid_1's binary_logloss: 0.317161
[112]	valid_0's auc: 0.939425	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.907655	valid_1's binary_logloss: 0.317314
[113]	valid_0's auc: 0.939668	valid_0's binary_logloss: 0.268643	valid_1's auc: 0.907652	valid_1's binary_logloss: 0.317315
[114]	valid_0's auc: 0.939934	valid_0's binary_logloss: 0.268188	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.31749
[115]	valid_0's auc: 0.940061	valid_0's binary_logloss: 0.267929	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317527
[116]	valid_0's auc: 0.94023	valid_0's binary_logloss: 0.267642	valid_1's auc: 0.907476	valid_1's binary_logloss: 0.317678
[117]	valid_0's auc: 0.940464	valid_0's binary_logloss: 0.267239	valid_1's auc: 0.907411	valid_1's binary_logloss: 0.317776
[118]	valid_0's auc: 0.940665	valid_0's binary_logloss: 0.266843	valid_1's auc: 0.907343	valid_1's binary_logloss: 0.317928
[119]	valid_0's auc: 0.940885	valid_0's binary_logloss: 0.266458	valid_1's auc: 0.907185	valid_1's binary_logloss: 0.318152
[120]	valid_0's auc: 0.941087	valid_0's binary_logloss: 0.266089	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318332
[121]	valid_0's auc: 0.941241	valid_0's binary_logloss: 0.265795	valid_1's auc: 0.907066	valid_1's binary_logloss: 0.318384
[122]	valid_0's auc: 0.941424	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.907017	valid_1's binary_logloss: 0.318467
[123]	valid_0's auc: 0.941646	valid_0's binary_logloss: 0.265083	valid_1's auc: 0.90695	valid_1's binary_logloss: 0.318594
[124]	valid_0's auc: 0.941814	valid_0's binary_logloss: 0.264777	valid_1's auc: 0.906879	valid_1's binary_logloss: 0.318756
[125]	valid_0's auc: 0.941942	valid_0's binary_logloss: 0.264522	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.318853
[126]	valid_0's auc: 0.942099	valid_0's binary_logloss: 0.264213	valid_1's auc: 0.906809	valid_1's binary_logloss: 0.318916
[127]	valid_0's auc: 0.942305	valid_0's binary_logloss: 0.263835	valid_1's auc: 0.906814	valid_1's binary_logloss: 0.318912
[128]	valid_0's auc: 0.942509	valid_0's binary_logloss: 0.263478	valid_1's auc: 0.906636	valid_1's binary_logloss: 0.319161
[129]	valid_0's auc: 0.942745	valid_0's binary_logloss: 0.26304	valid_1's auc: 0.906664	valid_1's binary_logloss: 0.319119
Early stopping, best iteration is:
[29]	valid_0's auc: 0.91458	valid_0's binary_logloss: 0.317387	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.318551
[1]	valid_0's auc: 0.88881	valid_0's binary_logloss: 0.516633	valid_1's auc: 0.897809	valid_1's binary_logloss: 0.50731
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8922	valid_0's binary_logloss: 0.487561	valid_1's auc: 0.899925	valid_1's binary_logloss: 0.477157
[3]	valid_0's auc: 0.892838	valid_0's binary_logloss: 0.464389	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.453152
[4]	valid_0's auc: 0.894608	valid_0's binary_logloss: 0.444961	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.434111
[5]	valid_0's auc: 0.895384	valid_0's binary_logloss: 0.428899	valid_1's auc: 0.901607	valid_1's binary_logloss: 0.41839
[6]	valid_0's auc: 0.895814	valid_0's binary_logloss: 0.415402	valid_1's auc: 0.901971	valid_1's binary_logloss: 0.404739
[7]	valid_0's auc: 0.897179	valid_0's binary_logloss: 0.403646	valid_1's auc: 0.902712	valid_1's binary_logloss: 0.393451
[8]	valid_0's auc: 0.90014	valid_0's binary_logloss: 0.393717	valid_1's auc: 0.904509	valid_1's binary_logloss: 0.383777
[9]	valid_0's auc: 0.901656	valid_0's binary_logloss: 0.384637	valid_1's auc: 0.905082	valid_1's binary_logloss: 0.375071
[10]	valid_0's auc: 0.902441	valid_0's binary_logloss: 0.376979	valid_1's auc: 0.905389	valid_1's binary_logloss: 0.36779
[11]	valid_0's auc: 0.903086	valid_0's binary_logloss: 0.37018	valid_1's auc: 0.905722	valid_1's binary_logloss: 0.361222
[12]	valid_0's auc: 0.903811	valid_0's binary_logloss: 0.364179	valid_1's auc: 0.905739	valid_1's binary_logloss: 0.355887
[13]	valid_0's auc: 0.904555	valid_0's binary_logloss: 0.359017	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.3513
[14]	valid_0's auc: 0.905441	valid_0's binary_logloss: 0.35414	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.347227
[15]	valid_0's auc: 0.906121	valid_0's binary_logloss: 0.349903	valid_1's auc: 0.90617	valid_1's binary_logloss: 0.343705
[16]	valid_0's auc: 0.906823	valid_0's binary_logloss: 0.346182	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.340575
[17]	valid_0's auc: 0.907614	valid_0's binary_logloss: 0.34265	valid_1's auc: 0.906788	valid_1's binary_logloss: 0.337415
[18]	valid_0's auc: 0.908426	valid_0's binary_logloss: 0.33935	valid_1's auc: 0.907223	valid_1's binary_logloss: 0.334649
[19]	valid_0's auc: 0.909009	valid_0's binary_logloss: 0.336509	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.332519
[20]	valid_0's auc: 0.909682	valid_0's binary_logloss: 0.333891	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.330522
[21]	valid_0's auc: 0.91025	valid_0's binary_logloss: 0.331419	valid_1's auc: 0.908052	valid_1's binary_logloss: 0.328532
[22]	valid_0's auc: 0.910958	valid_0's binary_logloss: 0.329117	valid_1's auc: 0.908118	valid_1's binary_logloss: 0.32705
[23]	valid_0's auc: 0.911613	valid_0's binary_logloss: 0.326873	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.325687
[24]	valid_0's auc: 0.91224	valid_0's binary_logloss: 0.324827	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.324184
[25]	valid_0's auc: 0.912772	valid_0's binary_logloss: 0.323042	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.322854
[26]	valid_0's auc: 0.913317	valid_0's binary_logloss: 0.321309	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.321876
[27]	valid_0's auc: 0.913764	valid_0's binary_logloss: 0.319778	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.321042
[28]	valid_0's auc: 0.914355	valid_0's binary_logloss: 0.318165	valid_1's auc: 0.909178	valid_1's binary_logloss: 0.32025
[29]	valid_0's auc: 0.914967	valid_0's binary_logloss: 0.31668	valid_1's auc: 0.909198	valid_1's binary_logloss: 0.319711
[30]	valid_0's auc: 0.915458	valid_0's binary_logloss: 0.315289	valid_1's auc: 0.909082	valid_1's binary_logloss: 0.319336
[31]	valid_0's auc: 0.915871	valid_0's binary_logloss: 0.314121	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.319009
[32]	valid_0's auc: 0.916316	valid_0's binary_logloss: 0.312853	valid_1's auc: 0.909285	valid_1's binary_logloss: 0.318051
[33]	valid_0's auc: 0.916767	valid_0's binary_logloss: 0.311725	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.317608
[34]	valid_0's auc: 0.917282	valid_0's binary_logloss: 0.310574	valid_1's auc: 0.90946	valid_1's binary_logloss: 0.317193
[35]	valid_0's auc: 0.917684	valid_0's binary_logloss: 0.309568	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.316867
[36]	valid_0's auc: 0.918036	valid_0's binary_logloss: 0.308643	valid_1's auc: 0.909626	valid_1's binary_logloss: 0.316435
[37]	valid_0's auc: 0.918488	valid_0's binary_logloss: 0.307682	valid_1's auc: 0.909497	valid_1's binary_logloss: 0.316373
[38]	valid_0's auc: 0.919017	valid_0's binary_logloss: 0.306611	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.316163
[39]	valid_0's auc: 0.919405	valid_0's binary_logloss: 0.305691	valid_1's auc: 0.909674	valid_1's binary_logloss: 0.315708
[40]	valid_0's auc: 0.919814	valid_0's binary_logloss: 0.30487	valid_1's auc: 0.909625	valid_1's binary_logloss: 0.315659
[41]	valid_0's auc: 0.920185	valid_0's binary_logloss: 0.304075	valid_1's auc: 0.909717	valid_1's binary_logloss: 0.315348
[42]	valid_0's auc: 0.92057	valid_0's binary_logloss: 0.303237	valid_1's auc: 0.909727	valid_1's binary_logloss: 0.315184
[43]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.302339	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.31495
[44]	valid_0's auc: 0.9214	valid_0's binary_logloss: 0.301613	valid_1's auc: 0.909712	valid_1's binary_logloss: 0.315002
[45]	valid_0's auc: 0.921786	valid_0's binary_logloss: 0.300824	valid_1's auc: 0.90972	valid_1's binary_logloss: 0.314874
[46]	valid_0's auc: 0.922118	valid_0's binary_logloss: 0.300144	valid_1's auc: 0.909706	valid_1's binary_logloss: 0.314801
[47]	valid_0's auc: 0.922511	valid_0's binary_logloss: 0.299368	valid_1's auc: 0.909677	valid_1's binary_logloss: 0.314736
[48]	valid_0's auc: 0.922848	valid_0's binary_logloss: 0.298732	valid_1's auc: 0.909645	valid_1's binary_logloss: 0.314741
[49]	valid_0's auc: 0.923199	valid_0's binary_logloss: 0.298057	valid_1's auc: 0.90953	valid_1's binary_logloss: 0.314827
[50]	valid_0's auc: 0.923638	valid_0's binary_logloss: 0.297224	valid_1's auc: 0.909597	valid_1's binary_logloss: 0.314729
[51]	valid_0's auc: 0.923936	valid_0's binary_logloss: 0.296631	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314696
[52]	valid_0's auc: 0.924277	valid_0's binary_logloss: 0.296005	valid_1's auc: 0.909579	valid_1's binary_logloss: 0.314709
[53]	valid_0's auc: 0.924534	valid_0's binary_logloss: 0.295488	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.3148
[54]	valid_0's auc: 0.924896	valid_0's binary_logloss: 0.29488	valid_1's auc: 0.909502	valid_1's binary_logloss: 0.314724
[55]	valid_0's auc: 0.925282	valid_0's binary_logloss: 0.294206	valid_1's auc: 0.909327	valid_1's binary_logloss: 0.314906
[56]	valid_0's auc: 0.925615	valid_0's binary_logloss: 0.293588	valid_1's auc: 0.909402	valid_1's binary_logloss: 0.314797
[57]	valid_0's auc: 0.925884	valid_0's binary_logloss: 0.293082	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314977
[58]	valid_0's auc: 0.926221	valid_0's binary_logloss: 0.292493	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.31501
[59]	valid_0's auc: 0.926498	valid_0's binary_logloss: 0.291955	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.315108
[60]	valid_0's auc: 0.926801	valid_0's binary_logloss: 0.2914	valid_1's auc: 0.909139	valid_1's binary_logloss: 0.315076
[61]	valid_0's auc: 0.927129	valid_0's binary_logloss: 0.290854	valid_1's auc: 0.90919	valid_1's binary_logloss: 0.315078
[62]	valid_0's auc: 0.927448	valid_0's binary_logloss: 0.290236	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.31503
[63]	valid_0's auc: 0.927722	valid_0's binary_logloss: 0.289723	valid_1's auc: 0.909197	valid_1's binary_logloss: 0.31504
[64]	valid_0's auc: 0.928061	valid_0's binary_logloss: 0.289121	valid_1's auc: 0.909369	valid_1's binary_logloss: 0.314817
[65]	valid_0's auc: 0.928336	valid_0's binary_logloss: 0.288633	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.315117
[66]	valid_0's auc: 0.928674	valid_0's binary_logloss: 0.28806	valid_1's auc: 0.909014	valid_1's binary_logloss: 0.315391
[67]	valid_0's auc: 0.928948	valid_0's binary_logloss: 0.287599	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.315494
[68]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.287166	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.315648
[69]	valid_0's auc: 0.929538	valid_0's binary_logloss: 0.286581	valid_1's auc: 0.908742	valid_1's binary_logloss: 0.315751
[70]	valid_0's auc: 0.929806	valid_0's binary_logloss: 0.286124	valid_1's auc: 0.908809	valid_1's binary_logloss: 0.315658
[71]	valid_0's auc: 0.930079	valid_0's binary_logloss: 0.285651	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.315707
[72]	valid_0's auc: 0.930367	valid_0's binary_logloss: 0.285162	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.315704
[73]	valid_0's auc: 0.930605	valid_0's binary_logloss: 0.284717	valid_1's auc: 0.908789	valid_1's binary_logloss: 0.315651
[74]	valid_0's auc: 0.93084	valid_0's binary_logloss: 0.284267	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.315831
[75]	valid_0's auc: 0.931049	valid_0's binary_logloss: 0.283852	valid_1's auc: 0.908599	valid_1's binary_logloss: 0.315982
[76]	valid_0's auc: 0.931391	valid_0's binary_logloss: 0.28329	valid_1's auc: 0.90852	valid_1's binary_logloss: 0.316132
[77]	valid_0's auc: 0.931717	valid_0's binary_logloss: 0.282759	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.316203
[78]	valid_0's auc: 0.931964	valid_0's binary_logloss: 0.282305	valid_1's auc: 0.908302	valid_1's binary_logloss: 0.316447
[79]	valid_0's auc: 0.932224	valid_0's binary_logloss: 0.281838	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316388
[80]	valid_0's auc: 0.932514	valid_0's binary_logloss: 0.281322	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316285
[81]	valid_0's auc: 0.93284	valid_0's binary_logloss: 0.280793	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.316509
[82]	valid_0's auc: 0.933068	valid_0's binary_logloss: 0.280385	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.316732
[83]	valid_0's auc: 0.933362	valid_0's binary_logloss: 0.279887	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.316946
[84]	valid_0's auc: 0.93357	valid_0's binary_logloss: 0.279488	valid_1's auc: 0.907954	valid_1's binary_logloss: 0.31692
[85]	valid_0's auc: 0.933829	valid_0's binary_logloss: 0.279028	valid_1's auc: 0.907928	valid_1's binary_logloss: 0.316991
[86]	valid_0's auc: 0.934137	valid_0's binary_logloss: 0.278524	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.317128
[87]	valid_0's auc: 0.934366	valid_0's binary_logloss: 0.278118	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.317074
[88]	valid_0's auc: 0.934575	valid_0's binary_logloss: 0.277737	valid_1's auc: 0.907939	valid_1's binary_logloss: 0.317018
[89]	valid_0's auc: 0.934773	valid_0's binary_logloss: 0.277396	valid_1's auc: 0.907789	valid_1's binary_logloss: 0.317257
[90]	valid_0's auc: 0.935028	valid_0's binary_logloss: 0.276944	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317253
[91]	valid_0's auc: 0.935288	valid_0's binary_logloss: 0.276502	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317586
[92]	valid_0's auc: 0.935411	valid_0's binary_logloss: 0.276224	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.317742
[93]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275785	valid_1's auc: 0.907584	valid_1's binary_logloss: 0.31774
[94]	valid_0's auc: 0.935938	valid_0's binary_logloss: 0.275321	valid_1's auc: 0.907536	valid_1's binary_logloss: 0.317805
[95]	valid_0's auc: 0.936159	valid_0's binary_logloss: 0.274923	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.317766
[96]	valid_0's auc: 0.936404	valid_0's binary_logloss: 0.274511	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.318049
[97]	valid_0's auc: 0.936703	valid_0's binary_logloss: 0.273998	valid_1's auc: 0.907371	valid_1's binary_logloss: 0.318079
[98]	valid_0's auc: 0.936922	valid_0's binary_logloss: 0.273559	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.318158
[99]	valid_0's auc: 0.93717	valid_0's binary_logloss: 0.273123	valid_1's auc: 0.907351	valid_1's binary_logloss: 0.318142
[100]	valid_0's auc: 0.937372	valid_0's binary_logloss: 0.272752	valid_1's auc: 0.907468	valid_1's binary_logloss: 0.31796
[101]	valid_0's auc: 0.937702	valid_0's binary_logloss: 0.272134	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318301
[102]	valid_0's auc: 0.938007	valid_0's binary_logloss: 0.271624	valid_1's auc: 0.907237	valid_1's binary_logloss: 0.318397
[103]	valid_0's auc: 0.9382	valid_0's binary_logloss: 0.271235	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.318405
[104]	valid_0's auc: 0.938422	valid_0's binary_logloss: 0.270813	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.318585
[105]	valid_0's auc: 0.93862	valid_0's binary_logloss: 0.270448	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.318748
[106]	valid_0's auc: 0.93882	valid_0's binary_logloss: 0.270102	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318759
[107]	valid_0's auc: 0.939099	valid_0's binary_logloss: 0.269599	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.318745
[108]	valid_0's auc: 0.93929	valid_0's binary_logloss: 0.269246	valid_1's auc: 0.907109	valid_1's binary_logloss: 0.318695
[109]	valid_0's auc: 0.939562	valid_0's binary_logloss: 0.268798	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.318929
[110]	valid_0's auc: 0.939737	valid_0's binary_logloss: 0.268484	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.318969
[111]	valid_0's auc: 0.939932	valid_0's binary_logloss: 0.268109	valid_1's auc: 0.906893	valid_1's binary_logloss: 0.319126
[112]	valid_0's auc: 0.940125	valid_0's binary_logloss: 0.267751	valid_1's auc: 0.906876	valid_1's binary_logloss: 0.319195
[113]	valid_0's auc: 0.940263	valid_0's binary_logloss: 0.267452	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319447
[114]	valid_0's auc: 0.940529	valid_0's binary_logloss: 0.266992	valid_1's auc: 0.906635	valid_1's binary_logloss: 0.319687
[115]	valid_0's auc: 0.940778	valid_0's binary_logloss: 0.266548	valid_1's auc: 0.906566	valid_1's binary_logloss: 0.319841
[116]	valid_0's auc: 0.940958	valid_0's binary_logloss: 0.266222	valid_1's auc: 0.906504	valid_1's binary_logloss: 0.319936
[117]	valid_0's auc: 0.941239	valid_0's binary_logloss: 0.265732	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.320015
[118]	valid_0's auc: 0.941438	valid_0's binary_logloss: 0.265351	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.319969
[119]	valid_0's auc: 0.941656	valid_0's binary_logloss: 0.264966	valid_1's auc: 0.906507	valid_1's binary_logloss: 0.320042
[120]	valid_0's auc: 0.941811	valid_0's binary_logloss: 0.264654	valid_1's auc: 0.906393	valid_1's binary_logloss: 0.32022
[121]	valid_0's auc: 0.941983	valid_0's binary_logloss: 0.264341	valid_1's auc: 0.906441	valid_1's binary_logloss: 0.320189
[122]	valid_0's auc: 0.942262	valid_0's binary_logloss: 0.263904	valid_1's auc: 0.906383	valid_1's binary_logloss: 0.320273
[123]	valid_0's auc: 0.94246	valid_0's binary_logloss: 0.263555	valid_1's auc: 0.906349	valid_1's binary_logloss: 0.320357
[124]	valid_0's auc: 0.942595	valid_0's binary_logloss: 0.263283	valid_1's auc: 0.906354	valid_1's binary_logloss: 0.320357
[125]	valid_0's auc: 0.942771	valid_0's binary_logloss: 0.262981	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.32045
[126]	valid_0's auc: 0.94292	valid_0's binary_logloss: 0.262704	valid_1's auc: 0.906219	valid_1's binary_logloss: 0.320591
[127]	valid_0's auc: 0.943078	valid_0's binary_logloss: 0.262411	valid_1's auc: 0.906271	valid_1's binary_logloss: 0.320521
[128]	valid_0's auc: 0.943241	valid_0's binary_logloss: 0.2621	valid_1's auc: 0.906213	valid_1's binary_logloss: 0.320628
[129]	valid_0's auc: 0.94337	valid_0's binary_logloss: 0.261843	valid_1's auc: 0.906182	valid_1's binary_logloss: 0.32075
[130]	valid_0's auc: 0.943527	valid_0's binary_logloss: 0.261537	valid_1's auc: 0.906135	valid_1's binary_logloss: 0.320819
[131]	valid_0's auc: 0.9438	valid_0's binary_logloss: 0.261085	valid_1's auc: 0.906121	valid_1's binary_logloss: 0.320864
[132]	valid_0's auc: 0.94401	valid_0's binary_logloss: 0.260673	valid_1's auc: 0.90607	valid_1's binary_logloss: 0.320997
[133]	valid_0's auc: 0.944163	valid_0's binary_logloss: 0.260385	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.321112
[134]	valid_0's auc: 0.944265	valid_0's binary_logloss: 0.260167	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.321239
[135]	valid_0's auc: 0.944549	valid_0's binary_logloss: 0.259695	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.321268
[136]	valid_0's auc: 0.944696	valid_0's binary_logloss: 0.259433	valid_1's auc: 0.905947	valid_1's binary_logloss: 0.321239
[137]	valid_0's auc: 0.944838	valid_0's binary_logloss: 0.259173	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.32125
[138]	valid_0's auc: 0.945025	valid_0's binary_logloss: 0.258826	valid_1's auc: 0.905968	valid_1's binary_logloss: 0.321236
[139]	valid_0's auc: 0.945201	valid_0's binary_logloss: 0.258505	valid_1's auc: 0.90594	valid_1's binary_logloss: 0.321337
[140]	valid_0's auc: 0.945331	valid_0's binary_logloss: 0.258233	valid_1's auc: 0.905804	valid_1's binary_logloss: 0.321582
[141]	valid_0's auc: 0.945428	valid_0's binary_logloss: 0.258017	valid_1's auc: 0.905814	valid_1's binary_logloss: 0.321651
[142]	valid_0's auc: 0.945565	valid_0's binary_logloss: 0.257733	valid_1's auc: 0.905769	valid_1's binary_logloss: 0.321746
[143]	valid_0's auc: 0.945741	valid_0's binary_logloss: 0.257369	valid_1's auc: 0.905745	valid_1's binary_logloss: 0.321757
Early stopping, best iteration is:
[43]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.302339	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.31495
[1]	valid_0's auc: 0.887249	valid_0's binary_logloss: 0.517046	valid_1's auc: 0.892969	valid_1's binary_logloss: 0.508431
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889524	valid_0's binary_logloss: 0.488088	valid_1's auc: 0.89592	valid_1's binary_logloss: 0.478873
[3]	valid_0's auc: 0.891571	valid_0's binary_logloss: 0.464744	valid_1's auc: 0.896177	valid_1's binary_logloss: 0.455472
[4]	valid_0's auc: 0.893868	valid_0's binary_logloss: 0.445249	valid_1's auc: 0.897585	valid_1's binary_logloss: 0.43623
[5]	valid_0's auc: 0.897186	valid_0's binary_logloss: 0.429114	valid_1's auc: 0.900745	valid_1's binary_logloss: 0.419804
[6]	valid_0's auc: 0.898078	valid_0's binary_logloss: 0.415466	valid_1's auc: 0.901242	valid_1's binary_logloss: 0.406401
[7]	valid_0's auc: 0.899398	valid_0's binary_logloss: 0.403794	valid_1's auc: 0.90246	valid_1's binary_logloss: 0.394732
[8]	valid_0's auc: 0.900616	valid_0's binary_logloss: 0.393732	valid_1's auc: 0.902926	valid_1's binary_logloss: 0.385104
[9]	valid_0's auc: 0.901282	valid_0's binary_logloss: 0.384962	valid_1's auc: 0.903761	valid_1's binary_logloss: 0.376423
[10]	valid_0's auc: 0.902116	valid_0's binary_logloss: 0.377268	valid_1's auc: 0.903857	valid_1's binary_logloss: 0.369348
[11]	valid_0's auc: 0.902911	valid_0's binary_logloss: 0.370559	valid_1's auc: 0.90371	valid_1's binary_logloss: 0.36337
[12]	valid_0's auc: 0.903892	valid_0's binary_logloss: 0.364523	valid_1's auc: 0.904465	valid_1's binary_logloss: 0.357744
[13]	valid_0's auc: 0.904864	valid_0's binary_logloss: 0.359224	valid_1's auc: 0.904853	valid_1's binary_logloss: 0.352978
[14]	valid_0's auc: 0.905535	valid_0's binary_logloss: 0.354517	valid_1's auc: 0.905195	valid_1's binary_logloss: 0.348745
[15]	valid_0's auc: 0.906247	valid_0's binary_logloss: 0.350292	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.345032
[16]	valid_0's auc: 0.906797	valid_0's binary_logloss: 0.346472	valid_1's auc: 0.905953	valid_1's binary_logloss: 0.341776
[17]	valid_0's auc: 0.907358	valid_0's binary_logloss: 0.343123	valid_1's auc: 0.906447	valid_1's binary_logloss: 0.338822
[18]	valid_0's auc: 0.908033	valid_0's binary_logloss: 0.339924	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336244
[19]	valid_0's auc: 0.9089	valid_0's binary_logloss: 0.336963	valid_1's auc: 0.906867	valid_1's binary_logloss: 0.334193
[20]	valid_0's auc: 0.909369	valid_0's binary_logloss: 0.334443	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.332105
[21]	valid_0's auc: 0.91003	valid_0's binary_logloss: 0.331985	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.330663
[22]	valid_0's auc: 0.910864	valid_0's binary_logloss: 0.329506	valid_1's auc: 0.907514	valid_1's binary_logloss: 0.328727
[23]	valid_0's auc: 0.91153	valid_0's binary_logloss: 0.327413	valid_1's auc: 0.907514	valid_1's binary_logloss: 0.327412
[24]	valid_0's auc: 0.912029	valid_0's binary_logloss: 0.325525	valid_1's auc: 0.907583	valid_1's binary_logloss: 0.326119
[25]	valid_0's auc: 0.912589	valid_0's binary_logloss: 0.323625	valid_1's auc: 0.907585	valid_1's binary_logloss: 0.324985
[26]	valid_0's auc: 0.913172	valid_0's binary_logloss: 0.321842	valid_1's auc: 0.907685	valid_1's binary_logloss: 0.323969
[27]	valid_0's auc: 0.913746	valid_0's binary_logloss: 0.320211	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.323003
[28]	valid_0's auc: 0.914191	valid_0's binary_logloss: 0.318789	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.321984
[29]	valid_0's auc: 0.914635	valid_0's binary_logloss: 0.317378	valid_1's auc: 0.908298	valid_1's binary_logloss: 0.321147
[30]	valid_0's auc: 0.915102	valid_0's binary_logloss: 0.316046	valid_1's auc: 0.908386	valid_1's binary_logloss: 0.320581
[31]	valid_0's auc: 0.915569	valid_0's binary_logloss: 0.314739	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.319825
[32]	valid_0's auc: 0.916028	valid_0's binary_logloss: 0.313492	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.319562
[33]	valid_0's auc: 0.916594	valid_0's binary_logloss: 0.312253	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.319131
[34]	valid_0's auc: 0.917079	valid_0's binary_logloss: 0.311062	valid_1's auc: 0.908472	valid_1's binary_logloss: 0.318884
[35]	valid_0's auc: 0.917491	valid_0's binary_logloss: 0.31004	valid_1's auc: 0.908461	valid_1's binary_logloss: 0.318572
[36]	valid_0's auc: 0.917947	valid_0's binary_logloss: 0.309001	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.31842
[37]	valid_0's auc: 0.918376	valid_0's binary_logloss: 0.308021	valid_1's auc: 0.908447	valid_1's binary_logloss: 0.318117
[38]	valid_0's auc: 0.918778	valid_0's binary_logloss: 0.307141	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.317916
[39]	valid_0's auc: 0.919223	valid_0's binary_logloss: 0.306216	valid_1's auc: 0.908337	valid_1's binary_logloss: 0.31792
[40]	valid_0's auc: 0.919764	valid_0's binary_logloss: 0.305128	valid_1's auc: 0.908408	valid_1's binary_logloss: 0.317682
[41]	valid_0's auc: 0.920187	valid_0's binary_logloss: 0.304281	valid_1's auc: 0.908306	valid_1's binary_logloss: 0.317646
[42]	valid_0's auc: 0.920619	valid_0's binary_logloss: 0.303442	valid_1's auc: 0.908257	valid_1's binary_logloss: 0.317622
[43]	valid_0's auc: 0.92102	valid_0's binary_logloss: 0.30262	valid_1's auc: 0.908354	valid_1's binary_logloss: 0.317389
[44]	valid_0's auc: 0.921413	valid_0's binary_logloss: 0.301836	valid_1's auc: 0.908264	valid_1's binary_logloss: 0.317424
[45]	valid_0's auc: 0.921785	valid_0's binary_logloss: 0.301061	valid_1's auc: 0.908129	valid_1's binary_logloss: 0.317502
[46]	valid_0's auc: 0.922198	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.907953	valid_1's binary_logloss: 0.317659
[47]	valid_0's auc: 0.922522	valid_0's binary_logloss: 0.29963	valid_1's auc: 0.907836	valid_1's binary_logloss: 0.317775
[48]	valid_0's auc: 0.922842	valid_0's binary_logloss: 0.298974	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317593
[49]	valid_0's auc: 0.923167	valid_0's binary_logloss: 0.298346	valid_1's auc: 0.907913	valid_1's binary_logloss: 0.317495
[50]	valid_0's auc: 0.923535	valid_0's binary_logloss: 0.297701	valid_1's auc: 0.907892	valid_1's binary_logloss: 0.317408
[51]	valid_0's auc: 0.923894	valid_0's binary_logloss: 0.296975	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.317438
[52]	valid_0's auc: 0.92424	valid_0's binary_logloss: 0.29636	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.317333
[53]	valid_0's auc: 0.924484	valid_0's binary_logloss: 0.295875	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317304
[54]	valid_0's auc: 0.924733	valid_0's binary_logloss: 0.29536	valid_1's auc: 0.907977	valid_1's binary_logloss: 0.3171
[55]	valid_0's auc: 0.925043	valid_0's binary_logloss: 0.294791	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317305
[56]	valid_0's auc: 0.925485	valid_0's binary_logloss: 0.294096	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.317587
[57]	valid_0's auc: 0.925858	valid_0's binary_logloss: 0.293445	valid_1's auc: 0.907598	valid_1's binary_logloss: 0.317677
[58]	valid_0's auc: 0.926244	valid_0's binary_logloss: 0.292757	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318083
[59]	valid_0's auc: 0.926466	valid_0's binary_logloss: 0.292343	valid_1's auc: 0.907328	valid_1's binary_logloss: 0.318147
[60]	valid_0's auc: 0.926805	valid_0's binary_logloss: 0.291707	valid_1's auc: 0.907261	valid_1's binary_logloss: 0.318239
[61]	valid_0's auc: 0.927157	valid_0's binary_logloss: 0.291072	valid_1's auc: 0.907276	valid_1's binary_logloss: 0.318247
[62]	valid_0's auc: 0.927457	valid_0's binary_logloss: 0.290536	valid_1's auc: 0.907204	valid_1's binary_logloss: 0.31833
[63]	valid_0's auc: 0.927778	valid_0's binary_logloss: 0.29	valid_1's auc: 0.907153	valid_1's binary_logloss: 0.318433
[64]	valid_0's auc: 0.928021	valid_0's binary_logloss: 0.289569	valid_1's auc: 0.907204	valid_1's binary_logloss: 0.318313
[65]	valid_0's auc: 0.928289	valid_0's binary_logloss: 0.28909	valid_1's auc: 0.907165	valid_1's binary_logloss: 0.318377
[66]	valid_0's auc: 0.928527	valid_0's binary_logloss: 0.288646	valid_1's auc: 0.907113	valid_1's binary_logloss: 0.318475
[67]	valid_0's auc: 0.928883	valid_0's binary_logloss: 0.288029	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.318526
[68]	valid_0's auc: 0.929201	valid_0's binary_logloss: 0.287495	valid_1's auc: 0.907197	valid_1's binary_logloss: 0.318388
[69]	valid_0's auc: 0.929378	valid_0's binary_logloss: 0.28713	valid_1's auc: 0.907093	valid_1's binary_logloss: 0.318533
[70]	valid_0's auc: 0.929657	valid_0's binary_logloss: 0.28662	valid_1's auc: 0.907128	valid_1's binary_logloss: 0.318459
[71]	valid_0's auc: 0.929939	valid_0's binary_logloss: 0.286099	valid_1's auc: 0.907052	valid_1's binary_logloss: 0.318615
[72]	valid_0's auc: 0.930105	valid_0's binary_logloss: 0.285756	valid_1's auc: 0.906992	valid_1's binary_logloss: 0.318671
[73]	valid_0's auc: 0.930351	valid_0's binary_logloss: 0.285297	valid_1's auc: 0.907029	valid_1's binary_logloss: 0.318652
[74]	valid_0's auc: 0.930753	valid_0's binary_logloss: 0.284593	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.318807
[75]	valid_0's auc: 0.931083	valid_0's binary_logloss: 0.283957	valid_1's auc: 0.906993	valid_1's binary_logloss: 0.318769
[76]	valid_0's auc: 0.93129	valid_0's binary_logloss: 0.283581	valid_1's auc: 0.907011	valid_1's binary_logloss: 0.318765
[77]	valid_0's auc: 0.931541	valid_0's binary_logloss: 0.283098	valid_1's auc: 0.906906	valid_1's binary_logloss: 0.318964
[78]	valid_0's auc: 0.93177	valid_0's binary_logloss: 0.282639	valid_1's auc: 0.906962	valid_1's binary_logloss: 0.318893
[79]	valid_0's auc: 0.931994	valid_0's binary_logloss: 0.282236	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.319021
[80]	valid_0's auc: 0.932235	valid_0's binary_logloss: 0.281793	valid_1's auc: 0.906833	valid_1's binary_logloss: 0.319153
[81]	valid_0's auc: 0.932496	valid_0's binary_logloss: 0.281291	valid_1's auc: 0.906745	valid_1's binary_logloss: 0.319332
[82]	valid_0's auc: 0.932766	valid_0's binary_logloss: 0.280841	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.319648
[83]	valid_0's auc: 0.932936	valid_0's binary_logloss: 0.280509	valid_1's auc: 0.906471	valid_1's binary_logloss: 0.31982
[84]	valid_0's auc: 0.93312	valid_0's binary_logloss: 0.280145	valid_1's auc: 0.906445	valid_1's binary_logloss: 0.319862
[85]	valid_0's auc: 0.933416	valid_0's binary_logloss: 0.279623	valid_1's auc: 0.906433	valid_1's binary_logloss: 0.319932
[86]	valid_0's auc: 0.933677	valid_0's binary_logloss: 0.279153	valid_1's auc: 0.906345	valid_1's binary_logloss: 0.320058
[87]	valid_0's auc: 0.933857	valid_0's binary_logloss: 0.278851	valid_1's auc: 0.906317	valid_1's binary_logloss: 0.320158
[88]	valid_0's auc: 0.934071	valid_0's binary_logloss: 0.278446	valid_1's auc: 0.906246	valid_1's binary_logloss: 0.320301
[89]	valid_0's auc: 0.934244	valid_0's binary_logloss: 0.278142	valid_1's auc: 0.906318	valid_1's binary_logloss: 0.320252
[90]	valid_0's auc: 0.934521	valid_0's binary_logloss: 0.277663	valid_1's auc: 0.906273	valid_1's binary_logloss: 0.320315
[91]	valid_0's auc: 0.934765	valid_0's binary_logloss: 0.277222	valid_1's auc: 0.906145	valid_1's binary_logloss: 0.320584
[92]	valid_0's auc: 0.935087	valid_0's binary_logloss: 0.27669	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320408
[93]	valid_0's auc: 0.93527	valid_0's binary_logloss: 0.27635	valid_1's auc: 0.906217	valid_1's binary_logloss: 0.320422
[94]	valid_0's auc: 0.935554	valid_0's binary_logloss: 0.275829	valid_1's auc: 0.90619	valid_1's binary_logloss: 0.320544
[95]	valid_0's auc: 0.935826	valid_0's binary_logloss: 0.275355	valid_1's auc: 0.90608	valid_1's binary_logloss: 0.3207
[96]	valid_0's auc: 0.936105	valid_0's binary_logloss: 0.274884	valid_1's auc: 0.905909	valid_1's binary_logloss: 0.32099
[97]	valid_0's auc: 0.93642	valid_0's binary_logloss: 0.274358	valid_1's auc: 0.905958	valid_1's binary_logloss: 0.320931
[98]	valid_0's auc: 0.936694	valid_0's binary_logloss: 0.273885	valid_1's auc: 0.905863	valid_1's binary_logloss: 0.321073
[99]	valid_0's auc: 0.936914	valid_0's binary_logloss: 0.273519	valid_1's auc: 0.905828	valid_1's binary_logloss: 0.321125
[100]	valid_0's auc: 0.937125	valid_0's binary_logloss: 0.273139	valid_1's auc: 0.905746	valid_1's binary_logloss: 0.321292
[101]	valid_0's auc: 0.937331	valid_0's binary_logloss: 0.27274	valid_1's auc: 0.905606	valid_1's binary_logloss: 0.321582
[102]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272424	valid_1's auc: 0.905546	valid_1's binary_logloss: 0.321722
[103]	valid_0's auc: 0.937675	valid_0's binary_logloss: 0.272138	valid_1's auc: 0.905512	valid_1's binary_logloss: 0.321791
[104]	valid_0's auc: 0.93786	valid_0's binary_logloss: 0.271807	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.321961
[105]	valid_0's auc: 0.938166	valid_0's binary_logloss: 0.271293	valid_1's auc: 0.905505	valid_1's binary_logloss: 0.321881
[106]	valid_0's auc: 0.938361	valid_0's binary_logloss: 0.270926	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322153
[107]	valid_0's auc: 0.938524	valid_0's binary_logloss: 0.270637	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.322188
[108]	valid_0's auc: 0.938766	valid_0's binary_logloss: 0.270148	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.322313
[109]	valid_0's auc: 0.938956	valid_0's binary_logloss: 0.269801	valid_1's auc: 0.905263	valid_1's binary_logloss: 0.322498
[110]	valid_0's auc: 0.939121	valid_0's binary_logloss: 0.269491	valid_1's auc: 0.905299	valid_1's binary_logloss: 0.322474
[111]	valid_0's auc: 0.939323	valid_0's binary_logloss: 0.269111	valid_1's auc: 0.905215	valid_1's binary_logloss: 0.322625
[112]	valid_0's auc: 0.939498	valid_0's binary_logloss: 0.268808	valid_1's auc: 0.905234	valid_1's binary_logloss: 0.322582
[113]	valid_0's auc: 0.939587	valid_0's binary_logloss: 0.268614	valid_1's auc: 0.905142	valid_1's binary_logloss: 0.322785
[114]	valid_0's auc: 0.939826	valid_0's binary_logloss: 0.26818	valid_1's auc: 0.905138	valid_1's binary_logloss: 0.322808
[115]	valid_0's auc: 0.940073	valid_0's binary_logloss: 0.26776	valid_1's auc: 0.905149	valid_1's binary_logloss: 0.322795
[116]	valid_0's auc: 0.940221	valid_0's binary_logloss: 0.267483	valid_1's auc: 0.905156	valid_1's binary_logloss: 0.322809
[117]	valid_0's auc: 0.940416	valid_0's binary_logloss: 0.267152	valid_1's auc: 0.905154	valid_1's binary_logloss: 0.322824
[118]	valid_0's auc: 0.940655	valid_0's binary_logloss: 0.266732	valid_1's auc: 0.905124	valid_1's binary_logloss: 0.322885
[119]	valid_0's auc: 0.940781	valid_0's binary_logloss: 0.266494	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323097
[120]	valid_0's auc: 0.940998	valid_0's binary_logloss: 0.266118	valid_1's auc: 0.904977	valid_1's binary_logloss: 0.323169
[121]	valid_0's auc: 0.941094	valid_0's binary_logloss: 0.265914	valid_1's auc: 0.904969	valid_1's binary_logloss: 0.323168
[122]	valid_0's auc: 0.941331	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.904967	valid_1's binary_logloss: 0.323192
[123]	valid_0's auc: 0.94152	valid_0's binary_logloss: 0.265128	valid_1's auc: 0.904915	valid_1's binary_logloss: 0.323329
[124]	valid_0's auc: 0.941759	valid_0's binary_logloss: 0.264712	valid_1's auc: 0.904838	valid_1's binary_logloss: 0.323542
[125]	valid_0's auc: 0.941827	valid_0's binary_logloss: 0.264561	valid_1's auc: 0.904837	valid_1's binary_logloss: 0.32354
[126]	valid_0's auc: 0.942004	valid_0's binary_logloss: 0.264253	valid_1's auc: 0.904771	valid_1's binary_logloss: 0.32369
[127]	valid_0's auc: 0.942186	valid_0's binary_logloss: 0.263899	valid_1's auc: 0.904709	valid_1's binary_logloss: 0.323881
[128]	valid_0's auc: 0.942419	valid_0's binary_logloss: 0.263503	valid_1's auc: 0.904669	valid_1's binary_logloss: 0.323978
[129]	valid_0's auc: 0.942585	valid_0's binary_logloss: 0.263195	valid_1's auc: 0.90469	valid_1's binary_logloss: 0.323913
[130]	valid_0's auc: 0.942807	valid_0's binary_logloss: 0.262768	valid_1's auc: 0.904623	valid_1's binary_logloss: 0.324056
[131]	valid_0's auc: 0.943008	valid_0's binary_logloss: 0.262435	valid_1's auc: 0.904665	valid_1's binary_logloss: 0.324027
Early stopping, best iteration is:
[31]	valid_0's auc: 0.915569	valid_0's binary_logloss: 0.314739	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.319825
[1]	valid_0's auc: 0.888786	valid_0's binary_logloss: 0.516801	valid_1's auc: 0.894376	valid_1's binary_logloss: 0.508215
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892051	valid_0's binary_logloss: 0.487909	valid_1's auc: 0.897516	valid_1's binary_logloss: 0.478613
[3]	valid_0's auc: 0.892499	valid_0's binary_logloss: 0.464939	valid_1's auc: 0.897999	valid_1's binary_logloss: 0.455284
[4]	valid_0's auc: 0.893544	valid_0's binary_logloss: 0.445997	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.43625
[5]	valid_0's auc: 0.897183	valid_0's binary_logloss: 0.429801	valid_1's auc: 0.901802	valid_1's binary_logloss: 0.419978
[6]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.416121	valid_1's auc: 0.902211	valid_1's binary_logloss: 0.406386
[7]	valid_0's auc: 0.899236	valid_0's binary_logloss: 0.40443	valid_1's auc: 0.902787	valid_1's binary_logloss: 0.394757
[8]	valid_0's auc: 0.899639	valid_0's binary_logloss: 0.394315	valid_1's auc: 0.90375	valid_1's binary_logloss: 0.384547
[9]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.38557	valid_1's auc: 0.904192	valid_1's binary_logloss: 0.376078
[10]	valid_0's auc: 0.901746	valid_0's binary_logloss: 0.377945	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.368806
[11]	valid_0's auc: 0.90252	valid_0's binary_logloss: 0.371205	valid_1's auc: 0.904908	valid_1's binary_logloss: 0.362532
[12]	valid_0's auc: 0.903208	valid_0's binary_logloss: 0.365265	valid_1's auc: 0.905106	valid_1's binary_logloss: 0.35705
[13]	valid_0's auc: 0.904384	valid_0's binary_logloss: 0.359865	valid_1's auc: 0.90581	valid_1's binary_logloss: 0.352017
[14]	valid_0's auc: 0.905128	valid_0's binary_logloss: 0.355111	valid_1's auc: 0.905975	valid_1's binary_logloss: 0.347824
[15]	valid_0's auc: 0.905702	valid_0's binary_logloss: 0.350796	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.343983
[16]	valid_0's auc: 0.906416	valid_0's binary_logloss: 0.346926	valid_1's auc: 0.907136	valid_1's binary_logloss: 0.340524
[17]	valid_0's auc: 0.906965	valid_0's binary_logloss: 0.343512	valid_1's auc: 0.907443	valid_1's binary_logloss: 0.337508
[18]	valid_0's auc: 0.907653	valid_0's binary_logloss: 0.340327	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.335135
[19]	valid_0's auc: 0.90867	valid_0's binary_logloss: 0.337206	valid_1's auc: 0.907689	valid_1's binary_logloss: 0.332904
[20]	valid_0's auc: 0.909209	valid_0's binary_logloss: 0.334692	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.331179
[21]	valid_0's auc: 0.90991	valid_0's binary_logloss: 0.3322	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.329477
[22]	valid_0's auc: 0.910643	valid_0's binary_logloss: 0.329894	valid_1's auc: 0.907685	valid_1's binary_logloss: 0.328068
[23]	valid_0's auc: 0.911375	valid_0's binary_logloss: 0.327592	valid_1's auc: 0.907806	valid_1's binary_logloss: 0.326608
[24]	valid_0's auc: 0.912047	valid_0's binary_logloss: 0.325475	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.325412
[25]	valid_0's auc: 0.91249	valid_0's binary_logloss: 0.323808	valid_1's auc: 0.907977	valid_1's binary_logloss: 0.324311
[26]	valid_0's auc: 0.913075	valid_0's binary_logloss: 0.322115	valid_1's auc: 0.908064	valid_1's binary_logloss: 0.323349
[27]	valid_0's auc: 0.913698	valid_0's binary_logloss: 0.320412	valid_1's auc: 0.908291	valid_1's binary_logloss: 0.3223
[28]	valid_0's auc: 0.914152	valid_0's binary_logloss: 0.318983	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.321655
[29]	valid_0's auc: 0.914788	valid_0's binary_logloss: 0.317385	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.321037
[30]	valid_0's auc: 0.9152	valid_0's binary_logloss: 0.316096	valid_1's auc: 0.908523	valid_1's binary_logloss: 0.320182
[31]	valid_0's auc: 0.91556	valid_0's binary_logloss: 0.314917	valid_1's auc: 0.908491	valid_1's binary_logloss: 0.319789
[32]	valid_0's auc: 0.915986	valid_0's binary_logloss: 0.313727	valid_1's auc: 0.908816	valid_1's binary_logloss: 0.318952
[33]	valid_0's auc: 0.916478	valid_0's binary_logloss: 0.312578	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.318495
[34]	valid_0's auc: 0.916924	valid_0's binary_logloss: 0.311425	valid_1's auc: 0.908981	valid_1's binary_logloss: 0.318003
[35]	valid_0's auc: 0.917365	valid_0's binary_logloss: 0.310288	valid_1's auc: 0.908978	valid_1's binary_logloss: 0.317658
[36]	valid_0's auc: 0.917694	valid_0's binary_logloss: 0.309367	valid_1's auc: 0.909051	valid_1's binary_logloss: 0.317322
[37]	valid_0's auc: 0.9181	valid_0's binary_logloss: 0.30838	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.317054
[38]	valid_0's auc: 0.918483	valid_0's binary_logloss: 0.307536	valid_1's auc: 0.90898	valid_1's binary_logloss: 0.317069
[39]	valid_0's auc: 0.918955	valid_0's binary_logloss: 0.30648	valid_1's auc: 0.908922	valid_1's binary_logloss: 0.316952
[40]	valid_0's auc: 0.919309	valid_0's binary_logloss: 0.30562	valid_1's auc: 0.909153	valid_1's binary_logloss: 0.316499
[41]	valid_0's auc: 0.91983	valid_0's binary_logloss: 0.304604	valid_1's auc: 0.909147	valid_1's binary_logloss: 0.316389
[42]	valid_0's auc: 0.920336	valid_0's binary_logloss: 0.303643	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.316482
[43]	valid_0's auc: 0.920736	valid_0's binary_logloss: 0.302776	valid_1's auc: 0.908915	valid_1's binary_logloss: 0.316468
[44]	valid_0's auc: 0.921159	valid_0's binary_logloss: 0.301928	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.316225
[45]	valid_0's auc: 0.921539	valid_0's binary_logloss: 0.301193	valid_1's auc: 0.908992	valid_1's binary_logloss: 0.316126
[46]	valid_0's auc: 0.92187	valid_0's binary_logloss: 0.300488	valid_1's auc: 0.909226	valid_1's binary_logloss: 0.315711
[47]	valid_0's auc: 0.922245	valid_0's binary_logloss: 0.299758	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.31581
[48]	valid_0's auc: 0.922544	valid_0's binary_logloss: 0.299144	valid_1's auc: 0.909222	valid_1's binary_logloss: 0.31565
[49]	valid_0's auc: 0.922868	valid_0's binary_logloss: 0.298506	valid_1's auc: 0.909291	valid_1's binary_logloss: 0.315479
[50]	valid_0's auc: 0.923161	valid_0's binary_logloss: 0.297913	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.315333
[51]	valid_0's auc: 0.923484	valid_0's binary_logloss: 0.297232	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.315207
[52]	valid_0's auc: 0.923889	valid_0's binary_logloss: 0.29655	valid_1's auc: 0.909301	valid_1's binary_logloss: 0.315335
[53]	valid_0's auc: 0.924254	valid_0's binary_logloss: 0.295955	valid_1's auc: 0.909275	valid_1's binary_logloss: 0.315351
[54]	valid_0's auc: 0.924517	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.909247	valid_1's binary_logloss: 0.315353
[55]	valid_0's auc: 0.92481	valid_0's binary_logloss: 0.294893	valid_1's auc: 0.90917	valid_1's binary_logloss: 0.315462
[56]	valid_0's auc: 0.925141	valid_0's binary_logloss: 0.294306	valid_1's auc: 0.9091	valid_1's binary_logloss: 0.315554
[57]	valid_0's auc: 0.925421	valid_0's binary_logloss: 0.293747	valid_1's auc: 0.909024	valid_1's binary_logloss: 0.315621
[58]	valid_0's auc: 0.925785	valid_0's binary_logloss: 0.293126	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.315675
[59]	valid_0's auc: 0.926173	valid_0's binary_logloss: 0.292439	valid_1's auc: 0.90897	valid_1's binary_logloss: 0.315695
[60]	valid_0's auc: 0.926458	valid_0's binary_logloss: 0.291904	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.316004
[61]	valid_0's auc: 0.926756	valid_0's binary_logloss: 0.291375	valid_1's auc: 0.908685	valid_1's binary_logloss: 0.316173
[62]	valid_0's auc: 0.927138	valid_0's binary_logloss: 0.29077	valid_1's auc: 0.908733	valid_1's binary_logloss: 0.316108
[63]	valid_0's auc: 0.927419	valid_0's binary_logloss: 0.290229	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.316013
[64]	valid_0's auc: 0.927725	valid_0's binary_logloss: 0.289704	valid_1's auc: 0.908769	valid_1's binary_logloss: 0.31602
[65]	valid_0's auc: 0.928033	valid_0's binary_logloss: 0.289182	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.315885
[66]	valid_0's auc: 0.928306	valid_0's binary_logloss: 0.288666	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.31594
[67]	valid_0's auc: 0.928609	valid_0's binary_logloss: 0.288157	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.315864
[68]	valid_0's auc: 0.928906	valid_0's binary_logloss: 0.287625	valid_1's auc: 0.908888	valid_1's binary_logloss: 0.315893
[69]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.287112	valid_1's auc: 0.908883	valid_1's binary_logloss: 0.315933
[70]	valid_0's auc: 0.929435	valid_0's binary_logloss: 0.286656	valid_1's auc: 0.908871	valid_1's binary_logloss: 0.315949
[71]	valid_0's auc: 0.92975	valid_0's binary_logloss: 0.286139	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.316021
[72]	valid_0's auc: 0.930013	valid_0's binary_logloss: 0.285676	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.316112
[73]	valid_0's auc: 0.930278	valid_0's binary_logloss: 0.285219	valid_1's auc: 0.908879	valid_1's binary_logloss: 0.316023
[74]	valid_0's auc: 0.930518	valid_0's binary_logloss: 0.284797	valid_1's auc: 0.908813	valid_1's binary_logloss: 0.31607
[75]	valid_0's auc: 0.930751	valid_0's binary_logloss: 0.284363	valid_1's auc: 0.908718	valid_1's binary_logloss: 0.316274
[76]	valid_0's auc: 0.93103	valid_0's binary_logloss: 0.283878	valid_1's auc: 0.908689	valid_1's binary_logloss: 0.316314
[77]	valid_0's auc: 0.93123	valid_0's binary_logloss: 0.283455	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.316362
[78]	valid_0's auc: 0.931527	valid_0's binary_logloss: 0.282977	valid_1's auc: 0.908556	valid_1's binary_logloss: 0.316511
[79]	valid_0's auc: 0.931848	valid_0's binary_logloss: 0.282431	valid_1's auc: 0.908578	valid_1's binary_logloss: 0.316506
[80]	valid_0's auc: 0.932055	valid_0's binary_logloss: 0.282006	valid_1's auc: 0.908483	valid_1's binary_logloss: 0.316679
[81]	valid_0's auc: 0.932277	valid_0's binary_logloss: 0.281636	valid_1's auc: 0.908391	valid_1's binary_logloss: 0.316806
[82]	valid_0's auc: 0.932582	valid_0's binary_logloss: 0.281116	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.317011
[83]	valid_0's auc: 0.932788	valid_0's binary_logloss: 0.2807	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.317227
[84]	valid_0's auc: 0.933006	valid_0's binary_logloss: 0.280312	valid_1's auc: 0.908055	valid_1's binary_logloss: 0.31746
[85]	valid_0's auc: 0.933335	valid_0's binary_logloss: 0.279791	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.317683
[86]	valid_0's auc: 0.933519	valid_0's binary_logloss: 0.279419	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.317973
[87]	valid_0's auc: 0.933653	valid_0's binary_logloss: 0.279115	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.318156
[88]	valid_0's auc: 0.933892	valid_0's binary_logloss: 0.278694	valid_1's auc: 0.907636	valid_1's binary_logloss: 0.318178
[89]	valid_0's auc: 0.934164	valid_0's binary_logloss: 0.278215	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318352
[90]	valid_0's auc: 0.934394	valid_0's binary_logloss: 0.277807	valid_1's auc: 0.90743	valid_1's binary_logloss: 0.318558
[91]	valid_0's auc: 0.934629	valid_0's binary_logloss: 0.277377	valid_1's auc: 0.907418	valid_1's binary_logloss: 0.318585
[92]	valid_0's auc: 0.93478	valid_0's binary_logloss: 0.277118	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.318602
[93]	valid_0's auc: 0.935084	valid_0's binary_logloss: 0.27657	valid_1's auc: 0.907257	valid_1's binary_logloss: 0.31882
[94]	valid_0's auc: 0.935232	valid_0's binary_logloss: 0.276271	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.319063
[95]	valid_0's auc: 0.93546	valid_0's binary_logloss: 0.275822	valid_1's auc: 0.907148	valid_1's binary_logloss: 0.319125
[96]	valid_0's auc: 0.935715	valid_0's binary_logloss: 0.275391	valid_1's auc: 0.907175	valid_1's binary_logloss: 0.319077
[97]	valid_0's auc: 0.935955	valid_0's binary_logloss: 0.274992	valid_1's auc: 0.907023	valid_1's binary_logloss: 0.319342
[98]	valid_0's auc: 0.936203	valid_0's binary_logloss: 0.274573	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.319289
[99]	valid_0's auc: 0.936406	valid_0's binary_logloss: 0.27424	valid_1's auc: 0.907131	valid_1's binary_logloss: 0.319247
[100]	valid_0's auc: 0.9366	valid_0's binary_logloss: 0.273836	valid_1's auc: 0.907095	valid_1's binary_logloss: 0.319326
[101]	valid_0's auc: 0.936853	valid_0's binary_logloss: 0.273432	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.319344
[102]	valid_0's auc: 0.937076	valid_0's binary_logloss: 0.273057	valid_1's auc: 0.907053	valid_1's binary_logloss: 0.319395
[103]	valid_0's auc: 0.937291	valid_0's binary_logloss: 0.272662	valid_1's auc: 0.907012	valid_1's binary_logloss: 0.319457
[104]	valid_0's auc: 0.937458	valid_0's binary_logloss: 0.272327	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.319621
[105]	valid_0's auc: 0.9376	valid_0's binary_logloss: 0.272015	valid_1's auc: 0.90672	valid_1's binary_logloss: 0.319998
[106]	valid_0's auc: 0.937839	valid_0's binary_logloss: 0.271611	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.320012
[107]	valid_0's auc: 0.938091	valid_0's binary_logloss: 0.271178	valid_1's auc: 0.906649	valid_1's binary_logloss: 0.320073
[108]	valid_0's auc: 0.938233	valid_0's binary_logloss: 0.270899	valid_1's auc: 0.906552	valid_1's binary_logloss: 0.320213
[109]	valid_0's auc: 0.938444	valid_0's binary_logloss: 0.270517	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320357
[110]	valid_0's auc: 0.938603	valid_0's binary_logloss: 0.270203	valid_1's auc: 0.906416	valid_1's binary_logloss: 0.320516
[111]	valid_0's auc: 0.938819	valid_0's binary_logloss: 0.269825	valid_1's auc: 0.90639	valid_1's binary_logloss: 0.320513
[112]	valid_0's auc: 0.939049	valid_0's binary_logloss: 0.269432	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.3205
[113]	valid_0's auc: 0.939222	valid_0's binary_logloss: 0.269081	valid_1's auc: 0.906454	valid_1's binary_logloss: 0.320432
[114]	valid_0's auc: 0.939388	valid_0's binary_logloss: 0.268763	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.320436
[115]	valid_0's auc: 0.939628	valid_0's binary_logloss: 0.26831	valid_1's auc: 0.906328	valid_1's binary_logloss: 0.320672
[116]	valid_0's auc: 0.939739	valid_0's binary_logloss: 0.26808	valid_1's auc: 0.906273	valid_1's binary_logloss: 0.320863
[117]	valid_0's auc: 0.939874	valid_0's binary_logloss: 0.267837	valid_1's auc: 0.906295	valid_1's binary_logloss: 0.320826
[118]	valid_0's auc: 0.940089	valid_0's binary_logloss: 0.267441	valid_1's auc: 0.906165	valid_1's binary_logloss: 0.32111
[119]	valid_0's auc: 0.940367	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.906236	valid_1's binary_logloss: 0.32097
[120]	valid_0's auc: 0.940587	valid_0's binary_logloss: 0.266546	valid_1's auc: 0.906223	valid_1's binary_logloss: 0.321039
[121]	valid_0's auc: 0.940751	valid_0's binary_logloss: 0.266243	valid_1's auc: 0.906137	valid_1's binary_logloss: 0.321232
[122]	valid_0's auc: 0.940894	valid_0's binary_logloss: 0.265945	valid_1's auc: 0.906042	valid_1's binary_logloss: 0.321446
[123]	valid_0's auc: 0.941108	valid_0's binary_logloss: 0.26555	valid_1's auc: 0.905976	valid_1's binary_logloss: 0.321608
[124]	valid_0's auc: 0.941217	valid_0's binary_logloss: 0.265311	valid_1's auc: 0.905893	valid_1's binary_logloss: 0.321821
[125]	valid_0's auc: 0.941403	valid_0's binary_logloss: 0.264992	valid_1's auc: 0.905871	valid_1's binary_logloss: 0.321859
[126]	valid_0's auc: 0.941561	valid_0's binary_logloss: 0.264697	valid_1's auc: 0.90586	valid_1's binary_logloss: 0.321893
[127]	valid_0's auc: 0.941717	valid_0's binary_logloss: 0.264398	valid_1's auc: 0.905859	valid_1's binary_logloss: 0.322003
[128]	valid_0's auc: 0.941904	valid_0's binary_logloss: 0.264068	valid_1's auc: 0.905784	valid_1's binary_logloss: 0.322109
[129]	valid_0's auc: 0.942129	valid_0's binary_logloss: 0.263681	valid_1's auc: 0.905732	valid_1's binary_logloss: 0.322221
[130]	valid_0's auc: 0.942337	valid_0's binary_logloss: 0.263332	valid_1's auc: 0.905641	valid_1's binary_logloss: 0.322397
[131]	valid_0's auc: 0.94256	valid_0's binary_logloss: 0.262953	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.322359
[132]	valid_0's auc: 0.942752	valid_0's binary_logloss: 0.26261	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.322374
[133]	valid_0's auc: 0.942961	valid_0's binary_logloss: 0.262214	valid_1's auc: 0.905645	valid_1's binary_logloss: 0.322528
[134]	valid_0's auc: 0.943101	valid_0's binary_logloss: 0.261927	valid_1's auc: 0.905593	valid_1's binary_logloss: 0.322696
[135]	valid_0's auc: 0.943328	valid_0's binary_logloss: 0.261499	valid_1's auc: 0.905557	valid_1's binary_logloss: 0.322806
[136]	valid_0's auc: 0.94353	valid_0's binary_logloss: 0.261141	valid_1's auc: 0.905584	valid_1's binary_logloss: 0.322786
[137]	valid_0's auc: 0.943724	valid_0's binary_logloss: 0.260804	valid_1's auc: 0.905576	valid_1's binary_logloss: 0.322783
[138]	valid_0's auc: 0.943947	valid_0's binary_logloss: 0.260408	valid_1's auc: 0.905598	valid_1's binary_logloss: 0.322802
[139]	valid_0's auc: 0.944115	valid_0's binary_logloss: 0.260124	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.322772
[140]	valid_0's auc: 0.944293	valid_0's binary_logloss: 0.259804	valid_1's auc: 0.90557	valid_1's binary_logloss: 0.322832
[141]	valid_0's auc: 0.944455	valid_0's binary_logloss: 0.259525	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.322881
[142]	valid_0's auc: 0.944615	valid_0's binary_logloss: 0.259194	valid_1's auc: 0.905533	valid_1's binary_logloss: 0.322929
[143]	valid_0's auc: 0.944798	valid_0's binary_logloss: 0.258869	valid_1's auc: 0.905557	valid_1's binary_logloss: 0.322959
[144]	valid_0's auc: 0.944968	valid_0's binary_logloss: 0.258561	valid_1's auc: 0.905552	valid_1's binary_logloss: 0.32302
[145]	valid_0's auc: 0.9451	valid_0's binary_logloss: 0.258305	valid_1's auc: 0.905654	valid_1's binary_logloss: 0.322894
[146]	valid_0's auc: 0.94524	valid_0's binary_logloss: 0.258043	valid_1's auc: 0.905584	valid_1's binary_logloss: 0.323021
[147]	valid_0's auc: 0.945358	valid_0's binary_logloss: 0.257801	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.323019
[148]	valid_0's auc: 0.945461	valid_0's binary_logloss: 0.257568	valid_1's auc: 0.905551	valid_1's binary_logloss: 0.323098
[149]	valid_0's auc: 0.945603	valid_0's binary_logloss: 0.257296	valid_1's auc: 0.905399	valid_1's binary_logloss: 0.323376
[150]	valid_0's auc: 0.945733	valid_0's binary_logloss: 0.257051	valid_1's auc: 0.905441	valid_1's binary_logloss: 0.323361
[151]	valid_0's auc: 0.945893	valid_0's binary_logloss: 0.256751	valid_1's auc: 0.905407	valid_1's binary_logloss: 0.323435
Early stopping, best iteration is:
[51]	valid_0's auc: 0.923484	valid_0's binary_logloss: 0.297232	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.315207
[1]	valid_0's auc: 0.888568	valid_0's binary_logloss: 0.517232	valid_1's auc: 0.893169	valid_1's binary_logloss: 0.508727
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893525	valid_0's binary_logloss: 0.48805	valid_1's auc: 0.898612	valid_1's binary_logloss: 0.479079
[3]	valid_0's auc: 0.895098	valid_0's binary_logloss: 0.465044	valid_1's auc: 0.899666	valid_1's binary_logloss: 0.45542
[4]	valid_0's auc: 0.897204	valid_0's binary_logloss: 0.445626	valid_1's auc: 0.9009	valid_1's binary_logloss: 0.436065
[5]	valid_0's auc: 0.898082	valid_0's binary_logloss: 0.429582	valid_1's auc: 0.901179	valid_1's binary_logloss: 0.420084
[6]	valid_0's auc: 0.899115	valid_0's binary_logloss: 0.416064	valid_1's auc: 0.902064	valid_1's binary_logloss: 0.406467
[7]	valid_0's auc: 0.900214	valid_0's binary_logloss: 0.404266	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.394517
[8]	valid_0's auc: 0.901071	valid_0's binary_logloss: 0.394186	valid_1's auc: 0.904674	valid_1's binary_logloss: 0.384528
[9]	valid_0's auc: 0.902053	valid_0's binary_logloss: 0.3852	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.375991
[10]	valid_0's auc: 0.902655	valid_0's binary_logloss: 0.377691	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.368542
[11]	valid_0's auc: 0.903721	valid_0's binary_logloss: 0.370845	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.36216
[12]	valid_0's auc: 0.90431	valid_0's binary_logloss: 0.364817	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.356697
[13]	valid_0's auc: 0.904899	valid_0's binary_logloss: 0.359461	valid_1's auc: 0.906267	valid_1's binary_logloss: 0.351973
[14]	valid_0's auc: 0.905421	valid_0's binary_logloss: 0.354711	valid_1's auc: 0.906457	valid_1's binary_logloss: 0.347712
[15]	valid_0's auc: 0.906567	valid_0's binary_logloss: 0.350371	valid_1's auc: 0.906775	valid_1's binary_logloss: 0.344046
[16]	valid_0's auc: 0.907287	valid_0's binary_logloss: 0.346495	valid_1's auc: 0.907202	valid_1's binary_logloss: 0.340683
[17]	valid_0's auc: 0.908034	valid_0's binary_logloss: 0.342933	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.337698
[18]	valid_0's auc: 0.908689	valid_0's binary_logloss: 0.339662	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.334943
[19]	valid_0's auc: 0.90925	valid_0's binary_logloss: 0.336764	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.332678
[20]	valid_0's auc: 0.909644	valid_0's binary_logloss: 0.334259	valid_1's auc: 0.908146	valid_1's binary_logloss: 0.330645
[21]	valid_0's auc: 0.910185	valid_0's binary_logloss: 0.33188	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.328924
[22]	valid_0's auc: 0.910775	valid_0's binary_logloss: 0.329584	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.327448
[23]	valid_0's auc: 0.9114	valid_0's binary_logloss: 0.327507	valid_1's auc: 0.908415	valid_1's binary_logloss: 0.325926
[24]	valid_0's auc: 0.911995	valid_0's binary_logloss: 0.325544	valid_1's auc: 0.908411	valid_1's binary_logloss: 0.32485
[25]	valid_0's auc: 0.912518	valid_0's binary_logloss: 0.323699	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.323409
[26]	valid_0's auc: 0.913113	valid_0's binary_logloss: 0.321982	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.322563
[27]	valid_0's auc: 0.913619	valid_0's binary_logloss: 0.320428	valid_1's auc: 0.908773	valid_1's binary_logloss: 0.321857
[28]	valid_0's auc: 0.913997	valid_0's binary_logloss: 0.319038	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.321103
[29]	valid_0's auc: 0.914534	valid_0's binary_logloss: 0.317595	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.320133
[30]	valid_0's auc: 0.915119	valid_0's binary_logloss: 0.316097	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.319557
[31]	valid_0's auc: 0.915576	valid_0's binary_logloss: 0.314812	valid_1's auc: 0.909168	valid_1's binary_logloss: 0.319006
[32]	valid_0's auc: 0.916098	valid_0's binary_logloss: 0.31357	valid_1's auc: 0.909261	valid_1's binary_logloss: 0.318543
[33]	valid_0's auc: 0.916546	valid_0's binary_logloss: 0.312427	valid_1's auc: 0.909244	valid_1's binary_logloss: 0.318171
[34]	valid_0's auc: 0.917016	valid_0's binary_logloss: 0.311269	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.317923
[35]	valid_0's auc: 0.917414	valid_0's binary_logloss: 0.310243	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.317536
[36]	valid_0's auc: 0.917827	valid_0's binary_logloss: 0.309274	valid_1's auc: 0.909295	valid_1's binary_logloss: 0.317185
[37]	valid_0's auc: 0.918329	valid_0's binary_logloss: 0.308247	valid_1's auc: 0.909286	valid_1's binary_logloss: 0.316991
[38]	valid_0's auc: 0.918748	valid_0's binary_logloss: 0.307341	valid_1's auc: 0.90927	valid_1's binary_logloss: 0.316831
[39]	valid_0's auc: 0.919198	valid_0's binary_logloss: 0.306329	valid_1's auc: 0.909351	valid_1's binary_logloss: 0.316452
[40]	valid_0's auc: 0.91958	valid_0's binary_logloss: 0.305446	valid_1's auc: 0.909369	valid_1's binary_logloss: 0.316231
[41]	valid_0's auc: 0.919912	valid_0's binary_logloss: 0.304679	valid_1's auc: 0.909497	valid_1's binary_logloss: 0.315908
[42]	valid_0's auc: 0.920318	valid_0's binary_logloss: 0.303907	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.31578
[43]	valid_0's auc: 0.92061	valid_0's binary_logloss: 0.303231	valid_1's auc: 0.909653	valid_1's binary_logloss: 0.315452
[44]	valid_0's auc: 0.92103	valid_0's binary_logloss: 0.302464	valid_1's auc: 0.909752	valid_1's binary_logloss: 0.315177
[45]	valid_0's auc: 0.921317	valid_0's binary_logloss: 0.301808	valid_1's auc: 0.909747	valid_1's binary_logloss: 0.315096
[46]	valid_0's auc: 0.921666	valid_0's binary_logloss: 0.301107	valid_1's auc: 0.909736	valid_1's binary_logloss: 0.314978
[47]	valid_0's auc: 0.922041	valid_0's binary_logloss: 0.300378	valid_1's auc: 0.909613	valid_1's binary_logloss: 0.315075
[48]	valid_0's auc: 0.9224	valid_0's binary_logloss: 0.299711	valid_1's auc: 0.909529	valid_1's binary_logloss: 0.315117
[49]	valid_0's auc: 0.922826	valid_0's binary_logloss: 0.298972	valid_1's auc: 0.909437	valid_1's binary_logloss: 0.315143
[50]	valid_0's auc: 0.923229	valid_0's binary_logloss: 0.298196	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.315011
[51]	valid_0's auc: 0.923617	valid_0's binary_logloss: 0.297476	valid_1's auc: 0.909499	valid_1's binary_logloss: 0.314934
[52]	valid_0's auc: 0.923948	valid_0's binary_logloss: 0.296887	valid_1's auc: 0.90951	valid_1's binary_logloss: 0.314856
[53]	valid_0's auc: 0.92432	valid_0's binary_logloss: 0.296196	valid_1's auc: 0.909459	valid_1's binary_logloss: 0.314878
[54]	valid_0's auc: 0.924589	valid_0's binary_logloss: 0.29561	valid_1's auc: 0.909494	valid_1's binary_logloss: 0.314761
[55]	valid_0's auc: 0.92498	valid_0's binary_logloss: 0.294905	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314482
[56]	valid_0's auc: 0.925413	valid_0's binary_logloss: 0.294165	valid_1's auc: 0.909742	valid_1's binary_logloss: 0.31429
[57]	valid_0's auc: 0.925772	valid_0's binary_logloss: 0.29356	valid_1's auc: 0.909684	valid_1's binary_logloss: 0.314415
[58]	valid_0's auc: 0.926033	valid_0's binary_logloss: 0.293004	valid_1's auc: 0.909787	valid_1's binary_logloss: 0.314239
[59]	valid_0's auc: 0.926356	valid_0's binary_logloss: 0.292504	valid_1's auc: 0.909759	valid_1's binary_logloss: 0.314304
[60]	valid_0's auc: 0.92672	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.90976	valid_1's binary_logloss: 0.314252
[61]	valid_0's auc: 0.927024	valid_0's binary_logloss: 0.291257	valid_1's auc: 0.909764	valid_1's binary_logloss: 0.314209
[62]	valid_0's auc: 0.927374	valid_0's binary_logloss: 0.290674	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314096
[63]	valid_0's auc: 0.927719	valid_0's binary_logloss: 0.29011	valid_1's auc: 0.909692	valid_1's binary_logloss: 0.314267
[64]	valid_0's auc: 0.928134	valid_0's binary_logloss: 0.289391	valid_1's auc: 0.909651	valid_1's binary_logloss: 0.314316
[65]	valid_0's auc: 0.928387	valid_0's binary_logloss: 0.288941	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314409
[66]	valid_0's auc: 0.928855	valid_0's binary_logloss: 0.288203	valid_1's auc: 0.909694	valid_1's binary_logloss: 0.314209
[67]	valid_0's auc: 0.929177	valid_0's binary_logloss: 0.287633	valid_1's auc: 0.909634	valid_1's binary_logloss: 0.314345
[68]	valid_0's auc: 0.929458	valid_0's binary_logloss: 0.287132	valid_1's auc: 0.909613	valid_1's binary_logloss: 0.314345
[69]	valid_0's auc: 0.929734	valid_0's binary_logloss: 0.286629	valid_1's auc: 0.909472	valid_1's binary_logloss: 0.314557
[70]	valid_0's auc: 0.930035	valid_0's binary_logloss: 0.286128	valid_1's auc: 0.909472	valid_1's binary_logloss: 0.314571
[71]	valid_0's auc: 0.930261	valid_0's binary_logloss: 0.285711	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.314665
[72]	valid_0's auc: 0.930598	valid_0's binary_logloss: 0.28514	valid_1's auc: 0.909427	valid_1's binary_logloss: 0.314585
[73]	valid_0's auc: 0.930924	valid_0's binary_logloss: 0.284596	valid_1's auc: 0.909418	valid_1's binary_logloss: 0.314589
[74]	valid_0's auc: 0.931099	valid_0's binary_logloss: 0.284258	valid_1's auc: 0.909409	valid_1's binary_logloss: 0.314637
[75]	valid_0's auc: 0.931447	valid_0's binary_logloss: 0.283673	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.314718
[76]	valid_0's auc: 0.931733	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.314674
[77]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.282801	valid_1's auc: 0.909225	valid_1's binary_logloss: 0.314931
[78]	valid_0's auc: 0.93215	valid_0's binary_logloss: 0.282385	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.315013
[79]	valid_0's auc: 0.932424	valid_0's binary_logloss: 0.28189	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.31497
[80]	valid_0's auc: 0.932659	valid_0's binary_logloss: 0.281455	valid_1's auc: 0.909217	valid_1's binary_logloss: 0.315074
[81]	valid_0's auc: 0.93292	valid_0's binary_logloss: 0.280986	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.315219
[82]	valid_0's auc: 0.933095	valid_0's binary_logloss: 0.280661	valid_1's auc: 0.90905	valid_1's binary_logloss: 0.315353
[83]	valid_0's auc: 0.933396	valid_0's binary_logloss: 0.280163	valid_1's auc: 0.908891	valid_1's binary_logloss: 0.315579
[84]	valid_0's auc: 0.933595	valid_0's binary_logloss: 0.279824	valid_1's auc: 0.908786	valid_1's binary_logloss: 0.315742
[85]	valid_0's auc: 0.933815	valid_0's binary_logloss: 0.279441	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.315859
[86]	valid_0's auc: 0.93401	valid_0's binary_logloss: 0.279074	valid_1's auc: 0.908607	valid_1's binary_logloss: 0.316046
[87]	valid_0's auc: 0.934219	valid_0's binary_logloss: 0.278643	valid_1's auc: 0.908524	valid_1's binary_logloss: 0.316197
[88]	valid_0's auc: 0.934476	valid_0's binary_logloss: 0.278207	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.316141
[89]	valid_0's auc: 0.934741	valid_0's binary_logloss: 0.277744	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316193
[90]	valid_0's auc: 0.935147	valid_0's binary_logloss: 0.277056	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.316144
[91]	valid_0's auc: 0.93532	valid_0's binary_logloss: 0.276732	valid_1's auc: 0.908633	valid_1's binary_logloss: 0.316096
[92]	valid_0's auc: 0.935472	valid_0's binary_logloss: 0.276442	valid_1's auc: 0.908571	valid_1's binary_logloss: 0.31622
[93]	valid_0's auc: 0.935703	valid_0's binary_logloss: 0.276022	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.316176
[94]	valid_0's auc: 0.93594	valid_0's binary_logloss: 0.275588	valid_1's auc: 0.908562	valid_1's binary_logloss: 0.316197
[95]	valid_0's auc: 0.936291	valid_0's binary_logloss: 0.275015	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.316158
[96]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.274641	valid_1's auc: 0.908593	valid_1's binary_logloss: 0.316111
[97]	valid_0's auc: 0.936735	valid_0's binary_logloss: 0.274231	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.316374
[98]	valid_0's auc: 0.937018	valid_0's binary_logloss: 0.273734	valid_1's auc: 0.908403	valid_1's binary_logloss: 0.316395
[99]	valid_0's auc: 0.937234	valid_0's binary_logloss: 0.273339	valid_1's auc: 0.908348	valid_1's binary_logloss: 0.316523
[100]	valid_0's auc: 0.937589	valid_0's binary_logloss: 0.272761	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.31687
[101]	valid_0's auc: 0.937714	valid_0's binary_logloss: 0.272478	valid_1's auc: 0.908152	valid_1's binary_logloss: 0.316849
[102]	valid_0's auc: 0.937967	valid_0's binary_logloss: 0.272019	valid_1's auc: 0.908072	valid_1's binary_logloss: 0.317009
[103]	valid_0's auc: 0.938226	valid_0's binary_logloss: 0.271531	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.317149
[104]	valid_0's auc: 0.938481	valid_0's binary_logloss: 0.271108	valid_1's auc: 0.908021	valid_1's binary_logloss: 0.317125
[105]	valid_0's auc: 0.938759	valid_0's binary_logloss: 0.270662	valid_1's auc: 0.907968	valid_1's binary_logloss: 0.317208
[106]	valid_0's auc: 0.938967	valid_0's binary_logloss: 0.270241	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.317231
[107]	valid_0's auc: 0.939212	valid_0's binary_logloss: 0.269802	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317365
[108]	valid_0's auc: 0.939397	valid_0's binary_logloss: 0.269484	valid_1's auc: 0.907834	valid_1's binary_logloss: 0.317532
[109]	valid_0's auc: 0.9396	valid_0's binary_logloss: 0.269073	valid_1's auc: 0.907841	valid_1's binary_logloss: 0.317581
[110]	valid_0's auc: 0.939778	valid_0's binary_logloss: 0.268762	valid_1's auc: 0.907878	valid_1's binary_logloss: 0.317536
[111]	valid_0's auc: 0.939984	valid_0's binary_logloss: 0.268414	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317602
[112]	valid_0's auc: 0.94015	valid_0's binary_logloss: 0.268103	valid_1's auc: 0.907843	valid_1's binary_logloss: 0.317569
[113]	valid_0's auc: 0.94025	valid_0's binary_logloss: 0.267875	valid_1's auc: 0.907812	valid_1's binary_logloss: 0.317617
[114]	valid_0's auc: 0.940448	valid_0's binary_logloss: 0.267519	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317699
[115]	valid_0's auc: 0.940667	valid_0's binary_logloss: 0.267146	valid_1's auc: 0.907742	valid_1's binary_logloss: 0.317757
[116]	valid_0's auc: 0.940862	valid_0's binary_logloss: 0.266732	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317809
[117]	valid_0's auc: 0.941066	valid_0's binary_logloss: 0.266376	valid_1's auc: 0.907717	valid_1's binary_logloss: 0.317848
[118]	valid_0's auc: 0.941307	valid_0's binary_logloss: 0.265899	valid_1's auc: 0.907584	valid_1's binary_logloss: 0.318144
[119]	valid_0's auc: 0.941453	valid_0's binary_logloss: 0.265615	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318193
[120]	valid_0's auc: 0.941664	valid_0's binary_logloss: 0.265241	valid_1's auc: 0.907532	valid_1's binary_logloss: 0.318277
[121]	valid_0's auc: 0.941958	valid_0's binary_logloss: 0.264722	valid_1's auc: 0.907497	valid_1's binary_logloss: 0.31833
[122]	valid_0's auc: 0.942096	valid_0's binary_logloss: 0.264434	valid_1's auc: 0.907492	valid_1's binary_logloss: 0.318353
[123]	valid_0's auc: 0.942368	valid_0's binary_logloss: 0.263978	valid_1's auc: 0.907438	valid_1's binary_logloss: 0.318436
[124]	valid_0's auc: 0.942576	valid_0's binary_logloss: 0.263606	valid_1's auc: 0.907506	valid_1's binary_logloss: 0.318334
[125]	valid_0's auc: 0.942728	valid_0's binary_logloss: 0.263258	valid_1's auc: 0.907429	valid_1's binary_logloss: 0.318527
[126]	valid_0's auc: 0.9429	valid_0's binary_logloss: 0.262939	valid_1's auc: 0.907361	valid_1's binary_logloss: 0.318664
[127]	valid_0's auc: 0.943004	valid_0's binary_logloss: 0.262723	valid_1's auc: 0.907288	valid_1's binary_logloss: 0.318843
[128]	valid_0's auc: 0.943191	valid_0's binary_logloss: 0.262383	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318961
[129]	valid_0's auc: 0.943339	valid_0's binary_logloss: 0.262074	valid_1's auc: 0.90726	valid_1's binary_logloss: 0.31884
[130]	valid_0's auc: 0.943579	valid_0's binary_logloss: 0.261651	valid_1's auc: 0.907241	valid_1's binary_logloss: 0.318891
[131]	valid_0's auc: 0.94375	valid_0's binary_logloss: 0.261266	valid_1's auc: 0.907225	valid_1's binary_logloss: 0.318982
[132]	valid_0's auc: 0.94397	valid_0's binary_logloss: 0.260881	valid_1's auc: 0.90723	valid_1's binary_logloss: 0.319071
[133]	valid_0's auc: 0.94415	valid_0's binary_logloss: 0.260583	valid_1's auc: 0.907007	valid_1's binary_logloss: 0.319464
[134]	valid_0's auc: 0.944336	valid_0's binary_logloss: 0.260224	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.319719
[135]	valid_0's auc: 0.94446	valid_0's binary_logloss: 0.259977	valid_1's auc: 0.906866	valid_1's binary_logloss: 0.319777
[136]	valid_0's auc: 0.944654	valid_0's binary_logloss: 0.25962	valid_1's auc: 0.906806	valid_1's binary_logloss: 0.319899
[137]	valid_0's auc: 0.944877	valid_0's binary_logloss: 0.25924	valid_1's auc: 0.906818	valid_1's binary_logloss: 0.319949
[138]	valid_0's auc: 0.945048	valid_0's binary_logloss: 0.258906	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.320018
[139]	valid_0's auc: 0.9452	valid_0's binary_logloss: 0.258583	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.32005
[140]	valid_0's auc: 0.945366	valid_0's binary_logloss: 0.258267	valid_1's auc: 0.90677	valid_1's binary_logloss: 0.320172
[141]	valid_0's auc: 0.945508	valid_0's binary_logloss: 0.257961	valid_1's auc: 0.906802	valid_1's binary_logloss: 0.320151
[142]	valid_0's auc: 0.945686	valid_0's binary_logloss: 0.257651	valid_1's auc: 0.906763	valid_1's binary_logloss: 0.320275
[143]	valid_0's auc: 0.945799	valid_0's binary_logloss: 0.257429	valid_1's auc: 0.906746	valid_1's binary_logloss: 0.320358
[144]	valid_0's auc: 0.94594	valid_0's binary_logloss: 0.257166	valid_1's auc: 0.906641	valid_1's binary_logloss: 0.320548
[145]	valid_0's auc: 0.946078	valid_0's binary_logloss: 0.256857	valid_1's auc: 0.906631	valid_1's binary_logloss: 0.32067
[146]	valid_0's auc: 0.946292	valid_0's binary_logloss: 0.256458	valid_1's auc: 0.906477	valid_1's binary_logloss: 0.32092
[147]	valid_0's auc: 0.946424	valid_0's binary_logloss: 0.256211	valid_1's auc: 0.906497	valid_1's binary_logloss: 0.320915
[148]	valid_0's auc: 0.946571	valid_0's binary_logloss: 0.255905	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.321128
[149]	valid_0's auc: 0.946695	valid_0's binary_logloss: 0.25567	valid_1's auc: 0.906357	valid_1's binary_logloss: 0.32128
[150]	valid_0's auc: 0.946798	valid_0's binary_logloss: 0.255436	valid_1's auc: 0.906332	valid_1's binary_logloss: 0.321317
[151]	valid_0's auc: 0.946973	valid_0's binary_logloss: 0.255081	valid_1's auc: 0.906214	valid_1's binary_logloss: 0.321524
[152]	valid_0's auc: 0.947105	valid_0's binary_logloss: 0.254834	valid_1's auc: 0.906174	valid_1's binary_logloss: 0.321609
[153]	valid_0's auc: 0.947244	valid_0's binary_logloss: 0.254577	valid_1's auc: 0.906171	valid_1's binary_logloss: 0.321658
[154]	valid_0's auc: 0.94741	valid_0's binary_logloss: 0.254279	valid_1's auc: 0.906124	valid_1's binary_logloss: 0.321759
[155]	valid_0's auc: 0.947505	valid_0's binary_logloss: 0.254064	valid_1's auc: 0.906093	valid_1's binary_logloss: 0.321835
[156]	valid_0's auc: 0.947643	valid_0's binary_logloss: 0.253759	valid_1's auc: 0.905935	valid_1's binary_logloss: 0.322154
[157]	valid_0's auc: 0.947845	valid_0's binary_logloss: 0.253358	valid_1's auc: 0.905901	valid_1's binary_logloss: 0.322252
[158]	valid_0's auc: 0.947944	valid_0's binary_logloss: 0.253133	valid_1's auc: 0.905838	valid_1's binary_logloss: 0.322388
[159]	valid_0's auc: 0.948134	valid_0's binary_logloss: 0.252791	valid_1's auc: 0.905813	valid_1's binary_logloss: 0.322498
[160]	valid_0's auc: 0.948265	valid_0's binary_logloss: 0.252528	valid_1's auc: 0.90575	valid_1's binary_logloss: 0.322666
[161]	valid_0's auc: 0.948369	valid_0's binary_logloss: 0.252284	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.322672
[162]	valid_0's auc: 0.948479	valid_0's binary_logloss: 0.252079	valid_1's auc: 0.905747	valid_1's binary_logloss: 0.322745
Early stopping, best iteration is:
[62]	valid_0's auc: 0.927374	valid_0's binary_logloss: 0.290674	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314096
[1]	valid_0's auc: 0.883999	valid_0's binary_logloss: 0.517495	valid_1's auc: 0.891234	valid_1's binary_logloss: 0.508616
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891027	valid_0's binary_logloss: 0.488825	valid_1's auc: 0.896641	valid_1's binary_logloss: 0.479157
[3]	valid_0's auc: 0.894951	valid_0's binary_logloss: 0.465291	valid_1's auc: 0.899671	valid_1's binary_logloss: 0.455294
[4]	valid_0's auc: 0.89606	valid_0's binary_logloss: 0.4462	valid_1's auc: 0.900601	valid_1's binary_logloss: 0.435941
[5]	valid_0's auc: 0.897345	valid_0's binary_logloss: 0.43003	valid_1's auc: 0.900711	valid_1's binary_logloss: 0.419873
[6]	valid_0's auc: 0.898499	valid_0's binary_logloss: 0.41635	valid_1's auc: 0.901767	valid_1's binary_logloss: 0.406108
[7]	valid_0's auc: 0.89983	valid_0's binary_logloss: 0.404494	valid_1's auc: 0.903447	valid_1's binary_logloss: 0.394511
[8]	valid_0's auc: 0.900425	valid_0's binary_logloss: 0.394452	valid_1's auc: 0.903731	valid_1's binary_logloss: 0.38466
[9]	valid_0's auc: 0.901201	valid_0's binary_logloss: 0.385617	valid_1's auc: 0.903911	valid_1's binary_logloss: 0.376198
[10]	valid_0's auc: 0.901776	valid_0's binary_logloss: 0.378074	valid_1's auc: 0.904371	valid_1's binary_logloss: 0.368708
[11]	valid_0's auc: 0.902544	valid_0's binary_logloss: 0.37121	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.362032
[12]	valid_0's auc: 0.90366	valid_0's binary_logloss: 0.364887	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.356476
[13]	valid_0's auc: 0.904305	valid_0's binary_logloss: 0.359711	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.351728
[14]	valid_0's auc: 0.905262	valid_0's binary_logloss: 0.354826	valid_1's auc: 0.906348	valid_1's binary_logloss: 0.347409
[15]	valid_0's auc: 0.90587	valid_0's binary_logloss: 0.350644	valid_1's auc: 0.906499	valid_1's binary_logloss: 0.343687
[16]	valid_0's auc: 0.90626	valid_0's binary_logloss: 0.347097	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.34054
[17]	valid_0's auc: 0.906844	valid_0's binary_logloss: 0.343671	valid_1's auc: 0.906994	valid_1's binary_logloss: 0.337526
[18]	valid_0's auc: 0.9076	valid_0's binary_logloss: 0.340386	valid_1's auc: 0.907114	valid_1's binary_logloss: 0.334877
[19]	valid_0's auc: 0.908461	valid_0's binary_logloss: 0.337529	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.332773
[20]	valid_0's auc: 0.909101	valid_0's binary_logloss: 0.334827	valid_1's auc: 0.908205	valid_1's binary_logloss: 0.33029
[21]	valid_0's auc: 0.909823	valid_0's binary_logloss: 0.33228	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.328521
[22]	valid_0's auc: 0.910415	valid_0's binary_logloss: 0.330045	valid_1's auc: 0.908359	valid_1's binary_logloss: 0.326994
[23]	valid_0's auc: 0.911018	valid_0's binary_logloss: 0.327874	valid_1's auc: 0.908714	valid_1's binary_logloss: 0.325227
[24]	valid_0's auc: 0.911611	valid_0's binary_logloss: 0.325867	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.323868
[25]	valid_0's auc: 0.912178	valid_0's binary_logloss: 0.323949	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.322513
[26]	valid_0's auc: 0.912874	valid_0's binary_logloss: 0.322149	valid_1's auc: 0.909102	valid_1's binary_logloss: 0.321504
[27]	valid_0's auc: 0.913521	valid_0's binary_logloss: 0.320396	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.320248
[28]	valid_0's auc: 0.914034	valid_0's binary_logloss: 0.318902	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.319553
[29]	valid_0's auc: 0.91458	valid_0's binary_logloss: 0.317387	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.318551
[30]	valid_0's auc: 0.915144	valid_0's binary_logloss: 0.31595	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.318078
[31]	valid_0's auc: 0.915618	valid_0's binary_logloss: 0.314668	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.317556
[32]	valid_0's auc: 0.916234	valid_0's binary_logloss: 0.31331	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.317238
[33]	valid_0's auc: 0.916616	valid_0's binary_logloss: 0.312239	valid_1's auc: 0.909675	valid_1's binary_logloss: 0.316716
[34]	valid_0's auc: 0.917182	valid_0's binary_logloss: 0.310978	valid_1's auc: 0.909633	valid_1's binary_logloss: 0.31641
[35]	valid_0's auc: 0.917599	valid_0's binary_logloss: 0.309913	valid_1's auc: 0.909573	valid_1's binary_logloss: 0.316209
[36]	valid_0's auc: 0.91806	valid_0's binary_logloss: 0.308908	valid_1's auc: 0.909355	valid_1's binary_logloss: 0.316188
[37]	valid_0's auc: 0.918485	valid_0's binary_logloss: 0.307974	valid_1's auc: 0.909414	valid_1's binary_logloss: 0.315841
[38]	valid_0's auc: 0.918923	valid_0's binary_logloss: 0.307027	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.315497
[39]	valid_0's auc: 0.919254	valid_0's binary_logloss: 0.306203	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.31517
[40]	valid_0's auc: 0.919724	valid_0's binary_logloss: 0.305269	valid_1's auc: 0.909607	valid_1's binary_logloss: 0.31496
[41]	valid_0's auc: 0.920132	valid_0's binary_logloss: 0.304355	valid_1's auc: 0.909591	valid_1's binary_logloss: 0.314901
[42]	valid_0's auc: 0.920468	valid_0's binary_logloss: 0.303619	valid_1's auc: 0.909536	valid_1's binary_logloss: 0.314833
[43]	valid_0's auc: 0.920768	valid_0's binary_logloss: 0.302947	valid_1's auc: 0.909577	valid_1's binary_logloss: 0.314618
[44]	valid_0's auc: 0.9211	valid_0's binary_logloss: 0.302216	valid_1's auc: 0.909551	valid_1's binary_logloss: 0.314493
[45]	valid_0's auc: 0.921442	valid_0's binary_logloss: 0.301494	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.314378
[46]	valid_0's auc: 0.921737	valid_0's binary_logloss: 0.300877	valid_1's auc: 0.909499	valid_1's binary_logloss: 0.314428
[47]	valid_0's auc: 0.922029	valid_0's binary_logloss: 0.300274	valid_1's auc: 0.90936	valid_1's binary_logloss: 0.314544
[48]	valid_0's auc: 0.922463	valid_0's binary_logloss: 0.299504	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314385
[49]	valid_0's auc: 0.922872	valid_0's binary_logloss: 0.298755	valid_1's auc: 0.909446	valid_1's binary_logloss: 0.314325
[50]	valid_0's auc: 0.923248	valid_0's binary_logloss: 0.298094	valid_1's auc: 0.909348	valid_1's binary_logloss: 0.314403
[51]	valid_0's auc: 0.923586	valid_0's binary_logloss: 0.297446	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.314606
[52]	valid_0's auc: 0.923987	valid_0's binary_logloss: 0.296759	valid_1's auc: 0.909141	valid_1's binary_logloss: 0.314704
[53]	valid_0's auc: 0.92426	valid_0's binary_logloss: 0.296197	valid_1's auc: 0.909132	valid_1's binary_logloss: 0.314609
[54]	valid_0's auc: 0.924562	valid_0's binary_logloss: 0.295605	valid_1's auc: 0.90922	valid_1's binary_logloss: 0.314465
[55]	valid_0's auc: 0.924869	valid_0's binary_logloss: 0.295	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314224
[56]	valid_0's auc: 0.925279	valid_0's binary_logloss: 0.294292	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.314067
[57]	valid_0's auc: 0.925561	valid_0's binary_logloss: 0.293757	valid_1's auc: 0.909493	valid_1's binary_logloss: 0.31403
[58]	valid_0's auc: 0.92592	valid_0's binary_logloss: 0.293138	valid_1's auc: 0.909486	valid_1's binary_logloss: 0.314024
[59]	valid_0's auc: 0.926256	valid_0's binary_logloss: 0.2925	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.313904
[60]	valid_0's auc: 0.926556	valid_0's binary_logloss: 0.29195	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314117
[61]	valid_0's auc: 0.926838	valid_0's binary_logloss: 0.291413	valid_1's auc: 0.9093	valid_1's binary_logloss: 0.314325
[62]	valid_0's auc: 0.927068	valid_0's binary_logloss: 0.290952	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314193
[63]	valid_0's auc: 0.927328	valid_0's binary_logloss: 0.290467	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.314056
[64]	valid_0's auc: 0.927659	valid_0's binary_logloss: 0.289899	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.314101
[65]	valid_0's auc: 0.927996	valid_0's binary_logloss: 0.289389	valid_1's auc: 0.909382	valid_1's binary_logloss: 0.314191
[66]	valid_0's auc: 0.928271	valid_0's binary_logloss: 0.288891	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.31411
[67]	valid_0's auc: 0.928532	valid_0's binary_logloss: 0.288415	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.314048
[68]	valid_0's auc: 0.928911	valid_0's binary_logloss: 0.287732	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.313859
[69]	valid_0's auc: 0.929183	valid_0's binary_logloss: 0.287187	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.31389
[70]	valid_0's auc: 0.929476	valid_0's binary_logloss: 0.286642	valid_1's auc: 0.909594	valid_1's binary_logloss: 0.313744
[71]	valid_0's auc: 0.929733	valid_0's binary_logloss: 0.286216	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.313913
[72]	valid_0's auc: 0.929958	valid_0's binary_logloss: 0.285787	valid_1's auc: 0.909478	valid_1's binary_logloss: 0.31394
[73]	valid_0's auc: 0.930232	valid_0's binary_logloss: 0.285307	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.313891
[74]	valid_0's auc: 0.930479	valid_0's binary_logloss: 0.284855	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314013
[75]	valid_0's auc: 0.930786	valid_0's binary_logloss: 0.284295	valid_1's auc: 0.909488	valid_1's binary_logloss: 0.313936
[76]	valid_0's auc: 0.931028	valid_0's binary_logloss: 0.283918	valid_1's auc: 0.909359	valid_1's binary_logloss: 0.31412
[77]	valid_0's auc: 0.931304	valid_0's binary_logloss: 0.283461	valid_1's auc: 0.909315	valid_1's binary_logloss: 0.314221
[78]	valid_0's auc: 0.931657	valid_0's binary_logloss: 0.282878	valid_1's auc: 0.909354	valid_1's binary_logloss: 0.314175
[79]	valid_0's auc: 0.931922	valid_0's binary_logloss: 0.282451	valid_1's auc: 0.909213	valid_1's binary_logloss: 0.314393
[80]	valid_0's auc: 0.932237	valid_0's binary_logloss: 0.281898	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.314307
[81]	valid_0's auc: 0.932473	valid_0's binary_logloss: 0.281482	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.31426
[82]	valid_0's auc: 0.932697	valid_0's binary_logloss: 0.281091	valid_1's auc: 0.909173	valid_1's binary_logloss: 0.314448
[83]	valid_0's auc: 0.932994	valid_0's binary_logloss: 0.280572	valid_1's auc: 0.909056	valid_1's binary_logloss: 0.314624
[84]	valid_0's auc: 0.933242	valid_0's binary_logloss: 0.280173	valid_1's auc: 0.908972	valid_1's binary_logloss: 0.314763
[85]	valid_0's auc: 0.933583	valid_0's binary_logloss: 0.279609	valid_1's auc: 0.908956	valid_1's binary_logloss: 0.31481
[86]	valid_0's auc: 0.933825	valid_0's binary_logloss: 0.279209	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.314884
[87]	valid_0's auc: 0.934027	valid_0's binary_logloss: 0.278833	valid_1's auc: 0.908942	valid_1's binary_logloss: 0.314877
[88]	valid_0's auc: 0.934291	valid_0's binary_logloss: 0.278403	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.314739
[89]	valid_0's auc: 0.93449	valid_0's binary_logloss: 0.278055	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.314726
[90]	valid_0's auc: 0.934723	valid_0's binary_logloss: 0.277683	valid_1's auc: 0.908973	valid_1's binary_logloss: 0.31491
[91]	valid_0's auc: 0.934916	valid_0's binary_logloss: 0.277339	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.315012
[92]	valid_0's auc: 0.935191	valid_0's binary_logloss: 0.276843	valid_1's auc: 0.908766	valid_1's binary_logloss: 0.315262
[93]	valid_0's auc: 0.935446	valid_0's binary_logloss: 0.276388	valid_1's auc: 0.908627	valid_1's binary_logloss: 0.315481
[94]	valid_0's auc: 0.935627	valid_0's binary_logloss: 0.27604	valid_1's auc: 0.908579	valid_1's binary_logloss: 0.315556
[95]	valid_0's auc: 0.935853	valid_0's binary_logloss: 0.275605	valid_1's auc: 0.908453	valid_1's binary_logloss: 0.315754
[96]	valid_0's auc: 0.936023	valid_0's binary_logloss: 0.275277	valid_1's auc: 0.908387	valid_1's binary_logloss: 0.315888
[97]	valid_0's auc: 0.936263	valid_0's binary_logloss: 0.274846	valid_1's auc: 0.90827	valid_1's binary_logloss: 0.316061
[98]	valid_0's auc: 0.936589	valid_0's binary_logloss: 0.274279	valid_1's auc: 0.908374	valid_1's binary_logloss: 0.315873
[99]	valid_0's auc: 0.936808	valid_0's binary_logloss: 0.27384	valid_1's auc: 0.908344	valid_1's binary_logloss: 0.315918
[100]	valid_0's auc: 0.937021	valid_0's binary_logloss: 0.273453	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.3161
[101]	valid_0's auc: 0.937236	valid_0's binary_logloss: 0.273064	valid_1's auc: 0.908234	valid_1's binary_logloss: 0.316164
[102]	valid_0's auc: 0.937404	valid_0's binary_logloss: 0.272751	valid_1's auc: 0.908176	valid_1's binary_logloss: 0.316287
[103]	valid_0's auc: 0.937575	valid_0's binary_logloss: 0.272407	valid_1's auc: 0.908033	valid_1's binary_logloss: 0.316594
[104]	valid_0's auc: 0.937762	valid_0's binary_logloss: 0.272079	valid_1's auc: 0.907979	valid_1's binary_logloss: 0.316706
[105]	valid_0's auc: 0.938052	valid_0's binary_logloss: 0.271611	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.316861
[106]	valid_0's auc: 0.938267	valid_0's binary_logloss: 0.27123	valid_1's auc: 0.90784	valid_1's binary_logloss: 0.316963
[107]	valid_0's auc: 0.938475	valid_0's binary_logloss: 0.270835	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.316896
[108]	valid_0's auc: 0.938695	valid_0's binary_logloss: 0.270455	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.316917
[109]	valid_0's auc: 0.938868	valid_0's binary_logloss: 0.270141	valid_1's auc: 0.907836	valid_1's binary_logloss: 0.31705
[110]	valid_0's auc: 0.939071	valid_0's binary_logloss: 0.269768	valid_1's auc: 0.907769	valid_1's binary_logloss: 0.317145
[111]	valid_0's auc: 0.939225	valid_0's binary_logloss: 0.269451	valid_1's auc: 0.907782	valid_1's binary_logloss: 0.317161
[112]	valid_0's auc: 0.939425	valid_0's binary_logloss: 0.269074	valid_1's auc: 0.907655	valid_1's binary_logloss: 0.317314
[113]	valid_0's auc: 0.939668	valid_0's binary_logloss: 0.268643	valid_1's auc: 0.907652	valid_1's binary_logloss: 0.317315
[114]	valid_0's auc: 0.939934	valid_0's binary_logloss: 0.268188	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.31749
[115]	valid_0's auc: 0.940061	valid_0's binary_logloss: 0.267929	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.317527
[116]	valid_0's auc: 0.94023	valid_0's binary_logloss: 0.267642	valid_1's auc: 0.907476	valid_1's binary_logloss: 0.317678
[117]	valid_0's auc: 0.940464	valid_0's binary_logloss: 0.267239	valid_1's auc: 0.907411	valid_1's binary_logloss: 0.317776
[118]	valid_0's auc: 0.940665	valid_0's binary_logloss: 0.266843	valid_1's auc: 0.907343	valid_1's binary_logloss: 0.317928
[119]	valid_0's auc: 0.940885	valid_0's binary_logloss: 0.266458	valid_1's auc: 0.907185	valid_1's binary_logloss: 0.318152
[120]	valid_0's auc: 0.941087	valid_0's binary_logloss: 0.266089	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318332
[121]	valid_0's auc: 0.941241	valid_0's binary_logloss: 0.265795	valid_1's auc: 0.907066	valid_1's binary_logloss: 0.318384
[122]	valid_0's auc: 0.941424	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.907017	valid_1's binary_logloss: 0.318467
[123]	valid_0's auc: 0.941646	valid_0's binary_logloss: 0.265083	valid_1's auc: 0.90695	valid_1's binary_logloss: 0.318594
[124]	valid_0's auc: 0.941814	valid_0's binary_logloss: 0.264777	valid_1's auc: 0.906879	valid_1's binary_logloss: 0.318756
[125]	valid_0's auc: 0.941942	valid_0's binary_logloss: 0.264522	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.318853
[126]	valid_0's auc: 0.942099	valid_0's binary_logloss: 0.264213	valid_1's auc: 0.906809	valid_1's binary_logloss: 0.318916
[127]	valid_0's auc: 0.942305	valid_0's binary_logloss: 0.263835	valid_1's auc: 0.906814	valid_1's binary_logloss: 0.318912
[128]	valid_0's auc: 0.942509	valid_0's binary_logloss: 0.263478	valid_1's auc: 0.906636	valid_1's binary_logloss: 0.319161
[129]	valid_0's auc: 0.942745	valid_0's binary_logloss: 0.26304	valid_1's auc: 0.906664	valid_1's binary_logloss: 0.319119
Early stopping, best iteration is:
[29]	valid_0's auc: 0.91458	valid_0's binary_logloss: 0.317387	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.318551
[1]	valid_0's auc: 0.88881	valid_0's binary_logloss: 0.516633	valid_1's auc: 0.897809	valid_1's binary_logloss: 0.50731
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8922	valid_0's binary_logloss: 0.487561	valid_1's auc: 0.899925	valid_1's binary_logloss: 0.477157
[3]	valid_0's auc: 0.892838	valid_0's binary_logloss: 0.464389	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.453152
[4]	valid_0's auc: 0.894608	valid_0's binary_logloss: 0.444961	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.434111
[5]	valid_0's auc: 0.895384	valid_0's binary_logloss: 0.428899	valid_1's auc: 0.901607	valid_1's binary_logloss: 0.41839
[6]	valid_0's auc: 0.895814	valid_0's binary_logloss: 0.415402	valid_1's auc: 0.901971	valid_1's binary_logloss: 0.404739
[7]	valid_0's auc: 0.897179	valid_0's binary_logloss: 0.403646	valid_1's auc: 0.902712	valid_1's binary_logloss: 0.393451
[8]	valid_0's auc: 0.90014	valid_0's binary_logloss: 0.393717	valid_1's auc: 0.904509	valid_1's binary_logloss: 0.383777
[9]	valid_0's auc: 0.901656	valid_0's binary_logloss: 0.384637	valid_1's auc: 0.905082	valid_1's binary_logloss: 0.375071
[10]	valid_0's auc: 0.902441	valid_0's binary_logloss: 0.376979	valid_1's auc: 0.905389	valid_1's binary_logloss: 0.36779
[11]	valid_0's auc: 0.903086	valid_0's binary_logloss: 0.37018	valid_1's auc: 0.905722	valid_1's binary_logloss: 0.361222
[12]	valid_0's auc: 0.903811	valid_0's binary_logloss: 0.364179	valid_1's auc: 0.905739	valid_1's binary_logloss: 0.355887
[13]	valid_0's auc: 0.904555	valid_0's binary_logloss: 0.359017	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.3513
[14]	valid_0's auc: 0.905441	valid_0's binary_logloss: 0.35414	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.347227
[15]	valid_0's auc: 0.906121	valid_0's binary_logloss: 0.349903	valid_1's auc: 0.90617	valid_1's binary_logloss: 0.343705
[16]	valid_0's auc: 0.906823	valid_0's binary_logloss: 0.346182	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.340575
[17]	valid_0's auc: 0.907614	valid_0's binary_logloss: 0.34265	valid_1's auc: 0.906788	valid_1's binary_logloss: 0.337415
[18]	valid_0's auc: 0.908426	valid_0's binary_logloss: 0.33935	valid_1's auc: 0.907223	valid_1's binary_logloss: 0.334649
[19]	valid_0's auc: 0.909009	valid_0's binary_logloss: 0.336509	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.332519
[20]	valid_0's auc: 0.909682	valid_0's binary_logloss: 0.333891	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.330522
[21]	valid_0's auc: 0.91025	valid_0's binary_logloss: 0.331419	valid_1's auc: 0.908052	valid_1's binary_logloss: 0.328532
[22]	valid_0's auc: 0.910958	valid_0's binary_logloss: 0.329117	valid_1's auc: 0.908118	valid_1's binary_logloss: 0.32705
[23]	valid_0's auc: 0.911613	valid_0's binary_logloss: 0.326873	valid_1's auc: 0.908194	valid_1's binary_logloss: 0.325687
[24]	valid_0's auc: 0.91224	valid_0's binary_logloss: 0.324827	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.324184
[25]	valid_0's auc: 0.912772	valid_0's binary_logloss: 0.323042	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.322854
[26]	valid_0's auc: 0.913317	valid_0's binary_logloss: 0.321309	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.321876
[27]	valid_0's auc: 0.913764	valid_0's binary_logloss: 0.319778	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.321042
[28]	valid_0's auc: 0.914355	valid_0's binary_logloss: 0.318165	valid_1's auc: 0.909178	valid_1's binary_logloss: 0.32025
[29]	valid_0's auc: 0.914967	valid_0's binary_logloss: 0.31668	valid_1's auc: 0.909198	valid_1's binary_logloss: 0.319711
[30]	valid_0's auc: 0.915458	valid_0's binary_logloss: 0.315289	valid_1's auc: 0.909082	valid_1's binary_logloss: 0.319336
[31]	valid_0's auc: 0.915871	valid_0's binary_logloss: 0.314121	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.319009
[32]	valid_0's auc: 0.916316	valid_0's binary_logloss: 0.312853	valid_1's auc: 0.909285	valid_1's binary_logloss: 0.318051
[33]	valid_0's auc: 0.916767	valid_0's binary_logloss: 0.311725	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.317608
[34]	valid_0's auc: 0.917282	valid_0's binary_logloss: 0.310574	valid_1's auc: 0.90946	valid_1's binary_logloss: 0.317193
[35]	valid_0's auc: 0.917684	valid_0's binary_logloss: 0.309568	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.316867
[36]	valid_0's auc: 0.918036	valid_0's binary_logloss: 0.308643	valid_1's auc: 0.909626	valid_1's binary_logloss: 0.316435
[37]	valid_0's auc: 0.918488	valid_0's binary_logloss: 0.307682	valid_1's auc: 0.909497	valid_1's binary_logloss: 0.316373
[38]	valid_0's auc: 0.919017	valid_0's binary_logloss: 0.306611	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.316163
[39]	valid_0's auc: 0.919405	valid_0's binary_logloss: 0.305691	valid_1's auc: 0.909674	valid_1's binary_logloss: 0.315708
[40]	valid_0's auc: 0.919814	valid_0's binary_logloss: 0.30487	valid_1's auc: 0.909625	valid_1's binary_logloss: 0.315659
[41]	valid_0's auc: 0.920185	valid_0's binary_logloss: 0.304075	valid_1's auc: 0.909717	valid_1's binary_logloss: 0.315348
[42]	valid_0's auc: 0.92057	valid_0's binary_logloss: 0.303237	valid_1's auc: 0.909727	valid_1's binary_logloss: 0.315184
[43]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.302339	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.31495
[44]	valid_0's auc: 0.9214	valid_0's binary_logloss: 0.301613	valid_1's auc: 0.909712	valid_1's binary_logloss: 0.315002
[45]	valid_0's auc: 0.921786	valid_0's binary_logloss: 0.300824	valid_1's auc: 0.90972	valid_1's binary_logloss: 0.314874
[46]	valid_0's auc: 0.922118	valid_0's binary_logloss: 0.300144	valid_1's auc: 0.909706	valid_1's binary_logloss: 0.314801
[47]	valid_0's auc: 0.922511	valid_0's binary_logloss: 0.299368	valid_1's auc: 0.909677	valid_1's binary_logloss: 0.314736
[48]	valid_0's auc: 0.922848	valid_0's binary_logloss: 0.298732	valid_1's auc: 0.909645	valid_1's binary_logloss: 0.314741
[49]	valid_0's auc: 0.923199	valid_0's binary_logloss: 0.298057	valid_1's auc: 0.90953	valid_1's binary_logloss: 0.314827
[50]	valid_0's auc: 0.923638	valid_0's binary_logloss: 0.297224	valid_1's auc: 0.909597	valid_1's binary_logloss: 0.314729
[51]	valid_0's auc: 0.923936	valid_0's binary_logloss: 0.296631	valid_1's auc: 0.909583	valid_1's binary_logloss: 0.314696
[52]	valid_0's auc: 0.924277	valid_0's binary_logloss: 0.296005	valid_1's auc: 0.909579	valid_1's binary_logloss: 0.314709
[53]	valid_0's auc: 0.924534	valid_0's binary_logloss: 0.295488	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.3148
[54]	valid_0's auc: 0.924896	valid_0's binary_logloss: 0.29488	valid_1's auc: 0.909502	valid_1's binary_logloss: 0.314724
[55]	valid_0's auc: 0.925282	valid_0's binary_logloss: 0.294206	valid_1's auc: 0.909327	valid_1's binary_logloss: 0.314906
[56]	valid_0's auc: 0.925615	valid_0's binary_logloss: 0.293588	valid_1's auc: 0.909402	valid_1's binary_logloss: 0.314797
[57]	valid_0's auc: 0.925884	valid_0's binary_logloss: 0.293082	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314977
[58]	valid_0's auc: 0.926221	valid_0's binary_logloss: 0.292493	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.31501
[59]	valid_0's auc: 0.926498	valid_0's binary_logloss: 0.291955	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.315108
[60]	valid_0's auc: 0.926801	valid_0's binary_logloss: 0.2914	valid_1's auc: 0.909139	valid_1's binary_logloss: 0.315076
[61]	valid_0's auc: 0.927129	valid_0's binary_logloss: 0.290854	valid_1's auc: 0.90919	valid_1's binary_logloss: 0.315078
[62]	valid_0's auc: 0.927448	valid_0's binary_logloss: 0.290236	valid_1's auc: 0.909235	valid_1's binary_logloss: 0.31503
[63]	valid_0's auc: 0.927722	valid_0's binary_logloss: 0.289723	valid_1's auc: 0.909197	valid_1's binary_logloss: 0.31504
[64]	valid_0's auc: 0.928061	valid_0's binary_logloss: 0.289121	valid_1's auc: 0.909369	valid_1's binary_logloss: 0.314817
[65]	valid_0's auc: 0.928336	valid_0's binary_logloss: 0.288633	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.315117
[66]	valid_0's auc: 0.928674	valid_0's binary_logloss: 0.28806	valid_1's auc: 0.909014	valid_1's binary_logloss: 0.315391
[67]	valid_0's auc: 0.928948	valid_0's binary_logloss: 0.287599	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.315494
[68]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.287166	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.315648
[69]	valid_0's auc: 0.929538	valid_0's binary_logloss: 0.286581	valid_1's auc: 0.908742	valid_1's binary_logloss: 0.315751
[70]	valid_0's auc: 0.929806	valid_0's binary_logloss: 0.286124	valid_1's auc: 0.908809	valid_1's binary_logloss: 0.315658
[71]	valid_0's auc: 0.930079	valid_0's binary_logloss: 0.285651	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.315707
[72]	valid_0's auc: 0.930367	valid_0's binary_logloss: 0.285162	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.315704
[73]	valid_0's auc: 0.930605	valid_0's binary_logloss: 0.284717	valid_1's auc: 0.908789	valid_1's binary_logloss: 0.315651
[74]	valid_0's auc: 0.93084	valid_0's binary_logloss: 0.284267	valid_1's auc: 0.908655	valid_1's binary_logloss: 0.315831
[75]	valid_0's auc: 0.931049	valid_0's binary_logloss: 0.283852	valid_1's auc: 0.908599	valid_1's binary_logloss: 0.315982
[76]	valid_0's auc: 0.931391	valid_0's binary_logloss: 0.28329	valid_1's auc: 0.90852	valid_1's binary_logloss: 0.316132
[77]	valid_0's auc: 0.931717	valid_0's binary_logloss: 0.282759	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.316203
[78]	valid_0's auc: 0.931964	valid_0's binary_logloss: 0.282305	valid_1's auc: 0.908302	valid_1's binary_logloss: 0.316447
[79]	valid_0's auc: 0.932224	valid_0's binary_logloss: 0.281838	valid_1's auc: 0.908347	valid_1's binary_logloss: 0.316388
[80]	valid_0's auc: 0.932514	valid_0's binary_logloss: 0.281322	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316285
[81]	valid_0's auc: 0.93284	valid_0's binary_logloss: 0.280793	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.316509
[82]	valid_0's auc: 0.933068	valid_0's binary_logloss: 0.280385	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.316732
[83]	valid_0's auc: 0.933362	valid_0's binary_logloss: 0.279887	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.316946
[84]	valid_0's auc: 0.93357	valid_0's binary_logloss: 0.279488	valid_1's auc: 0.907954	valid_1's binary_logloss: 0.31692
[85]	valid_0's auc: 0.933829	valid_0's binary_logloss: 0.279028	valid_1's auc: 0.907928	valid_1's binary_logloss: 0.316991
[86]	valid_0's auc: 0.934137	valid_0's binary_logloss: 0.278524	valid_1's auc: 0.907857	valid_1's binary_logloss: 0.317128
[87]	valid_0's auc: 0.934366	valid_0's binary_logloss: 0.278118	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.317074
[88]	valid_0's auc: 0.934575	valid_0's binary_logloss: 0.277737	valid_1's auc: 0.907939	valid_1's binary_logloss: 0.317018
[89]	valid_0's auc: 0.934773	valid_0's binary_logloss: 0.277396	valid_1's auc: 0.907789	valid_1's binary_logloss: 0.317257
[90]	valid_0's auc: 0.935028	valid_0's binary_logloss: 0.276944	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317253
[91]	valid_0's auc: 0.935288	valid_0's binary_logloss: 0.276502	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317586
[92]	valid_0's auc: 0.935411	valid_0's binary_logloss: 0.276224	valid_1's auc: 0.907537	valid_1's binary_logloss: 0.317742
[93]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275785	valid_1's auc: 0.907584	valid_1's binary_logloss: 0.31774
[94]	valid_0's auc: 0.935938	valid_0's binary_logloss: 0.275321	valid_1's auc: 0.907536	valid_1's binary_logloss: 0.317805
[95]	valid_0's auc: 0.936159	valid_0's binary_logloss: 0.274923	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.317766
[96]	valid_0's auc: 0.936404	valid_0's binary_logloss: 0.274511	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.318049
[97]	valid_0's auc: 0.936703	valid_0's binary_logloss: 0.273998	valid_1's auc: 0.907371	valid_1's binary_logloss: 0.318079
[98]	valid_0's auc: 0.936922	valid_0's binary_logloss: 0.273559	valid_1's auc: 0.907327	valid_1's binary_logloss: 0.318158
[99]	valid_0's auc: 0.93717	valid_0's binary_logloss: 0.273123	valid_1's auc: 0.907351	valid_1's binary_logloss: 0.318142
[100]	valid_0's auc: 0.937372	valid_0's binary_logloss: 0.272752	valid_1's auc: 0.907468	valid_1's binary_logloss: 0.31796
[101]	valid_0's auc: 0.937702	valid_0's binary_logloss: 0.272134	valid_1's auc: 0.907259	valid_1's binary_logloss: 0.318301
[102]	valid_0's auc: 0.938007	valid_0's binary_logloss: 0.271624	valid_1's auc: 0.907237	valid_1's binary_logloss: 0.318397
[103]	valid_0's auc: 0.9382	valid_0's binary_logloss: 0.271235	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.318405
[104]	valid_0's auc: 0.938422	valid_0's binary_logloss: 0.270813	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.318585
[105]	valid_0's auc: 0.93862	valid_0's binary_logloss: 0.270448	valid_1's auc: 0.907055	valid_1's binary_logloss: 0.318748
[106]	valid_0's auc: 0.93882	valid_0's binary_logloss: 0.270102	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318759
[107]	valid_0's auc: 0.939099	valid_0's binary_logloss: 0.269599	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.318745
[108]	valid_0's auc: 0.93929	valid_0's binary_logloss: 0.269246	valid_1's auc: 0.907109	valid_1's binary_logloss: 0.318695
[109]	valid_0's auc: 0.939562	valid_0's binary_logloss: 0.268798	valid_1's auc: 0.906976	valid_1's binary_logloss: 0.318929
[110]	valid_0's auc: 0.939737	valid_0's binary_logloss: 0.268484	valid_1's auc: 0.906965	valid_1's binary_logloss: 0.318969
[111]	valid_0's auc: 0.939932	valid_0's binary_logloss: 0.268109	valid_1's auc: 0.906893	valid_1's binary_logloss: 0.319126
[112]	valid_0's auc: 0.940125	valid_0's binary_logloss: 0.267751	valid_1's auc: 0.906876	valid_1's binary_logloss: 0.319195
[113]	valid_0's auc: 0.940263	valid_0's binary_logloss: 0.267452	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319447
[114]	valid_0's auc: 0.940529	valid_0's binary_logloss: 0.266992	valid_1's auc: 0.906635	valid_1's binary_logloss: 0.319687
[115]	valid_0's auc: 0.940778	valid_0's binary_logloss: 0.266548	valid_1's auc: 0.906566	valid_1's binary_logloss: 0.319841
[116]	valid_0's auc: 0.940958	valid_0's binary_logloss: 0.266222	valid_1's auc: 0.906504	valid_1's binary_logloss: 0.319936
[117]	valid_0's auc: 0.941239	valid_0's binary_logloss: 0.265732	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.320015
[118]	valid_0's auc: 0.941438	valid_0's binary_logloss: 0.265351	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.319969
[119]	valid_0's auc: 0.941656	valid_0's binary_logloss: 0.264966	valid_1's auc: 0.906507	valid_1's binary_logloss: 0.320042
[120]	valid_0's auc: 0.941811	valid_0's binary_logloss: 0.264654	valid_1's auc: 0.906393	valid_1's binary_logloss: 0.32022
[121]	valid_0's auc: 0.941983	valid_0's binary_logloss: 0.264341	valid_1's auc: 0.906441	valid_1's binary_logloss: 0.320189
[122]	valid_0's auc: 0.942262	valid_0's binary_logloss: 0.263904	valid_1's auc: 0.906383	valid_1's binary_logloss: 0.320273
[123]	valid_0's auc: 0.94246	valid_0's binary_logloss: 0.263555	valid_1's auc: 0.906349	valid_1's binary_logloss: 0.320357
[124]	valid_0's auc: 0.942595	valid_0's binary_logloss: 0.263283	valid_1's auc: 0.906354	valid_1's binary_logloss: 0.320357
[125]	valid_0's auc: 0.942771	valid_0's binary_logloss: 0.262981	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.32045
[126]	valid_0's auc: 0.94292	valid_0's binary_logloss: 0.262704	valid_1's auc: 0.906219	valid_1's binary_logloss: 0.320591
[127]	valid_0's auc: 0.943078	valid_0's binary_logloss: 0.262411	valid_1's auc: 0.906271	valid_1's binary_logloss: 0.320521
[128]	valid_0's auc: 0.943241	valid_0's binary_logloss: 0.2621	valid_1's auc: 0.906213	valid_1's binary_logloss: 0.320628
[129]	valid_0's auc: 0.94337	valid_0's binary_logloss: 0.261843	valid_1's auc: 0.906182	valid_1's binary_logloss: 0.32075
[130]	valid_0's auc: 0.943527	valid_0's binary_logloss: 0.261537	valid_1's auc: 0.906135	valid_1's binary_logloss: 0.320819
[131]	valid_0's auc: 0.9438	valid_0's binary_logloss: 0.261085	valid_1's auc: 0.906121	valid_1's binary_logloss: 0.320864
[132]	valid_0's auc: 0.94401	valid_0's binary_logloss: 0.260673	valid_1's auc: 0.90607	valid_1's binary_logloss: 0.320997
[133]	valid_0's auc: 0.944163	valid_0's binary_logloss: 0.260385	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.321112
[134]	valid_0's auc: 0.944265	valid_0's binary_logloss: 0.260167	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.321239
[135]	valid_0's auc: 0.944549	valid_0's binary_logloss: 0.259695	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.321268
[136]	valid_0's auc: 0.944696	valid_0's binary_logloss: 0.259433	valid_1's auc: 0.905947	valid_1's binary_logloss: 0.321239
[137]	valid_0's auc: 0.944838	valid_0's binary_logloss: 0.259173	valid_1's auc: 0.905946	valid_1's binary_logloss: 0.32125
[138]	valid_0's auc: 0.945025	valid_0's binary_logloss: 0.258826	valid_1's auc: 0.905968	valid_1's binary_logloss: 0.321236
[139]	valid_0's auc: 0.945201	valid_0's binary_logloss: 0.258505	valid_1's auc: 0.90594	valid_1's binary_logloss: 0.321337
[140]	valid_0's auc: 0.945331	valid_0's binary_logloss: 0.258233	valid_1's auc: 0.905804	valid_1's binary_logloss: 0.321582
[141]	valid_0's auc: 0.945428	valid_0's binary_logloss: 0.258017	valid_1's auc: 0.905814	valid_1's binary_logloss: 0.321651
[142]	valid_0's auc: 0.945565	valid_0's binary_logloss: 0.257733	valid_1's auc: 0.905769	valid_1's binary_logloss: 0.321746
[143]	valid_0's auc: 0.945741	valid_0's binary_logloss: 0.257369	valid_1's auc: 0.905745	valid_1's binary_logloss: 0.321757
Early stopping, best iteration is:
[43]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.302339	valid_1's auc: 0.909837	valid_1's binary_logloss: 0.31495
[1]	valid_0's auc: 0.887249	valid_0's binary_logloss: 0.517046	valid_1's auc: 0.892969	valid_1's binary_logloss: 0.508431
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889524	valid_0's binary_logloss: 0.488088	valid_1's auc: 0.89592	valid_1's binary_logloss: 0.478873
[3]	valid_0's auc: 0.891571	valid_0's binary_logloss: 0.464744	valid_1's auc: 0.896177	valid_1's binary_logloss: 0.455472
[4]	valid_0's auc: 0.893868	valid_0's binary_logloss: 0.445249	valid_1's auc: 0.897585	valid_1's binary_logloss: 0.43623
[5]	valid_0's auc: 0.897186	valid_0's binary_logloss: 0.429114	valid_1's auc: 0.900745	valid_1's binary_logloss: 0.419804
[6]	valid_0's auc: 0.898078	valid_0's binary_logloss: 0.415466	valid_1's auc: 0.901242	valid_1's binary_logloss: 0.406401
[7]	valid_0's auc: 0.899398	valid_0's binary_logloss: 0.403794	valid_1's auc: 0.90246	valid_1's binary_logloss: 0.394732
[8]	valid_0's auc: 0.900616	valid_0's binary_logloss: 0.393732	valid_1's auc: 0.902926	valid_1's binary_logloss: 0.385104
[9]	valid_0's auc: 0.901282	valid_0's binary_logloss: 0.384962	valid_1's auc: 0.903761	valid_1's binary_logloss: 0.376423
[10]	valid_0's auc: 0.902116	valid_0's binary_logloss: 0.377268	valid_1's auc: 0.903857	valid_1's binary_logloss: 0.369348
[11]	valid_0's auc: 0.902911	valid_0's binary_logloss: 0.370559	valid_1's auc: 0.90371	valid_1's binary_logloss: 0.36337
[12]	valid_0's auc: 0.903892	valid_0's binary_logloss: 0.364523	valid_1's auc: 0.904465	valid_1's binary_logloss: 0.357744
[13]	valid_0's auc: 0.904864	valid_0's binary_logloss: 0.359224	valid_1's auc: 0.904853	valid_1's binary_logloss: 0.352978
[14]	valid_0's auc: 0.905535	valid_0's binary_logloss: 0.354517	valid_1's auc: 0.905195	valid_1's binary_logloss: 0.348745
[15]	valid_0's auc: 0.906247	valid_0's binary_logloss: 0.350292	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.345032
[16]	valid_0's auc: 0.906797	valid_0's binary_logloss: 0.346472	valid_1's auc: 0.905953	valid_1's binary_logloss: 0.341776
[17]	valid_0's auc: 0.907358	valid_0's binary_logloss: 0.343123	valid_1's auc: 0.906447	valid_1's binary_logloss: 0.338822
[18]	valid_0's auc: 0.908033	valid_0's binary_logloss: 0.339924	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336244
[19]	valid_0's auc: 0.9089	valid_0's binary_logloss: 0.336963	valid_1's auc: 0.906867	valid_1's binary_logloss: 0.334193
[20]	valid_0's auc: 0.909369	valid_0's binary_logloss: 0.334443	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.332105
[21]	valid_0's auc: 0.91003	valid_0's binary_logloss: 0.331985	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.330663
[22]	valid_0's auc: 0.910864	valid_0's binary_logloss: 0.329506	valid_1's auc: 0.907514	valid_1's binary_logloss: 0.328727
[23]	valid_0's auc: 0.91153	valid_0's binary_logloss: 0.327413	valid_1's auc: 0.907514	valid_1's binary_logloss: 0.327412
[24]	valid_0's auc: 0.912029	valid_0's binary_logloss: 0.325525	valid_1's auc: 0.907583	valid_1's binary_logloss: 0.326119
[25]	valid_0's auc: 0.912589	valid_0's binary_logloss: 0.323625	valid_1's auc: 0.907585	valid_1's binary_logloss: 0.324985
[26]	valid_0's auc: 0.913172	valid_0's binary_logloss: 0.321842	valid_1's auc: 0.907685	valid_1's binary_logloss: 0.323969
[27]	valid_0's auc: 0.913746	valid_0's binary_logloss: 0.320211	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.323003
[28]	valid_0's auc: 0.914191	valid_0's binary_logloss: 0.318789	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.321984
[29]	valid_0's auc: 0.914635	valid_0's binary_logloss: 0.317378	valid_1's auc: 0.908298	valid_1's binary_logloss: 0.321147
[30]	valid_0's auc: 0.915102	valid_0's binary_logloss: 0.316046	valid_1's auc: 0.908386	valid_1's binary_logloss: 0.320581
[31]	valid_0's auc: 0.915569	valid_0's binary_logloss: 0.314739	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.319825
[32]	valid_0's auc: 0.916028	valid_0's binary_logloss: 0.313492	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.319562
[33]	valid_0's auc: 0.916594	valid_0's binary_logloss: 0.312253	valid_1's auc: 0.908586	valid_1's binary_logloss: 0.319131
[34]	valid_0's auc: 0.917079	valid_0's binary_logloss: 0.311062	valid_1's auc: 0.908472	valid_1's binary_logloss: 0.318884
[35]	valid_0's auc: 0.917491	valid_0's binary_logloss: 0.31004	valid_1's auc: 0.908461	valid_1's binary_logloss: 0.318572
[36]	valid_0's auc: 0.917947	valid_0's binary_logloss: 0.309001	valid_1's auc: 0.908416	valid_1's binary_logloss: 0.31842
[37]	valid_0's auc: 0.918376	valid_0's binary_logloss: 0.308021	valid_1's auc: 0.908447	valid_1's binary_logloss: 0.318117
[38]	valid_0's auc: 0.918778	valid_0's binary_logloss: 0.307141	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.317916
[39]	valid_0's auc: 0.919223	valid_0's binary_logloss: 0.306216	valid_1's auc: 0.908337	valid_1's binary_logloss: 0.31792
[40]	valid_0's auc: 0.919764	valid_0's binary_logloss: 0.305128	valid_1's auc: 0.908408	valid_1's binary_logloss: 0.317682
[41]	valid_0's auc: 0.920187	valid_0's binary_logloss: 0.304281	valid_1's auc: 0.908306	valid_1's binary_logloss: 0.317646
[42]	valid_0's auc: 0.920619	valid_0's binary_logloss: 0.303442	valid_1's auc: 0.908257	valid_1's binary_logloss: 0.317622
[43]	valid_0's auc: 0.92102	valid_0's binary_logloss: 0.30262	valid_1's auc: 0.908354	valid_1's binary_logloss: 0.317389
[44]	valid_0's auc: 0.921413	valid_0's binary_logloss: 0.301836	valid_1's auc: 0.908264	valid_1's binary_logloss: 0.317424
[45]	valid_0's auc: 0.921785	valid_0's binary_logloss: 0.301061	valid_1's auc: 0.908129	valid_1's binary_logloss: 0.317502
[46]	valid_0's auc: 0.922198	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.907953	valid_1's binary_logloss: 0.317659
[47]	valid_0's auc: 0.922522	valid_0's binary_logloss: 0.29963	valid_1's auc: 0.907836	valid_1's binary_logloss: 0.317775
[48]	valid_0's auc: 0.922842	valid_0's binary_logloss: 0.298974	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.317593
[49]	valid_0's auc: 0.923167	valid_0's binary_logloss: 0.298346	valid_1's auc: 0.907913	valid_1's binary_logloss: 0.317495
[50]	valid_0's auc: 0.923535	valid_0's binary_logloss: 0.297701	valid_1's auc: 0.907892	valid_1's binary_logloss: 0.317408
[51]	valid_0's auc: 0.923894	valid_0's binary_logloss: 0.296975	valid_1's auc: 0.907848	valid_1's binary_logloss: 0.317438
[52]	valid_0's auc: 0.92424	valid_0's binary_logloss: 0.29636	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.317333
[53]	valid_0's auc: 0.924484	valid_0's binary_logloss: 0.295875	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317304
[54]	valid_0's auc: 0.924733	valid_0's binary_logloss: 0.29536	valid_1's auc: 0.907977	valid_1's binary_logloss: 0.3171
[55]	valid_0's auc: 0.925043	valid_0's binary_logloss: 0.294791	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317305
[56]	valid_0's auc: 0.925485	valid_0's binary_logloss: 0.294096	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.317587
[57]	valid_0's auc: 0.925858	valid_0's binary_logloss: 0.293445	valid_1's auc: 0.907598	valid_1's binary_logloss: 0.317677
[58]	valid_0's auc: 0.926244	valid_0's binary_logloss: 0.292757	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318083
[59]	valid_0's auc: 0.926466	valid_0's binary_logloss: 0.292343	valid_1's auc: 0.907328	valid_1's binary_logloss: 0.318147
[60]	valid_0's auc: 0.926805	valid_0's binary_logloss: 0.291707	valid_1's auc: 0.907261	valid_1's binary_logloss: 0.318239
[61]	valid_0's auc: 0.927157	valid_0's binary_logloss: 0.291072	valid_1's auc: 0.907276	valid_1's binary_logloss: 0.318247
[62]	valid_0's auc: 0.927457	valid_0's binary_logloss: 0.290536	valid_1's auc: 0.907204	valid_1's binary_logloss: 0.31833
[63]	valid_0's auc: 0.927778	valid_0's binary_logloss: 0.29	valid_1's auc: 0.907153	valid_1's binary_logloss: 0.318433
[64]	valid_0's auc: 0.928021	valid_0's binary_logloss: 0.289569	valid_1's auc: 0.907204	valid_1's binary_logloss: 0.318313
[65]	valid_0's auc: 0.928289	valid_0's binary_logloss: 0.28909	valid_1's auc: 0.907165	valid_1's binary_logloss: 0.318377
[66]	valid_0's auc: 0.928527	valid_0's binary_logloss: 0.288646	valid_1's auc: 0.907113	valid_1's binary_logloss: 0.318475
[67]	valid_0's auc: 0.928883	valid_0's binary_logloss: 0.288029	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.318526
[68]	valid_0's auc: 0.929201	valid_0's binary_logloss: 0.287495	valid_1's auc: 0.907197	valid_1's binary_logloss: 0.318388
[69]	valid_0's auc: 0.929378	valid_0's binary_logloss: 0.28713	valid_1's auc: 0.907093	valid_1's binary_logloss: 0.318533
[70]	valid_0's auc: 0.929657	valid_0's binary_logloss: 0.28662	valid_1's auc: 0.907128	valid_1's binary_logloss: 0.318459
[71]	valid_0's auc: 0.929939	valid_0's binary_logloss: 0.286099	valid_1's auc: 0.907052	valid_1's binary_logloss: 0.318615
[72]	valid_0's auc: 0.930105	valid_0's binary_logloss: 0.285756	valid_1's auc: 0.906992	valid_1's binary_logloss: 0.318671
[73]	valid_0's auc: 0.930351	valid_0's binary_logloss: 0.285297	valid_1's auc: 0.907029	valid_1's binary_logloss: 0.318652
[74]	valid_0's auc: 0.930753	valid_0's binary_logloss: 0.284593	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.318807
[75]	valid_0's auc: 0.931083	valid_0's binary_logloss: 0.283957	valid_1's auc: 0.906993	valid_1's binary_logloss: 0.318769
[76]	valid_0's auc: 0.93129	valid_0's binary_logloss: 0.283581	valid_1's auc: 0.907011	valid_1's binary_logloss: 0.318765
[77]	valid_0's auc: 0.931541	valid_0's binary_logloss: 0.283098	valid_1's auc: 0.906906	valid_1's binary_logloss: 0.318964
[78]	valid_0's auc: 0.93177	valid_0's binary_logloss: 0.282639	valid_1's auc: 0.906962	valid_1's binary_logloss: 0.318893
[79]	valid_0's auc: 0.931994	valid_0's binary_logloss: 0.282236	valid_1's auc: 0.906909	valid_1's binary_logloss: 0.319021
[80]	valid_0's auc: 0.932235	valid_0's binary_logloss: 0.281793	valid_1's auc: 0.906833	valid_1's binary_logloss: 0.319153
[81]	valid_0's auc: 0.932496	valid_0's binary_logloss: 0.281291	valid_1's auc: 0.906745	valid_1's binary_logloss: 0.319332
[82]	valid_0's auc: 0.932766	valid_0's binary_logloss: 0.280841	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.319648
[83]	valid_0's auc: 0.932936	valid_0's binary_logloss: 0.280509	valid_1's auc: 0.906471	valid_1's binary_logloss: 0.31982
[84]	valid_0's auc: 0.93312	valid_0's binary_logloss: 0.280145	valid_1's auc: 0.906445	valid_1's binary_logloss: 0.319862
[85]	valid_0's auc: 0.933416	valid_0's binary_logloss: 0.279623	valid_1's auc: 0.906433	valid_1's binary_logloss: 0.319932
[86]	valid_0's auc: 0.933677	valid_0's binary_logloss: 0.279153	valid_1's auc: 0.906345	valid_1's binary_logloss: 0.320058
[87]	valid_0's auc: 0.933857	valid_0's binary_logloss: 0.278851	valid_1's auc: 0.906317	valid_1's binary_logloss: 0.320158
[88]	valid_0's auc: 0.934071	valid_0's binary_logloss: 0.278446	valid_1's auc: 0.906246	valid_1's binary_logloss: 0.320301
[89]	valid_0's auc: 0.934244	valid_0's binary_logloss: 0.278142	valid_1's auc: 0.906318	valid_1's binary_logloss: 0.320252
[90]	valid_0's auc: 0.934521	valid_0's binary_logloss: 0.277663	valid_1's auc: 0.906273	valid_1's binary_logloss: 0.320315
[91]	valid_0's auc: 0.934765	valid_0's binary_logloss: 0.277222	valid_1's auc: 0.906145	valid_1's binary_logloss: 0.320584
[92]	valid_0's auc: 0.935087	valid_0's binary_logloss: 0.27669	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320408
[93]	valid_0's auc: 0.93527	valid_0's binary_logloss: 0.27635	valid_1's auc: 0.906217	valid_1's binary_logloss: 0.320422
[94]	valid_0's auc: 0.935554	valid_0's binary_logloss: 0.275829	valid_1's auc: 0.90619	valid_1's binary_logloss: 0.320544
[95]	valid_0's auc: 0.935826	valid_0's binary_logloss: 0.275355	valid_1's auc: 0.90608	valid_1's binary_logloss: 0.3207
[96]	valid_0's auc: 0.936105	valid_0's binary_logloss: 0.274884	valid_1's auc: 0.905909	valid_1's binary_logloss: 0.32099
[97]	valid_0's auc: 0.93642	valid_0's binary_logloss: 0.274358	valid_1's auc: 0.905958	valid_1's binary_logloss: 0.320931
[98]	valid_0's auc: 0.936694	valid_0's binary_logloss: 0.273885	valid_1's auc: 0.905863	valid_1's binary_logloss: 0.321073
[99]	valid_0's auc: 0.936914	valid_0's binary_logloss: 0.273519	valid_1's auc: 0.905828	valid_1's binary_logloss: 0.321125
[100]	valid_0's auc: 0.937125	valid_0's binary_logloss: 0.273139	valid_1's auc: 0.905746	valid_1's binary_logloss: 0.321292
[101]	valid_0's auc: 0.937331	valid_0's binary_logloss: 0.27274	valid_1's auc: 0.905606	valid_1's binary_logloss: 0.321582
[102]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272424	valid_1's auc: 0.905546	valid_1's binary_logloss: 0.321722
[103]	valid_0's auc: 0.937675	valid_0's binary_logloss: 0.272138	valid_1's auc: 0.905512	valid_1's binary_logloss: 0.321791
[104]	valid_0's auc: 0.93786	valid_0's binary_logloss: 0.271807	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.321961
[105]	valid_0's auc: 0.938166	valid_0's binary_logloss: 0.271293	valid_1's auc: 0.905505	valid_1's binary_logloss: 0.321881
[106]	valid_0's auc: 0.938361	valid_0's binary_logloss: 0.270926	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322153
[107]	valid_0's auc: 0.938524	valid_0's binary_logloss: 0.270637	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.322188
[108]	valid_0's auc: 0.938766	valid_0's binary_logloss: 0.270148	valid_1's auc: 0.905321	valid_1's binary_logloss: 0.322313
[109]	valid_0's auc: 0.938956	valid_0's binary_logloss: 0.269801	valid_1's auc: 0.905263	valid_1's binary_logloss: 0.322498
[110]	valid_0's auc: 0.939121	valid_0's binary_logloss: 0.269491	valid_1's auc: 0.905299	valid_1's binary_logloss: 0.322474
[111]	valid_0's auc: 0.939323	valid_0's binary_logloss: 0.269111	valid_1's auc: 0.905215	valid_1's binary_logloss: 0.322625
[112]	valid_0's auc: 0.939498	valid_0's binary_logloss: 0.268808	valid_1's auc: 0.905234	valid_1's binary_logloss: 0.322582
[113]	valid_0's auc: 0.939587	valid_0's binary_logloss: 0.268614	valid_1's auc: 0.905142	valid_1's binary_logloss: 0.322785
[114]	valid_0's auc: 0.939826	valid_0's binary_logloss: 0.26818	valid_1's auc: 0.905138	valid_1's binary_logloss: 0.322808
[115]	valid_0's auc: 0.940073	valid_0's binary_logloss: 0.26776	valid_1's auc: 0.905149	valid_1's binary_logloss: 0.322795
[116]	valid_0's auc: 0.940221	valid_0's binary_logloss: 0.267483	valid_1's auc: 0.905156	valid_1's binary_logloss: 0.322809
[117]	valid_0's auc: 0.940416	valid_0's binary_logloss: 0.267152	valid_1's auc: 0.905154	valid_1's binary_logloss: 0.322824
[118]	valid_0's auc: 0.940655	valid_0's binary_logloss: 0.266732	valid_1's auc: 0.905124	valid_1's binary_logloss: 0.322885
[119]	valid_0's auc: 0.940781	valid_0's binary_logloss: 0.266494	valid_1's auc: 0.904995	valid_1's binary_logloss: 0.323097
[120]	valid_0's auc: 0.940998	valid_0's binary_logloss: 0.266118	valid_1's auc: 0.904977	valid_1's binary_logloss: 0.323169
[121]	valid_0's auc: 0.941094	valid_0's binary_logloss: 0.265914	valid_1's auc: 0.904969	valid_1's binary_logloss: 0.323168
[122]	valid_0's auc: 0.941331	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.904967	valid_1's binary_logloss: 0.323192
[123]	valid_0's auc: 0.94152	valid_0's binary_logloss: 0.265128	valid_1's auc: 0.904915	valid_1's binary_logloss: 0.323329
[124]	valid_0's auc: 0.941759	valid_0's binary_logloss: 0.264712	valid_1's auc: 0.904838	valid_1's binary_logloss: 0.323542
[125]	valid_0's auc: 0.941827	valid_0's binary_logloss: 0.264561	valid_1's auc: 0.904837	valid_1's binary_logloss: 0.32354
[126]	valid_0's auc: 0.942004	valid_0's binary_logloss: 0.264253	valid_1's auc: 0.904771	valid_1's binary_logloss: 0.32369
[127]	valid_0's auc: 0.942186	valid_0's binary_logloss: 0.263899	valid_1's auc: 0.904709	valid_1's binary_logloss: 0.323881
[128]	valid_0's auc: 0.942419	valid_0's binary_logloss: 0.263503	valid_1's auc: 0.904669	valid_1's binary_logloss: 0.323978
[129]	valid_0's auc: 0.942585	valid_0's binary_logloss: 0.263195	valid_1's auc: 0.90469	valid_1's binary_logloss: 0.323913
[130]	valid_0's auc: 0.942807	valid_0's binary_logloss: 0.262768	valid_1's auc: 0.904623	valid_1's binary_logloss: 0.324056
[131]	valid_0's auc: 0.943008	valid_0's binary_logloss: 0.262435	valid_1's auc: 0.904665	valid_1's binary_logloss: 0.324027
Early stopping, best iteration is:
[31]	valid_0's auc: 0.915569	valid_0's binary_logloss: 0.314739	valid_1's auc: 0.908628	valid_1's binary_logloss: 0.319825
[1]	valid_0's auc: 0.888786	valid_0's binary_logloss: 0.516801	valid_1's auc: 0.894376	valid_1's binary_logloss: 0.508215
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892051	valid_0's binary_logloss: 0.487909	valid_1's auc: 0.897516	valid_1's binary_logloss: 0.478613
[3]	valid_0's auc: 0.892499	valid_0's binary_logloss: 0.464939	valid_1's auc: 0.897999	valid_1's binary_logloss: 0.455284
[4]	valid_0's auc: 0.893544	valid_0's binary_logloss: 0.445997	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.43625
[5]	valid_0's auc: 0.897183	valid_0's binary_logloss: 0.429801	valid_1's auc: 0.901802	valid_1's binary_logloss: 0.419978
[6]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.416121	valid_1's auc: 0.902211	valid_1's binary_logloss: 0.406386
[7]	valid_0's auc: 0.899236	valid_0's binary_logloss: 0.40443	valid_1's auc: 0.902787	valid_1's binary_logloss: 0.394757
[8]	valid_0's auc: 0.899639	valid_0's binary_logloss: 0.394315	valid_1's auc: 0.90375	valid_1's binary_logloss: 0.384547
[9]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.38557	valid_1's auc: 0.904192	valid_1's binary_logloss: 0.376078
[10]	valid_0's auc: 0.901746	valid_0's binary_logloss: 0.377945	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.368806
[11]	valid_0's auc: 0.90252	valid_0's binary_logloss: 0.371205	valid_1's auc: 0.904908	valid_1's binary_logloss: 0.362532
[12]	valid_0's auc: 0.903208	valid_0's binary_logloss: 0.365265	valid_1's auc: 0.905106	valid_1's binary_logloss: 0.35705
[13]	valid_0's auc: 0.904384	valid_0's binary_logloss: 0.359865	valid_1's auc: 0.90581	valid_1's binary_logloss: 0.352017
[14]	valid_0's auc: 0.905128	valid_0's binary_logloss: 0.355111	valid_1's auc: 0.905975	valid_1's binary_logloss: 0.347824
[15]	valid_0's auc: 0.905702	valid_0's binary_logloss: 0.350796	valid_1's auc: 0.906461	valid_1's binary_logloss: 0.343983
[16]	valid_0's auc: 0.906416	valid_0's binary_logloss: 0.346926	valid_1's auc: 0.907136	valid_1's binary_logloss: 0.340524
[17]	valid_0's auc: 0.906965	valid_0's binary_logloss: 0.343512	valid_1's auc: 0.907443	valid_1's binary_logloss: 0.337508
[18]	valid_0's auc: 0.907653	valid_0's binary_logloss: 0.340327	valid_1's auc: 0.907568	valid_1's binary_logloss: 0.335135
[19]	valid_0's auc: 0.90867	valid_0's binary_logloss: 0.337206	valid_1's auc: 0.907689	valid_1's binary_logloss: 0.332904
[20]	valid_0's auc: 0.909209	valid_0's binary_logloss: 0.334692	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.331179
[21]	valid_0's auc: 0.90991	valid_0's binary_logloss: 0.3322	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.329477
[22]	valid_0's auc: 0.910643	valid_0's binary_logloss: 0.329894	valid_1's auc: 0.907685	valid_1's binary_logloss: 0.328068
[23]	valid_0's auc: 0.911375	valid_0's binary_logloss: 0.327592	valid_1's auc: 0.907806	valid_1's binary_logloss: 0.326608
[24]	valid_0's auc: 0.912047	valid_0's binary_logloss: 0.325475	valid_1's auc: 0.907924	valid_1's binary_logloss: 0.325412
[25]	valid_0's auc: 0.91249	valid_0's binary_logloss: 0.323808	valid_1's auc: 0.907977	valid_1's binary_logloss: 0.324311
[26]	valid_0's auc: 0.913075	valid_0's binary_logloss: 0.322115	valid_1's auc: 0.908064	valid_1's binary_logloss: 0.323349
[27]	valid_0's auc: 0.913698	valid_0's binary_logloss: 0.320412	valid_1's auc: 0.908291	valid_1's binary_logloss: 0.3223
[28]	valid_0's auc: 0.914152	valid_0's binary_logloss: 0.318983	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.321655
[29]	valid_0's auc: 0.914788	valid_0's binary_logloss: 0.317385	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.321037
[30]	valid_0's auc: 0.9152	valid_0's binary_logloss: 0.316096	valid_1's auc: 0.908523	valid_1's binary_logloss: 0.320182
[31]	valid_0's auc: 0.91556	valid_0's binary_logloss: 0.314917	valid_1's auc: 0.908491	valid_1's binary_logloss: 0.319789
[32]	valid_0's auc: 0.915986	valid_0's binary_logloss: 0.313727	valid_1's auc: 0.908816	valid_1's binary_logloss: 0.318952
[33]	valid_0's auc: 0.916478	valid_0's binary_logloss: 0.312578	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.318495
[34]	valid_0's auc: 0.916924	valid_0's binary_logloss: 0.311425	valid_1's auc: 0.908981	valid_1's binary_logloss: 0.318003
[35]	valid_0's auc: 0.917365	valid_0's binary_logloss: 0.310288	valid_1's auc: 0.908978	valid_1's binary_logloss: 0.317658
[36]	valid_0's auc: 0.917694	valid_0's binary_logloss: 0.309367	valid_1's auc: 0.909051	valid_1's binary_logloss: 0.317322
[37]	valid_0's auc: 0.9181	valid_0's binary_logloss: 0.30838	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.317054
[38]	valid_0's auc: 0.918483	valid_0's binary_logloss: 0.307536	valid_1's auc: 0.90898	valid_1's binary_logloss: 0.317069
[39]	valid_0's auc: 0.918955	valid_0's binary_logloss: 0.30648	valid_1's auc: 0.908922	valid_1's binary_logloss: 0.316952
[40]	valid_0's auc: 0.919309	valid_0's binary_logloss: 0.30562	valid_1's auc: 0.909153	valid_1's binary_logloss: 0.316499
[41]	valid_0's auc: 0.91983	valid_0's binary_logloss: 0.304604	valid_1's auc: 0.909147	valid_1's binary_logloss: 0.316389
[42]	valid_0's auc: 0.920336	valid_0's binary_logloss: 0.303643	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.316482
[43]	valid_0's auc: 0.920736	valid_0's binary_logloss: 0.302776	valid_1's auc: 0.908915	valid_1's binary_logloss: 0.316468
[44]	valid_0's auc: 0.921159	valid_0's binary_logloss: 0.301928	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.316225
[45]	valid_0's auc: 0.921539	valid_0's binary_logloss: 0.301193	valid_1's auc: 0.908992	valid_1's binary_logloss: 0.316126
[46]	valid_0's auc: 0.92187	valid_0's binary_logloss: 0.300488	valid_1's auc: 0.909226	valid_1's binary_logloss: 0.315711
[47]	valid_0's auc: 0.922245	valid_0's binary_logloss: 0.299758	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.31581
[48]	valid_0's auc: 0.922544	valid_0's binary_logloss: 0.299144	valid_1's auc: 0.909222	valid_1's binary_logloss: 0.31565
[49]	valid_0's auc: 0.922868	valid_0's binary_logloss: 0.298506	valid_1's auc: 0.909291	valid_1's binary_logloss: 0.315479
[50]	valid_0's auc: 0.923161	valid_0's binary_logloss: 0.297913	valid_1's auc: 0.909378	valid_1's binary_logloss: 0.315333
[51]	valid_0's auc: 0.923484	valid_0's binary_logloss: 0.297232	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.315207
[52]	valid_0's auc: 0.923889	valid_0's binary_logloss: 0.29655	valid_1's auc: 0.909301	valid_1's binary_logloss: 0.315335
[53]	valid_0's auc: 0.924254	valid_0's binary_logloss: 0.295955	valid_1's auc: 0.909275	valid_1's binary_logloss: 0.315351
[54]	valid_0's auc: 0.924517	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.909247	valid_1's binary_logloss: 0.315353
[55]	valid_0's auc: 0.92481	valid_0's binary_logloss: 0.294893	valid_1's auc: 0.90917	valid_1's binary_logloss: 0.315462
[56]	valid_0's auc: 0.925141	valid_0's binary_logloss: 0.294306	valid_1's auc: 0.9091	valid_1's binary_logloss: 0.315554
[57]	valid_0's auc: 0.925421	valid_0's binary_logloss: 0.293747	valid_1's auc: 0.909024	valid_1's binary_logloss: 0.315621
[58]	valid_0's auc: 0.925785	valid_0's binary_logloss: 0.293126	valid_1's auc: 0.909006	valid_1's binary_logloss: 0.315675
[59]	valid_0's auc: 0.926173	valid_0's binary_logloss: 0.292439	valid_1's auc: 0.90897	valid_1's binary_logloss: 0.315695
[60]	valid_0's auc: 0.926458	valid_0's binary_logloss: 0.291904	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.316004
[61]	valid_0's auc: 0.926756	valid_0's binary_logloss: 0.291375	valid_1's auc: 0.908685	valid_1's binary_logloss: 0.316173
[62]	valid_0's auc: 0.927138	valid_0's binary_logloss: 0.29077	valid_1's auc: 0.908733	valid_1's binary_logloss: 0.316108
[63]	valid_0's auc: 0.927419	valid_0's binary_logloss: 0.290229	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.316013
[64]	valid_0's auc: 0.927725	valid_0's binary_logloss: 0.289704	valid_1's auc: 0.908769	valid_1's binary_logloss: 0.31602
[65]	valid_0's auc: 0.928033	valid_0's binary_logloss: 0.289182	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.315885
[66]	valid_0's auc: 0.928306	valid_0's binary_logloss: 0.288666	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.31594
[67]	valid_0's auc: 0.928609	valid_0's binary_logloss: 0.288157	valid_1's auc: 0.908907	valid_1's binary_logloss: 0.315864
[68]	valid_0's auc: 0.928906	valid_0's binary_logloss: 0.287625	valid_1's auc: 0.908888	valid_1's binary_logloss: 0.315893
[69]	valid_0's auc: 0.929205	valid_0's binary_logloss: 0.287112	valid_1's auc: 0.908883	valid_1's binary_logloss: 0.315933
[70]	valid_0's auc: 0.929435	valid_0's binary_logloss: 0.286656	valid_1's auc: 0.908871	valid_1's binary_logloss: 0.315949
[71]	valid_0's auc: 0.92975	valid_0's binary_logloss: 0.286139	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.316021
[72]	valid_0's auc: 0.930013	valid_0's binary_logloss: 0.285676	valid_1's auc: 0.908798	valid_1's binary_logloss: 0.316112
[73]	valid_0's auc: 0.930278	valid_0's binary_logloss: 0.285219	valid_1's auc: 0.908879	valid_1's binary_logloss: 0.316023
[74]	valid_0's auc: 0.930518	valid_0's binary_logloss: 0.284797	valid_1's auc: 0.908813	valid_1's binary_logloss: 0.31607
[75]	valid_0's auc: 0.930751	valid_0's binary_logloss: 0.284363	valid_1's auc: 0.908718	valid_1's binary_logloss: 0.316274
[76]	valid_0's auc: 0.93103	valid_0's binary_logloss: 0.283878	valid_1's auc: 0.908689	valid_1's binary_logloss: 0.316314
[77]	valid_0's auc: 0.93123	valid_0's binary_logloss: 0.283455	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.316362
[78]	valid_0's auc: 0.931527	valid_0's binary_logloss: 0.282977	valid_1's auc: 0.908556	valid_1's binary_logloss: 0.316511
[79]	valid_0's auc: 0.931848	valid_0's binary_logloss: 0.282431	valid_1's auc: 0.908578	valid_1's binary_logloss: 0.316506
[80]	valid_0's auc: 0.932055	valid_0's binary_logloss: 0.282006	valid_1's auc: 0.908483	valid_1's binary_logloss: 0.316679
[81]	valid_0's auc: 0.932277	valid_0's binary_logloss: 0.281636	valid_1's auc: 0.908391	valid_1's binary_logloss: 0.316806
[82]	valid_0's auc: 0.932582	valid_0's binary_logloss: 0.281116	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.317011
[83]	valid_0's auc: 0.932788	valid_0's binary_logloss: 0.2807	valid_1's auc: 0.908168	valid_1's binary_logloss: 0.317227
[84]	valid_0's auc: 0.933006	valid_0's binary_logloss: 0.280312	valid_1's auc: 0.908055	valid_1's binary_logloss: 0.31746
[85]	valid_0's auc: 0.933335	valid_0's binary_logloss: 0.279791	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.317683
[86]	valid_0's auc: 0.933519	valid_0's binary_logloss: 0.279419	valid_1's auc: 0.907774	valid_1's binary_logloss: 0.317973
[87]	valid_0's auc: 0.933653	valid_0's binary_logloss: 0.279115	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.318156
[88]	valid_0's auc: 0.933892	valid_0's binary_logloss: 0.278694	valid_1's auc: 0.907636	valid_1's binary_logloss: 0.318178
[89]	valid_0's auc: 0.934164	valid_0's binary_logloss: 0.278215	valid_1's auc: 0.907578	valid_1's binary_logloss: 0.318352
[90]	valid_0's auc: 0.934394	valid_0's binary_logloss: 0.277807	valid_1's auc: 0.90743	valid_1's binary_logloss: 0.318558
[91]	valid_0's auc: 0.934629	valid_0's binary_logloss: 0.277377	valid_1's auc: 0.907418	valid_1's binary_logloss: 0.318585
[92]	valid_0's auc: 0.93478	valid_0's binary_logloss: 0.277118	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.318602
[93]	valid_0's auc: 0.935084	valid_0's binary_logloss: 0.27657	valid_1's auc: 0.907257	valid_1's binary_logloss: 0.31882
[94]	valid_0's auc: 0.935232	valid_0's binary_logloss: 0.276271	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.319063
[95]	valid_0's auc: 0.93546	valid_0's binary_logloss: 0.275822	valid_1's auc: 0.907148	valid_1's binary_logloss: 0.319125
[96]	valid_0's auc: 0.935715	valid_0's binary_logloss: 0.275391	valid_1's auc: 0.907175	valid_1's binary_logloss: 0.319077
[97]	valid_0's auc: 0.935955	valid_0's binary_logloss: 0.274992	valid_1's auc: 0.907023	valid_1's binary_logloss: 0.319342
[98]	valid_0's auc: 0.936203	valid_0's binary_logloss: 0.274573	valid_1's auc: 0.907085	valid_1's binary_logloss: 0.319289
[99]	valid_0's auc: 0.936406	valid_0's binary_logloss: 0.27424	valid_1's auc: 0.907131	valid_1's binary_logloss: 0.319247
[100]	valid_0's auc: 0.9366	valid_0's binary_logloss: 0.273836	valid_1's auc: 0.907095	valid_1's binary_logloss: 0.319326
[101]	valid_0's auc: 0.936853	valid_0's binary_logloss: 0.273432	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.319344
[102]	valid_0's auc: 0.937076	valid_0's binary_logloss: 0.273057	valid_1's auc: 0.907053	valid_1's binary_logloss: 0.319395
[103]	valid_0's auc: 0.937291	valid_0's binary_logloss: 0.272662	valid_1's auc: 0.907012	valid_1's binary_logloss: 0.319457
[104]	valid_0's auc: 0.937458	valid_0's binary_logloss: 0.272327	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.319621
[105]	valid_0's auc: 0.9376	valid_0's binary_logloss: 0.272015	valid_1's auc: 0.90672	valid_1's binary_logloss: 0.319998
[106]	valid_0's auc: 0.937839	valid_0's binary_logloss: 0.271611	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.320012
[107]	valid_0's auc: 0.938091	valid_0's binary_logloss: 0.271178	valid_1's auc: 0.906649	valid_1's binary_logloss: 0.320073
[108]	valid_0's auc: 0.938233	valid_0's binary_logloss: 0.270899	valid_1's auc: 0.906552	valid_1's binary_logloss: 0.320213
[109]	valid_0's auc: 0.938444	valid_0's binary_logloss: 0.270517	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320357
[110]	valid_0's auc: 0.938603	valid_0's binary_logloss: 0.270203	valid_1's auc: 0.906416	valid_1's binary_logloss: 0.320516
[111]	valid_0's auc: 0.938819	valid_0's binary_logloss: 0.269825	valid_1's auc: 0.90639	valid_1's binary_logloss: 0.320513
[112]	valid_0's auc: 0.939049	valid_0's binary_logloss: 0.269432	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.3205
[113]	valid_0's auc: 0.939222	valid_0's binary_logloss: 0.269081	valid_1's auc: 0.906454	valid_1's binary_logloss: 0.320432
[114]	valid_0's auc: 0.939388	valid_0's binary_logloss: 0.268763	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.320436
[115]	valid_0's auc: 0.939628	valid_0's binary_logloss: 0.26831	valid_1's auc: 0.906328	valid_1's binary_logloss: 0.320672
[116]	valid_0's auc: 0.939739	valid_0's binary_logloss: 0.26808	valid_1's auc: 0.906273	valid_1's binary_logloss: 0.320863
[117]	valid_0's auc: 0.939874	valid_0's binary_logloss: 0.267837	valid_1's auc: 0.906295	valid_1's binary_logloss: 0.320826
[118]	valid_0's auc: 0.940089	valid_0's binary_logloss: 0.267441	valid_1's auc: 0.906165	valid_1's binary_logloss: 0.32111
[119]	valid_0's auc: 0.940367	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.906236	valid_1's binary_logloss: 0.32097
[120]	valid_0's auc: 0.940587	valid_0's binary_logloss: 0.266546	valid_1's auc: 0.906223	valid_1's binary_logloss: 0.321039
[121]	valid_0's auc: 0.940751	valid_0's binary_logloss: 0.266243	valid_1's auc: 0.906137	valid_1's binary_logloss: 0.321232
[122]	valid_0's auc: 0.940894	valid_0's binary_logloss: 0.265945	valid_1's auc: 0.906042	valid_1's binary_logloss: 0.321446
[123]	valid_0's auc: 0.941108	valid_0's binary_logloss: 0.26555	valid_1's auc: 0.905976	valid_1's binary_logloss: 0.321608
[124]	valid_0's auc: 0.941217	valid_0's binary_logloss: 0.265311	valid_1's auc: 0.905893	valid_1's binary_logloss: 0.321821
[125]	valid_0's auc: 0.941403	valid_0's binary_logloss: 0.264992	valid_1's auc: 0.905871	valid_1's binary_logloss: 0.321859
[126]	valid_0's auc: 0.941561	valid_0's binary_logloss: 0.264697	valid_1's auc: 0.90586	valid_1's binary_logloss: 0.321893
[127]	valid_0's auc: 0.941717	valid_0's binary_logloss: 0.264398	valid_1's auc: 0.905859	valid_1's binary_logloss: 0.322003
[128]	valid_0's auc: 0.941904	valid_0's binary_logloss: 0.264068	valid_1's auc: 0.905784	valid_1's binary_logloss: 0.322109
[129]	valid_0's auc: 0.942129	valid_0's binary_logloss: 0.263681	valid_1's auc: 0.905732	valid_1's binary_logloss: 0.322221
[130]	valid_0's auc: 0.942337	valid_0's binary_logloss: 0.263332	valid_1's auc: 0.905641	valid_1's binary_logloss: 0.322397
[131]	valid_0's auc: 0.94256	valid_0's binary_logloss: 0.262953	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.322359
[132]	valid_0's auc: 0.942752	valid_0's binary_logloss: 0.26261	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.322374
[133]	valid_0's auc: 0.942961	valid_0's binary_logloss: 0.262214	valid_1's auc: 0.905645	valid_1's binary_logloss: 0.322528
[134]	valid_0's auc: 0.943101	valid_0's binary_logloss: 0.261927	valid_1's auc: 0.905593	valid_1's binary_logloss: 0.322696
[135]	valid_0's auc: 0.943328	valid_0's binary_logloss: 0.261499	valid_1's auc: 0.905557	valid_1's binary_logloss: 0.322806
[136]	valid_0's auc: 0.94353	valid_0's binary_logloss: 0.261141	valid_1's auc: 0.905584	valid_1's binary_logloss: 0.322786
[137]	valid_0's auc: 0.943724	valid_0's binary_logloss: 0.260804	valid_1's auc: 0.905576	valid_1's binary_logloss: 0.322783
[138]	valid_0's auc: 0.943947	valid_0's binary_logloss: 0.260408	valid_1's auc: 0.905598	valid_1's binary_logloss: 0.322802
[139]	valid_0's auc: 0.944115	valid_0's binary_logloss: 0.260124	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.322772
[140]	valid_0's auc: 0.944293	valid_0's binary_logloss: 0.259804	valid_1's auc: 0.90557	valid_1's binary_logloss: 0.322832
[141]	valid_0's auc: 0.944455	valid_0's binary_logloss: 0.259525	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.322881
[142]	valid_0's auc: 0.944615	valid_0's binary_logloss: 0.259194	valid_1's auc: 0.905533	valid_1's binary_logloss: 0.322929
[143]	valid_0's auc: 0.944798	valid_0's binary_logloss: 0.258869	valid_1's auc: 0.905557	valid_1's binary_logloss: 0.322959
[144]	valid_0's auc: 0.944968	valid_0's binary_logloss: 0.258561	valid_1's auc: 0.905552	valid_1's binary_logloss: 0.32302
[145]	valid_0's auc: 0.9451	valid_0's binary_logloss: 0.258305	valid_1's auc: 0.905654	valid_1's binary_logloss: 0.322894
[146]	valid_0's auc: 0.94524	valid_0's binary_logloss: 0.258043	valid_1's auc: 0.905584	valid_1's binary_logloss: 0.323021
[147]	valid_0's auc: 0.945358	valid_0's binary_logloss: 0.257801	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.323019
[148]	valid_0's auc: 0.945461	valid_0's binary_logloss: 0.257568	valid_1's auc: 0.905551	valid_1's binary_logloss: 0.323098
[149]	valid_0's auc: 0.945603	valid_0's binary_logloss: 0.257296	valid_1's auc: 0.905399	valid_1's binary_logloss: 0.323376
[150]	valid_0's auc: 0.945733	valid_0's binary_logloss: 0.257051	valid_1's auc: 0.905441	valid_1's binary_logloss: 0.323361
[151]	valid_0's auc: 0.945893	valid_0's binary_logloss: 0.256751	valid_1's auc: 0.905407	valid_1's binary_logloss: 0.323435
Early stopping, best iteration is:
[51]	valid_0's auc: 0.923484	valid_0's binary_logloss: 0.297232	valid_1's auc: 0.9094	valid_1's binary_logloss: 0.315207
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8932	valid_0's binary_logloss: 0.488767	valid_1's auc: 0.898628	valid_1's binary_logloss: 0.47931
[3]	valid_0's auc: 0.893892	valid_0's binary_logloss: 0.46573	valid_1's auc: 0.899079	valid_1's binary_logloss: 0.45581
[4]	valid_0's auc: 0.895475	valid_0's binary_logloss: 0.446714	valid_1's auc: 0.900674	valid_1's binary_logloss: 0.436743
[5]	valid_0's auc: 0.897074	valid_0's binary_logloss: 0.430337	valid_1's auc: 0.90173	valid_1's binary_logloss: 0.42032
[6]	valid_0's auc: 0.898357	valid_0's binary_logloss: 0.416642	valid_1's auc: 0.902698	valid_1's binary_logloss: 0.406406
[7]	valid_0's auc: 0.899307	valid_0's binary_logloss: 0.404911	valid_1's auc: 0.903472	valid_1's binary_logloss: 0.394687
[8]	valid_0's auc: 0.900174	valid_0's binary_logloss: 0.394885	valid_1's auc: 0.904079	valid_1's binary_logloss: 0.384734
[9]	valid_0's auc: 0.901445	valid_0's binary_logloss: 0.385831	valid_1's auc: 0.904686	valid_1's binary_logloss: 0.375986
[10]	valid_0's auc: 0.901761	valid_0's binary_logloss: 0.378314	valid_1's auc: 0.905095	valid_1's binary_logloss: 0.368578
[11]	valid_0's auc: 0.902733	valid_0's binary_logloss: 0.371404	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.362191
[12]	valid_0's auc: 0.903536	valid_0's binary_logloss: 0.365482	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.356725
[13]	valid_0's auc: 0.903939	valid_0's binary_logloss: 0.360327	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.352125
[14]	valid_0's auc: 0.905183	valid_0's binary_logloss: 0.355358	valid_1's auc: 0.906337	valid_1's binary_logloss: 0.347748
[15]	valid_0's auc: 0.905915	valid_0's binary_logloss: 0.351013	valid_1's auc: 0.906789	valid_1's binary_logloss: 0.343933
[16]	valid_0's auc: 0.906648	valid_0's binary_logloss: 0.347095	valid_1's auc: 0.907136	valid_1's binary_logloss: 0.340623
[17]	valid_0's auc: 0.907042	valid_0's binary_logloss: 0.343795	valid_1's auc: 0.907146	valid_1's binary_logloss: 0.337806
[18]	valid_0's auc: 0.907613	valid_0's binary_logloss: 0.340701	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.335307
[19]	valid_0's auc: 0.9081	valid_0's binary_logloss: 0.337909	valid_1's auc: 0.907772	valid_1's binary_logloss: 0.332832
[20]	valid_0's auc: 0.908551	valid_0's binary_logloss: 0.335421	valid_1's auc: 0.907616	valid_1's binary_logloss: 0.331094
[21]	valid_0's auc: 0.909266	valid_0's binary_logloss: 0.332931	valid_1's auc: 0.907861	valid_1's binary_logloss: 0.329282
[22]	valid_0's auc: 0.909785	valid_0's binary_logloss: 0.330757	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.327887
[23]	valid_0's auc: 0.910383	valid_0's binary_logloss: 0.328569	valid_1's auc: 0.908097	valid_1's binary_logloss: 0.326331
[24]	valid_0's auc: 0.910975	valid_0's binary_logloss: 0.326595	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.325034
[25]	valid_0's auc: 0.911519	valid_0's binary_logloss: 0.324821	valid_1's auc: 0.908426	valid_1's binary_logloss: 0.323904
[26]	valid_0's auc: 0.912141	valid_0's binary_logloss: 0.323045	valid_1's auc: 0.908767	valid_1's binary_logloss: 0.322654
[27]	valid_0's auc: 0.912654	valid_0's binary_logloss: 0.321415	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.321844
[28]	valid_0's auc: 0.913134	valid_0's binary_logloss: 0.319969	valid_1's auc: 0.908835	valid_1's binary_logloss: 0.321096
[29]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.318373	valid_1's auc: 0.908936	valid_1's binary_logloss: 0.320357
[30]	valid_0's auc: 0.914217	valid_0's binary_logloss: 0.317083	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.319712
[31]	valid_0's auc: 0.914768	valid_0's binary_logloss: 0.315701	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.319049
[32]	valid_0's auc: 0.915208	valid_0's binary_logloss: 0.314525	valid_1's auc: 0.909146	valid_1's binary_logloss: 0.318692
[33]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.313365	valid_1's auc: 0.909114	valid_1's binary_logloss: 0.318322
[34]	valid_0's auc: 0.916047	valid_0's binary_logloss: 0.312374	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.317849
[35]	valid_0's auc: 0.916531	valid_0's binary_logloss: 0.311286	valid_1's auc: 0.90923	valid_1's binary_logloss: 0.317481
[36]	valid_0's auc: 0.916932	valid_0's binary_logloss: 0.310326	valid_1's auc: 0.909362	valid_1's binary_logloss: 0.317036
[37]	valid_0's auc: 0.917311	valid_0's binary_logloss: 0.309497	valid_1's auc: 0.909237	valid_1's binary_logloss: 0.316952
[38]	valid_0's auc: 0.917746	valid_0's binary_logloss: 0.308587	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.31681
[39]	valid_0's auc: 0.918108	valid_0's binary_logloss: 0.307735	valid_1's auc: 0.909209	valid_1's binary_logloss: 0.316662
[40]	valid_0's auc: 0.918504	valid_0's binary_logloss: 0.30687	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316355
[41]	valid_0's auc: 0.918913	valid_0's binary_logloss: 0.306026	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.316055
[42]	valid_0's auc: 0.919225	valid_0's binary_logloss: 0.305318	valid_1's auc: 0.909454	valid_1's binary_logloss: 0.315766
[43]	valid_0's auc: 0.919511	valid_0's binary_logloss: 0.304647	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.315646
[44]	valid_0's auc: 0.919871	valid_0's binary_logloss: 0.303869	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.315599
[45]	valid_0's auc: 0.920215	valid_0's binary_logloss: 0.303093	valid_1's auc: 0.909332	valid_1's binary_logloss: 0.315542
[46]	valid_0's auc: 0.920636	valid_0's binary_logloss: 0.302305	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.315391
[47]	valid_0's auc: 0.921014	valid_0's binary_logloss: 0.301572	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.31518
[48]	valid_0's auc: 0.921374	valid_0's binary_logloss: 0.300887	valid_1's auc: 0.909576	valid_1's binary_logloss: 0.31499
[49]	valid_0's auc: 0.921675	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314676
[50]	valid_0's auc: 0.922088	valid_0's binary_logloss: 0.299604	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314743
[51]	valid_0's auc: 0.922463	valid_0's binary_logloss: 0.298954	valid_1's auc: 0.90961	valid_1's binary_logloss: 0.314746
[52]	valid_0's auc: 0.922724	valid_0's binary_logloss: 0.298433	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314726
[53]	valid_0's auc: 0.923039	valid_0's binary_logloss: 0.2978	valid_1's auc: 0.909624	valid_1's binary_logloss: 0.314541
[54]	valid_0's auc: 0.923312	valid_0's binary_logloss: 0.297236	valid_1's auc: 0.909536	valid_1's binary_logloss: 0.314566
[55]	valid_0's auc: 0.923702	valid_0's binary_logloss: 0.296604	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.3145
[56]	valid_0's auc: 0.924015	valid_0's binary_logloss: 0.29603	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.314549
[57]	valid_0's auc: 0.924248	valid_0's binary_logloss: 0.295612	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.314627
[58]	valid_0's auc: 0.924539	valid_0's binary_logloss: 0.295069	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.314842
[59]	valid_0's auc: 0.9249	valid_0's binary_logloss: 0.294407	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.315108
[60]	valid_0's auc: 0.925204	valid_0's binary_logloss: 0.293899	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.315257
[61]	valid_0's auc: 0.925557	valid_0's binary_logloss: 0.293315	valid_1's auc: 0.908992	valid_1's binary_logloss: 0.315222
[62]	valid_0's auc: 0.925914	valid_0's binary_logloss: 0.292743	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.315425
[63]	valid_0's auc: 0.926273	valid_0's binary_logloss: 0.292108	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.315355
[64]	valid_0's auc: 0.926577	valid_0's binary_logloss: 0.29156	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315387
[65]	valid_0's auc: 0.92686	valid_0's binary_logloss: 0.291077	valid_1's auc: 0.908848	valid_1's binary_logloss: 0.315337
[66]	valid_0's auc: 0.927178	valid_0's binary_logloss: 0.290535	valid_1's auc: 0.908839	valid_1's binary_logloss: 0.315405
[67]	valid_0's auc: 0.927402	valid_0's binary_logloss: 0.290102	valid_1's auc: 0.908924	valid_1's binary_logloss: 0.315265
[68]	valid_0's auc: 0.927704	valid_0's binary_logloss: 0.289578	valid_1's auc: 0.908815	valid_1's binary_logloss: 0.315435
[69]	valid_0's auc: 0.927945	valid_0's binary_logloss: 0.289142	valid_1's auc: 0.908698	valid_1's binary_logloss: 0.315628
[70]	valid_0's auc: 0.928201	valid_0's binary_logloss: 0.288689	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.315722
[71]	valid_0's auc: 0.928469	valid_0's binary_logloss: 0.288194	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.315815
[72]	valid_0's auc: 0.928753	valid_0's binary_logloss: 0.287728	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.315861
[73]	valid_0's auc: 0.928968	valid_0's binary_logloss: 0.287353	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.315948
[74]	valid_0's auc: 0.929261	valid_0's binary_logloss: 0.286877	valid_1's auc: 0.908341	valid_1's binary_logloss: 0.316054
[75]	valid_0's auc: 0.929478	valid_0's binary_logloss: 0.28648	valid_1's auc: 0.908271	valid_1's binary_logloss: 0.31615
[76]	valid_0's auc: 0.929763	valid_0's binary_logloss: 0.286003	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.316199
[77]	valid_0's auc: 0.93001	valid_0's binary_logloss: 0.285585	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.316322
[78]	valid_0's auc: 0.930324	valid_0's binary_logloss: 0.284986	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.316583
[79]	valid_0's auc: 0.930566	valid_0's binary_logloss: 0.284558	valid_1's auc: 0.908012	valid_1's binary_logloss: 0.316613
[80]	valid_0's auc: 0.930865	valid_0's binary_logloss: 0.284025	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.316538
[81]	valid_0's auc: 0.931077	valid_0's binary_logloss: 0.283626	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.316525
[82]	valid_0's auc: 0.93139	valid_0's binary_logloss: 0.283085	valid_1's auc: 0.908009	valid_1's binary_logloss: 0.316653
[83]	valid_0's auc: 0.931652	valid_0's binary_logloss: 0.282661	valid_1's auc: 0.907995	valid_1's binary_logloss: 0.316681
[84]	valid_0's auc: 0.931934	valid_0's binary_logloss: 0.282182	valid_1's auc: 0.907998	valid_1's binary_logloss: 0.316722
[85]	valid_0's auc: 0.932186	valid_0's binary_logloss: 0.281767	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.316798
[86]	valid_0's auc: 0.932442	valid_0's binary_logloss: 0.281326	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316882
[87]	valid_0's auc: 0.932631	valid_0's binary_logloss: 0.280966	valid_1's auc: 0.907888	valid_1's binary_logloss: 0.316957
[88]	valid_0's auc: 0.93282	valid_0's binary_logloss: 0.280629	valid_1's auc: 0.907909	valid_1's binary_logloss: 0.316945
[89]	valid_0's auc: 0.933104	valid_0's binary_logloss: 0.280152	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.31701
[90]	valid_0's auc: 0.93336	valid_0's binary_logloss: 0.279675	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.31735
[91]	valid_0's auc: 0.93356	valid_0's binary_logloss: 0.279337	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.317254
[92]	valid_0's auc: 0.933782	valid_0's binary_logloss: 0.278958	valid_1's auc: 0.907664	valid_1's binary_logloss: 0.317437
[93]	valid_0's auc: 0.934021	valid_0's binary_logloss: 0.278582	valid_1's auc: 0.907579	valid_1's binary_logloss: 0.317572
[94]	valid_0's auc: 0.934212	valid_0's binary_logloss: 0.278248	valid_1's auc: 0.907515	valid_1's binary_logloss: 0.317668
[95]	valid_0's auc: 0.934444	valid_0's binary_logloss: 0.27786	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.317755
[96]	valid_0's auc: 0.934636	valid_0's binary_logloss: 0.277537	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.317832
[97]	valid_0's auc: 0.934823	valid_0's binary_logloss: 0.277222	valid_1's auc: 0.907458	valid_1's binary_logloss: 0.317821
[98]	valid_0's auc: 0.935064	valid_0's binary_logloss: 0.276787	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.317956
[99]	valid_0's auc: 0.935276	valid_0's binary_logloss: 0.276432	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.317839
[100]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.276143	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.317915
[101]	valid_0's auc: 0.935644	valid_0's binary_logloss: 0.275714	valid_1's auc: 0.907447	valid_1's binary_logloss: 0.317948
[102]	valid_0's auc: 0.935851	valid_0's binary_logloss: 0.275366	valid_1's auc: 0.907465	valid_1's binary_logloss: 0.317915
[103]	valid_0's auc: 0.936053	valid_0's binary_logloss: 0.275008	valid_1's auc: 0.90744	valid_1's binary_logloss: 0.317973
[104]	valid_0's auc: 0.936313	valid_0's binary_logloss: 0.274583	valid_1's auc: 0.907374	valid_1's binary_logloss: 0.318049
[105]	valid_0's auc: 0.936509	valid_0's binary_logloss: 0.274243	valid_1's auc: 0.907359	valid_1's binary_logloss: 0.318051
[106]	valid_0's auc: 0.936716	valid_0's binary_logloss: 0.273881	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318062
[107]	valid_0's auc: 0.936891	valid_0's binary_logloss: 0.273579	valid_1's auc: 0.907397	valid_1's binary_logloss: 0.318025
[108]	valid_0's auc: 0.937127	valid_0's binary_logloss: 0.273147	valid_1's auc: 0.907435	valid_1's binary_logloss: 0.318015
[109]	valid_0's auc: 0.937406	valid_0's binary_logloss: 0.272674	valid_1's auc: 0.90745	valid_1's binary_logloss: 0.318016
[110]	valid_0's auc: 0.937577	valid_0's binary_logloss: 0.272386	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.318049
[111]	valid_0's auc: 0.937795	valid_0's binary_logloss: 0.272011	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.318174
[112]	valid_0's auc: 0.937922	valid_0's binary_logloss: 0.271759	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318238
[113]	valid_0's auc: 0.938076	valid_0's binary_logloss: 0.271455	valid_1's auc: 0.907386	valid_1's binary_logloss: 0.318249
[114]	valid_0's auc: 0.938275	valid_0's binary_logloss: 0.271114	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318283
[115]	valid_0's auc: 0.938412	valid_0's binary_logloss: 0.270862	valid_1's auc: 0.907305	valid_1's binary_logloss: 0.31843
[116]	valid_0's auc: 0.938632	valid_0's binary_logloss: 0.270469	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318564
[117]	valid_0's auc: 0.938786	valid_0's binary_logloss: 0.270171	valid_1's auc: 0.907203	valid_1's binary_logloss: 0.318655
[118]	valid_0's auc: 0.939012	valid_0's binary_logloss: 0.269741	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318886
[119]	valid_0's auc: 0.939209	valid_0's binary_logloss: 0.269365	valid_1's auc: 0.90705	valid_1's binary_logloss: 0.318959
[120]	valid_0's auc: 0.93942	valid_0's binary_logloss: 0.268992	valid_1's auc: 0.907004	valid_1's binary_logloss: 0.319076
[121]	valid_0's auc: 0.939536	valid_0's binary_logloss: 0.268791	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.319086
[122]	valid_0's auc: 0.939826	valid_0's binary_logloss: 0.268325	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.319206
[123]	valid_0's auc: 0.940043	valid_0's binary_logloss: 0.267903	valid_1's auc: 0.906868	valid_1's binary_logloss: 0.319365
[124]	valid_0's auc: 0.940161	valid_0's binary_logloss: 0.267668	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319495
[125]	valid_0's auc: 0.940282	valid_0's binary_logloss: 0.267431	valid_1's auc: 0.90667	valid_1's binary_logloss: 0.319727
[126]	valid_0's auc: 0.940576	valid_0's binary_logloss: 0.266942	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.319905
[127]	valid_0's auc: 0.940732	valid_0's binary_logloss: 0.266683	valid_1's auc: 0.906588	valid_1's binary_logloss: 0.319875
[128]	valid_0's auc: 0.940842	valid_0's binary_logloss: 0.266468	valid_1's auc: 0.906595	valid_1's binary_logloss: 0.319894
[129]	valid_0's auc: 0.941003	valid_0's binary_logloss: 0.266163	valid_1's auc: 0.906545	valid_1's binary_logloss: 0.320003
[130]	valid_0's auc: 0.94109	valid_0's binary_logloss: 0.265972	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.319999
[131]	valid_0's auc: 0.941191	valid_0's binary_logloss: 0.26577	valid_1's auc: 0.90649	valid_1's binary_logloss: 0.320172
[132]	valid_0's auc: 0.941419	valid_0's binary_logloss: 0.265374	valid_1's auc: 0.906375	valid_1's binary_logloss: 0.320401
[133]	valid_0's auc: 0.941617	valid_0's binary_logloss: 0.265022	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320689
[134]	valid_0's auc: 0.941752	valid_0's binary_logloss: 0.264787	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.320727
[135]	valid_0's auc: 0.941954	valid_0's binary_logloss: 0.264419	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.320908
[136]	valid_0's auc: 0.942126	valid_0's binary_logloss: 0.26411	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.321062
[137]	valid_0's auc: 0.942355	valid_0's binary_logloss: 0.263696	valid_1's auc: 0.906081	valid_1's binary_logloss: 0.320968
[138]	valid_0's auc: 0.942582	valid_0's binary_logloss: 0.263291	valid_1's auc: 0.90603	valid_1's binary_logloss: 0.321118
[139]	valid_0's auc: 0.942756	valid_0's binary_logloss: 0.262965	valid_1's auc: 0.906009	valid_1's binary_logloss: 0.321225
[140]	valid_0's auc: 0.942866	valid_0's binary_logloss: 0.262712	valid_1's auc: 0.905917	valid_1's binary_logloss: 0.321456
[141]	valid_0's auc: 0.943043	valid_0's binary_logloss: 0.262361	valid_1's auc: 0.905968	valid_1's binary_logloss: 0.321378
[142]	valid_0's auc: 0.943243	valid_0's binary_logloss: 0.262006	valid_1's auc: 0.905863	valid_1's binary_logloss: 0.321487
[143]	valid_0's auc: 0.943439	valid_0's binary_logloss: 0.261645	valid_1's auc: 0.905849	valid_1's binary_logloss: 0.321548
[144]	valid_0's auc: 0.94357	valid_0's binary_logloss: 0.261404	valid_1's auc: 0.905788	valid_1's binary_logloss: 0.32168
[145]	valid_0's auc: 0.943704	valid_0's binary_logloss: 0.261131	valid_1's auc: 0.905757	valid_1's binary_logloss: 0.32177
[146]	valid_0's auc: 0.94389	valid_0's binary_logloss: 0.26079	valid_1's auc: 0.905746	valid_1's binary_logloss: 0.321802
[147]	valid_0's auc: 0.944025	valid_0's binary_logloss: 0.260532	valid_1's auc: 0.905625	valid_1's binary_logloss: 0.322039
[148]	valid_0's auc: 0.944146	valid_0's binary_logloss: 0.260281	valid_1's auc: 0.905558	valid_1's binary_logloss: 0.322194
[149]	valid_0's auc: 0.944251	valid_0's binary_logloss: 0.260031	valid_1's auc: 0.905528	valid_1's binary_logloss: 0.322313
Early stopping, best iteration is:
[49]	valid_0's auc: 0.921675	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314676
[1]	valid_0's auc: 0.888033	valid_0's binary_logloss: 0.517843	valid_1's auc: 0.894415	valid_1's binary_logloss: 0.508761
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891314	valid_0's binary_logloss: 0.489285	valid_1's auc: 0.895027	valid_1's binary_logloss: 0.479894
[3]	valid_0's auc: 0.894088	valid_0's binary_logloss: 0.465958	valid_1's auc: 0.896489	valid_1's binary_logloss: 0.456524
[4]	valid_0's auc: 0.89488	valid_0's binary_logloss: 0.446911	valid_1's auc: 0.898262	valid_1's binary_logloss: 0.43713
[5]	valid_0's auc: 0.896689	valid_0's binary_logloss: 0.430552	valid_1's auc: 0.899869	valid_1's binary_logloss: 0.420594
[6]	valid_0's auc: 0.898013	valid_0's binary_logloss: 0.416849	valid_1's auc: 0.901707	valid_1's binary_logloss: 0.406699
[7]	valid_0's auc: 0.898754	valid_0's binary_logloss: 0.405125	valid_1's auc: 0.90195	valid_1's binary_logloss: 0.395204
[8]	valid_0's auc: 0.899284	valid_0's binary_logloss: 0.395187	valid_1's auc: 0.903018	valid_1's binary_logloss: 0.385059
[9]	valid_0's auc: 0.90024	valid_0's binary_logloss: 0.386298	valid_1's auc: 0.903497	valid_1's binary_logloss: 0.376501
[10]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.378777	valid_1's auc: 0.903423	valid_1's binary_logloss: 0.369439
[11]	valid_0's auc: 0.901409	valid_0's binary_logloss: 0.372036	valid_1's auc: 0.903966	valid_1's binary_logloss: 0.362807
[12]	valid_0's auc: 0.902026	valid_0's binary_logloss: 0.366154	valid_1's auc: 0.904417	valid_1's binary_logloss: 0.357196
[13]	valid_0's auc: 0.903075	valid_0's binary_logloss: 0.360671	valid_1's auc: 0.905081	valid_1's binary_logloss: 0.352152
[14]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.355876	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.347773
[15]	valid_0's auc: 0.904685	valid_0's binary_logloss: 0.351691	valid_1's auc: 0.905867	valid_1's binary_logloss: 0.344181
[16]	valid_0's auc: 0.905378	valid_0's binary_logloss: 0.34781	valid_1's auc: 0.906444	valid_1's binary_logloss: 0.340635
[17]	valid_0's auc: 0.905952	valid_0's binary_logloss: 0.344376	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.337845
[18]	valid_0's auc: 0.906788	valid_0's binary_logloss: 0.341233	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.335275
[19]	valid_0's auc: 0.907429	valid_0's binary_logloss: 0.33838	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.333194
[20]	valid_0's auc: 0.908014	valid_0's binary_logloss: 0.33582	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.330977
[21]	valid_0's auc: 0.908813	valid_0's binary_logloss: 0.333265	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.329429
[22]	valid_0's auc: 0.909387	valid_0's binary_logloss: 0.331028	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.327796
[23]	valid_0's auc: 0.910076	valid_0's binary_logloss: 0.328812	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.326067
[24]	valid_0's auc: 0.91072	valid_0's binary_logloss: 0.326703	valid_1's auc: 0.90799	valid_1's binary_logloss: 0.324865
[25]	valid_0's auc: 0.911306	valid_0's binary_logloss: 0.324845	valid_1's auc: 0.908288	valid_1's binary_logloss: 0.32359
[26]	valid_0's auc: 0.911952	valid_0's binary_logloss: 0.323026	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.322428
[27]	valid_0's auc: 0.912603	valid_0's binary_logloss: 0.321361	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.321371
[28]	valid_0's auc: 0.913075	valid_0's binary_logloss: 0.319884	valid_1's auc: 0.9088	valid_1's binary_logloss: 0.320513
[29]	valid_0's auc: 0.913574	valid_0's binary_logloss: 0.318534	valid_1's auc: 0.908848	valid_1's binary_logloss: 0.319844
[30]	valid_0's auc: 0.914068	valid_0's binary_logloss: 0.317246	valid_1's auc: 0.90885	valid_1's binary_logloss: 0.319283
[31]	valid_0's auc: 0.914558	valid_0's binary_logloss: 0.315953	valid_1's auc: 0.908851	valid_1's binary_logloss: 0.31876
[32]	valid_0's auc: 0.915051	valid_0's binary_logloss: 0.314752	valid_1's auc: 0.908787	valid_1's binary_logloss: 0.318444
[33]	valid_0's auc: 0.915516	valid_0's binary_logloss: 0.313565	valid_1's auc: 0.908979	valid_1's binary_logloss: 0.317865
[34]	valid_0's auc: 0.915933	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.317224
[35]	valid_0's auc: 0.9164	valid_0's binary_logloss: 0.311405	valid_1's auc: 0.909273	valid_1's binary_logloss: 0.316712
[36]	valid_0's auc: 0.916866	valid_0's binary_logloss: 0.310416	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.31645
[37]	valid_0's auc: 0.917376	valid_0's binary_logloss: 0.309342	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.316021
[38]	valid_0's auc: 0.917736	valid_0's binary_logloss: 0.308518	valid_1's auc: 0.909562	valid_1's binary_logloss: 0.315703
[39]	valid_0's auc: 0.918141	valid_0's binary_logloss: 0.30761	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.315473
[40]	valid_0's auc: 0.918511	valid_0's binary_logloss: 0.306774	valid_1's auc: 0.909581	valid_1's binary_logloss: 0.315304
[41]	valid_0's auc: 0.918862	valid_0's binary_logloss: 0.305981	valid_1's auc: 0.909711	valid_1's binary_logloss: 0.314919
[42]	valid_0's auc: 0.919237	valid_0's binary_logloss: 0.305176	valid_1's auc: 0.909696	valid_1's binary_logloss: 0.314794
[43]	valid_0's auc: 0.919649	valid_0's binary_logloss: 0.304385	valid_1's auc: 0.909872	valid_1's binary_logloss: 0.314427
[44]	valid_0's auc: 0.92006	valid_0's binary_logloss: 0.303621	valid_1's auc: 0.909908	valid_1's binary_logloss: 0.314309
[45]	valid_0's auc: 0.920424	valid_0's binary_logloss: 0.302856	valid_1's auc: 0.90984	valid_1's binary_logloss: 0.314228
[46]	valid_0's auc: 0.92078	valid_0's binary_logloss: 0.302162	valid_1's auc: 0.909869	valid_1's binary_logloss: 0.314149
[47]	valid_0's auc: 0.921103	valid_0's binary_logloss: 0.301468	valid_1's auc: 0.909695	valid_1's binary_logloss: 0.31432
[48]	valid_0's auc: 0.921407	valid_0's binary_logloss: 0.300835	valid_1's auc: 0.909703	valid_1's binary_logloss: 0.314221
[49]	valid_0's auc: 0.921742	valid_0's binary_logloss: 0.300203	valid_1's auc: 0.909684	valid_1's binary_logloss: 0.314222
[50]	valid_0's auc: 0.922068	valid_0's binary_logloss: 0.299605	valid_1's auc: 0.909722	valid_1's binary_logloss: 0.314049
[51]	valid_0's auc: 0.92241	valid_0's binary_logloss: 0.299013	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.314204
[52]	valid_0's auc: 0.922698	valid_0's binary_logloss: 0.298393	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.31423
[53]	valid_0's auc: 0.922979	valid_0's binary_logloss: 0.297847	valid_1's auc: 0.909309	valid_1's binary_logloss: 0.314386
[54]	valid_0's auc: 0.923202	valid_0's binary_logloss: 0.297397	valid_1's auc: 0.909122	valid_1's binary_logloss: 0.314568
[55]	valid_0's auc: 0.923501	valid_0's binary_logloss: 0.296789	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.31469
[56]	valid_0's auc: 0.923814	valid_0's binary_logloss: 0.296245	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.314751
[57]	valid_0's auc: 0.924188	valid_0's binary_logloss: 0.295611	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.314752
[58]	valid_0's auc: 0.924446	valid_0's binary_logloss: 0.295122	valid_1's auc: 0.908888	valid_1's binary_logloss: 0.314958
[59]	valid_0's auc: 0.924765	valid_0's binary_logloss: 0.294524	valid_1's auc: 0.908787	valid_1's binary_logloss: 0.315081
[60]	valid_0's auc: 0.925074	valid_0's binary_logloss: 0.293961	valid_1's auc: 0.908717	valid_1's binary_logloss: 0.315153
[61]	valid_0's auc: 0.925376	valid_0's binary_logloss: 0.293458	valid_1's auc: 0.908761	valid_1's binary_logloss: 0.315089
[62]	valid_0's auc: 0.925659	valid_0's binary_logloss: 0.292935	valid_1's auc: 0.908605	valid_1's binary_logloss: 0.315292
[63]	valid_0's auc: 0.92594	valid_0's binary_logloss: 0.292443	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.315389
[64]	valid_0's auc: 0.926168	valid_0's binary_logloss: 0.292072	valid_1's auc: 0.908463	valid_1's binary_logloss: 0.315507
[65]	valid_0's auc: 0.926447	valid_0's binary_logloss: 0.291576	valid_1's auc: 0.908295	valid_1's binary_logloss: 0.3158
[66]	valid_0's auc: 0.926655	valid_0's binary_logloss: 0.291194	valid_1's auc: 0.908308	valid_1's binary_logloss: 0.315757
[67]	valid_0's auc: 0.926891	valid_0's binary_logloss: 0.290776	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.315707
[68]	valid_0's auc: 0.927161	valid_0's binary_logloss: 0.290318	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.315735
[69]	valid_0's auc: 0.927406	valid_0's binary_logloss: 0.289888	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.315815
[70]	valid_0's auc: 0.927699	valid_0's binary_logloss: 0.289355	valid_1's auc: 0.908193	valid_1's binary_logloss: 0.315914
[71]	valid_0's auc: 0.927929	valid_0's binary_logloss: 0.288973	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316051
[72]	valid_0's auc: 0.928152	valid_0's binary_logloss: 0.288574	valid_1's auc: 0.908114	valid_1's binary_logloss: 0.31603
[73]	valid_0's auc: 0.928397	valid_0's binary_logloss: 0.288138	valid_1's auc: 0.908018	valid_1's binary_logloss: 0.316201
[74]	valid_0's auc: 0.928656	valid_0's binary_logloss: 0.287708	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.316333
[75]	valid_0's auc: 0.929009	valid_0's binary_logloss: 0.287071	valid_1's auc: 0.907949	valid_1's binary_logloss: 0.316399
[76]	valid_0's auc: 0.929218	valid_0's binary_logloss: 0.286708	valid_1's auc: 0.907982	valid_1's binary_logloss: 0.316422
[77]	valid_0's auc: 0.929509	valid_0's binary_logloss: 0.286212	valid_1's auc: 0.907871	valid_1's binary_logloss: 0.316624
[78]	valid_0's auc: 0.929697	valid_0's binary_logloss: 0.285859	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.316737
[79]	valid_0's auc: 0.929912	valid_0's binary_logloss: 0.285493	valid_1's auc: 0.907642	valid_1's binary_logloss: 0.317008
[80]	valid_0's auc: 0.930135	valid_0's binary_logloss: 0.285137	valid_1's auc: 0.907484	valid_1's binary_logloss: 0.317235
[81]	valid_0's auc: 0.930342	valid_0's binary_logloss: 0.284743	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.317238
[82]	valid_0's auc: 0.930568	valid_0's binary_logloss: 0.284323	valid_1's auc: 0.907496	valid_1's binary_logloss: 0.317282
[83]	valid_0's auc: 0.930786	valid_0's binary_logloss: 0.283952	valid_1's auc: 0.907493	valid_1's binary_logloss: 0.317267
[84]	valid_0's auc: 0.931222	valid_0's binary_logloss: 0.283239	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.317404
[85]	valid_0's auc: 0.931417	valid_0's binary_logloss: 0.282891	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.317416
[86]	valid_0's auc: 0.931632	valid_0's binary_logloss: 0.282534	valid_1's auc: 0.907333	valid_1's binary_logloss: 0.317515
[87]	valid_0's auc: 0.931843	valid_0's binary_logloss: 0.282189	valid_1's auc: 0.907222	valid_1's binary_logloss: 0.317719
[88]	valid_0's auc: 0.932074	valid_0's binary_logloss: 0.281805	valid_1's auc: 0.907161	valid_1's binary_logloss: 0.317841
[89]	valid_0's auc: 0.932304	valid_0's binary_logloss: 0.281428	valid_1's auc: 0.907186	valid_1's binary_logloss: 0.317801
[90]	valid_0's auc: 0.932562	valid_0's binary_logloss: 0.280979	valid_1's auc: 0.907064	valid_1's binary_logloss: 0.317998
[91]	valid_0's auc: 0.932774	valid_0's binary_logloss: 0.280626	valid_1's auc: 0.907028	valid_1's binary_logloss: 0.318076
[92]	valid_0's auc: 0.933082	valid_0's binary_logloss: 0.280148	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.318142
[93]	valid_0's auc: 0.933281	valid_0's binary_logloss: 0.279776	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.318293
[94]	valid_0's auc: 0.933525	valid_0's binary_logloss: 0.279344	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.318441
[95]	valid_0's auc: 0.933784	valid_0's binary_logloss: 0.278871	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.318425
[96]	valid_0's auc: 0.934022	valid_0's binary_logloss: 0.278469	valid_1's auc: 0.906717	valid_1's binary_logloss: 0.318635
[97]	valid_0's auc: 0.934263	valid_0's binary_logloss: 0.278055	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.318543
[98]	valid_0's auc: 0.934457	valid_0's binary_logloss: 0.277703	valid_1's auc: 0.906762	valid_1's binary_logloss: 0.318644
[99]	valid_0's auc: 0.934655	valid_0's binary_logloss: 0.277349	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.318755
[100]	valid_0's auc: 0.934872	valid_0's binary_logloss: 0.277017	valid_1's auc: 0.906666	valid_1's binary_logloss: 0.31879
[101]	valid_0's auc: 0.935102	valid_0's binary_logloss: 0.276596	valid_1's auc: 0.90661	valid_1's binary_logloss: 0.31892
[102]	valid_0's auc: 0.935303	valid_0's binary_logloss: 0.276263	valid_1's auc: 0.906577	valid_1's binary_logloss: 0.31893
[103]	valid_0's auc: 0.935513	valid_0's binary_logloss: 0.275929	valid_1's auc: 0.906651	valid_1's binary_logloss: 0.318777
[104]	valid_0's auc: 0.935808	valid_0's binary_logloss: 0.275425	valid_1's auc: 0.906557	valid_1's binary_logloss: 0.318935
[105]	valid_0's auc: 0.936087	valid_0's binary_logloss: 0.274937	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.318834
[106]	valid_0's auc: 0.936247	valid_0's binary_logloss: 0.274631	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.318816
[107]	valid_0's auc: 0.936479	valid_0's binary_logloss: 0.274226	valid_1's auc: 0.906645	valid_1's binary_logloss: 0.318853
[108]	valid_0's auc: 0.936629	valid_0's binary_logloss: 0.273954	valid_1's auc: 0.906586	valid_1's binary_logloss: 0.318956
[109]	valid_0's auc: 0.936911	valid_0's binary_logloss: 0.273455	valid_1's auc: 0.90657	valid_1's binary_logloss: 0.318974
[110]	valid_0's auc: 0.937063	valid_0's binary_logloss: 0.273161	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.319045
[111]	valid_0's auc: 0.937286	valid_0's binary_logloss: 0.272764	valid_1's auc: 0.906541	valid_1's binary_logloss: 0.319083
[112]	valid_0's auc: 0.937442	valid_0's binary_logloss: 0.272485	valid_1's auc: 0.906427	valid_1's binary_logloss: 0.319304
[113]	valid_0's auc: 0.937607	valid_0's binary_logloss: 0.272161	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.319314
[114]	valid_0's auc: 0.937814	valid_0's binary_logloss: 0.271768	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.319279
[115]	valid_0's auc: 0.937948	valid_0's binary_logloss: 0.271523	valid_1's auc: 0.906272	valid_1's binary_logloss: 0.319493
[116]	valid_0's auc: 0.938176	valid_0's binary_logloss: 0.271117	valid_1's auc: 0.906295	valid_1's binary_logloss: 0.319481
[117]	valid_0's auc: 0.93832	valid_0's binary_logloss: 0.270858	valid_1's auc: 0.906302	valid_1's binary_logloss: 0.319525
[118]	valid_0's auc: 0.938539	valid_0's binary_logloss: 0.27048	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.319558
[119]	valid_0's auc: 0.938731	valid_0's binary_logloss: 0.270106	valid_1's auc: 0.906241	valid_1's binary_logloss: 0.319615
[120]	valid_0's auc: 0.938832	valid_0's binary_logloss: 0.269895	valid_1's auc: 0.906175	valid_1's binary_logloss: 0.319733
[121]	valid_0's auc: 0.939085	valid_0's binary_logloss: 0.269444	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.319898
[122]	valid_0's auc: 0.939271	valid_0's binary_logloss: 0.269064	valid_1's auc: 0.906087	valid_1's binary_logloss: 0.319963
[123]	valid_0's auc: 0.939446	valid_0's binary_logloss: 0.268732	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.319934
[124]	valid_0's auc: 0.939751	valid_0's binary_logloss: 0.268197	valid_1's auc: 0.906137	valid_1's binary_logloss: 0.31993
[125]	valid_0's auc: 0.939953	valid_0's binary_logloss: 0.267854	valid_1's auc: 0.906114	valid_1's binary_logloss: 0.319967
[126]	valid_0's auc: 0.940155	valid_0's binary_logloss: 0.267477	valid_1's auc: 0.905991	valid_1's binary_logloss: 0.320203
[127]	valid_0's auc: 0.940377	valid_0's binary_logloss: 0.267102	valid_1's auc: 0.905884	valid_1's binary_logloss: 0.320402
[128]	valid_0's auc: 0.940461	valid_0's binary_logloss: 0.266968	valid_1's auc: 0.905811	valid_1's binary_logloss: 0.320519
[129]	valid_0's auc: 0.940603	valid_0's binary_logloss: 0.266682	valid_1's auc: 0.905678	valid_1's binary_logloss: 0.320746
[130]	valid_0's auc: 0.940723	valid_0's binary_logloss: 0.266452	valid_1's auc: 0.905646	valid_1's binary_logloss: 0.320798
[131]	valid_0's auc: 0.940886	valid_0's binary_logloss: 0.266154	valid_1's auc: 0.905564	valid_1's binary_logloss: 0.320951
[132]	valid_0's auc: 0.941082	valid_0's binary_logloss: 0.265797	valid_1's auc: 0.905555	valid_1's binary_logloss: 0.321029
[133]	valid_0's auc: 0.941258	valid_0's binary_logloss: 0.26548	valid_1's auc: 0.905499	valid_1's binary_logloss: 0.321176
[134]	valid_0's auc: 0.941408	valid_0's binary_logloss: 0.265197	valid_1's auc: 0.905504	valid_1's binary_logloss: 0.321212
[135]	valid_0's auc: 0.941585	valid_0's binary_logloss: 0.264899	valid_1's auc: 0.905472	valid_1's binary_logloss: 0.321283
[136]	valid_0's auc: 0.941752	valid_0's binary_logloss: 0.264596	valid_1's auc: 0.905475	valid_1's binary_logloss: 0.321274
[137]	valid_0's auc: 0.941876	valid_0's binary_logloss: 0.264318	valid_1's auc: 0.90545	valid_1's binary_logloss: 0.321395
[138]	valid_0's auc: 0.941984	valid_0's binary_logloss: 0.264114	valid_1's auc: 0.905349	valid_1's binary_logloss: 0.32161
[139]	valid_0's auc: 0.942105	valid_0's binary_logloss: 0.2639	valid_1's auc: 0.905276	valid_1's binary_logloss: 0.321741
[140]	valid_0's auc: 0.942265	valid_0's binary_logloss: 0.263611	valid_1's auc: 0.905243	valid_1's binary_logloss: 0.321833
[141]	valid_0's auc: 0.942442	valid_0's binary_logloss: 0.263265	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.321973
[142]	valid_0's auc: 0.942583	valid_0's binary_logloss: 0.262999	valid_1's auc: 0.905187	valid_1's binary_logloss: 0.322021
[143]	valid_0's auc: 0.942771	valid_0's binary_logloss: 0.262666	valid_1's auc: 0.905251	valid_1's binary_logloss: 0.321921
[144]	valid_0's auc: 0.942945	valid_0's binary_logloss: 0.262335	valid_1's auc: 0.905303	valid_1's binary_logloss: 0.321872
Early stopping, best iteration is:
[44]	valid_0's auc: 0.92006	valid_0's binary_logloss: 0.303621	valid_1's auc: 0.909908	valid_1's binary_logloss: 0.314309
[1]	valid_0's auc: 0.887858	valid_0's binary_logloss: 0.516982	valid_1's auc: 0.894799	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89299	valid_0's binary_logloss: 0.488143	valid_1's auc: 0.899409	valid_1's binary_logloss: 0.478442
[3]	valid_0's auc: 0.894141	valid_0's binary_logloss: 0.464911	valid_1's auc: 0.900492	valid_1's binary_logloss: 0.454848
[4]	valid_0's auc: 0.89588	valid_0's binary_logloss: 0.445631	valid_1's auc: 0.9015	valid_1's binary_logloss: 0.435366
[5]	valid_0's auc: 0.896299	valid_0's binary_logloss: 0.429674	valid_1's auc: 0.902037	valid_1's binary_logloss: 0.419456
[6]	valid_0's auc: 0.897764	valid_0's binary_logloss: 0.415869	valid_1's auc: 0.90356	valid_1's binary_logloss: 0.405588
[7]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.40445	valid_1's auc: 0.903498	valid_1's binary_logloss: 0.394181
[8]	valid_0's auc: 0.899739	valid_0's binary_logloss: 0.394387	valid_1's auc: 0.904256	valid_1's binary_logloss: 0.384278
[9]	valid_0's auc: 0.900665	valid_0's binary_logloss: 0.385622	valid_1's auc: 0.90431	valid_1's binary_logloss: 0.376255
[10]	valid_0's auc: 0.901172	valid_0's binary_logloss: 0.378008	valid_1's auc: 0.904383	valid_1's binary_logloss: 0.369035
[11]	valid_0's auc: 0.901958	valid_0's binary_logloss: 0.371271	valid_1's auc: 0.904536	valid_1's binary_logloss: 0.362695
[12]	valid_0's auc: 0.902712	valid_0's binary_logloss: 0.365325	valid_1's auc: 0.904917	valid_1's binary_logloss: 0.357165
[13]	valid_0's auc: 0.903607	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.905448	valid_1's binary_logloss: 0.352189
[14]	valid_0's auc: 0.90411	valid_0's binary_logloss: 0.355367	valid_1's auc: 0.905582	valid_1's binary_logloss: 0.347845
[15]	valid_0's auc: 0.905142	valid_0's binary_logloss: 0.351087	valid_1's auc: 0.905872	valid_1's binary_logloss: 0.344197
[16]	valid_0's auc: 0.905715	valid_0's binary_logloss: 0.347394	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.340902
[17]	valid_0's auc: 0.906452	valid_0's binary_logloss: 0.343859	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.338101
[18]	valid_0's auc: 0.907111	valid_0's binary_logloss: 0.340666	valid_1's auc: 0.906431	valid_1's binary_logloss: 0.335674
[19]	valid_0's auc: 0.908026	valid_0's binary_logloss: 0.337582	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.333435
[20]	valid_0's auc: 0.908829	valid_0's binary_logloss: 0.334831	valid_1's auc: 0.906869	valid_1's binary_logloss: 0.331543
[21]	valid_0's auc: 0.909441	valid_0's binary_logloss: 0.332471	valid_1's auc: 0.907297	valid_1's binary_logloss: 0.329665
[22]	valid_0's auc: 0.91014	valid_0's binary_logloss: 0.330146	valid_1's auc: 0.907746	valid_1's binary_logloss: 0.327827
[23]	valid_0's auc: 0.910809	valid_0's binary_logloss: 0.327961	valid_1's auc: 0.907802	valid_1's binary_logloss: 0.326481
[24]	valid_0's auc: 0.911434	valid_0's binary_logloss: 0.325861	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.325187
[25]	valid_0's auc: 0.911977	valid_0's binary_logloss: 0.324096	valid_1's auc: 0.908145	valid_1's binary_logloss: 0.32394
[26]	valid_0's auc: 0.912594	valid_0's binary_logloss: 0.322352	valid_1's auc: 0.908181	valid_1's binary_logloss: 0.322983
[27]	valid_0's auc: 0.913045	valid_0's binary_logloss: 0.320869	valid_1's auc: 0.908244	valid_1's binary_logloss: 0.32208
[28]	valid_0's auc: 0.913716	valid_0's binary_logloss: 0.319176	valid_1's auc: 0.90844	valid_1's binary_logloss: 0.321187
[29]	valid_0's auc: 0.914226	valid_0's binary_logloss: 0.317778	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.320412
[30]	valid_0's auc: 0.914698	valid_0's binary_logloss: 0.316445	valid_1's auc: 0.908478	valid_1's binary_logloss: 0.32001
[31]	valid_0's auc: 0.915169	valid_0's binary_logloss: 0.315202	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.319465
[32]	valid_0's auc: 0.915602	valid_0's binary_logloss: 0.314007	valid_1's auc: 0.908716	valid_1's binary_logloss: 0.318874
[33]	valid_0's auc: 0.916023	valid_0's binary_logloss: 0.31286	valid_1's auc: 0.908919	valid_1's binary_logloss: 0.318228
[34]	valid_0's auc: 0.91644	valid_0's binary_logloss: 0.311748	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.317768
[35]	valid_0's auc: 0.916777	valid_0's binary_logloss: 0.310816	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.317525
[36]	valid_0's auc: 0.91713	valid_0's binary_logloss: 0.309928	valid_1's auc: 0.908993	valid_1's binary_logloss: 0.317207
[37]	valid_0's auc: 0.917571	valid_0's binary_logloss: 0.308946	valid_1's auc: 0.909045	valid_1's binary_logloss: 0.316908
[38]	valid_0's auc: 0.918087	valid_0's binary_logloss: 0.307902	valid_1's auc: 0.909173	valid_1's binary_logloss: 0.316577
[39]	valid_0's auc: 0.918438	valid_0's binary_logloss: 0.307028	valid_1's auc: 0.909105	valid_1's binary_logloss: 0.316393
[40]	valid_0's auc: 0.918855	valid_0's binary_logloss: 0.306172	valid_1's auc: 0.90932	valid_1's binary_logloss: 0.315911
[41]	valid_0's auc: 0.919183	valid_0's binary_logloss: 0.3054	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.315829
[42]	valid_0's auc: 0.919459	valid_0's binary_logloss: 0.3047	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.315841
[43]	valid_0's auc: 0.919816	valid_0's binary_logloss: 0.303929	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.315456
[44]	valid_0's auc: 0.920082	valid_0's binary_logloss: 0.303293	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.315411
[45]	valid_0's auc: 0.92055	valid_0's binary_logloss: 0.302468	valid_1's auc: 0.909361	valid_1's binary_logloss: 0.315353
[46]	valid_0's auc: 0.920827	valid_0's binary_logloss: 0.301886	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.315287
[47]	valid_0's auc: 0.921206	valid_0's binary_logloss: 0.301167	valid_1's auc: 0.90928	valid_1's binary_logloss: 0.315288
[48]	valid_0's auc: 0.921498	valid_0's binary_logloss: 0.300584	valid_1's auc: 0.90929	valid_1's binary_logloss: 0.315197
[49]	valid_0's auc: 0.921886	valid_0's binary_logloss: 0.299891	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.315312
[50]	valid_0's auc: 0.922149	valid_0's binary_logloss: 0.299339	valid_1's auc: 0.909228	valid_1's binary_logloss: 0.315256
[51]	valid_0's auc: 0.92257	valid_0's binary_logloss: 0.29862	valid_1's auc: 0.909199	valid_1's binary_logloss: 0.31522
[52]	valid_0's auc: 0.922878	valid_0's binary_logloss: 0.298042	valid_1's auc: 0.909171	valid_1's binary_logloss: 0.315223
[53]	valid_0's auc: 0.923201	valid_0's binary_logloss: 0.297448	valid_1's auc: 0.909102	valid_1's binary_logloss: 0.315331
[54]	valid_0's auc: 0.923492	valid_0's binary_logloss: 0.296867	valid_1's auc: 0.909004	valid_1's binary_logloss: 0.315434
[55]	valid_0's auc: 0.923733	valid_0's binary_logloss: 0.296339	valid_1's auc: 0.909076	valid_1's binary_logloss: 0.315373
[56]	valid_0's auc: 0.924035	valid_0's binary_logloss: 0.295774	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.315384
[57]	valid_0's auc: 0.924395	valid_0's binary_logloss: 0.295161	valid_1's auc: 0.909025	valid_1's binary_logloss: 0.315401
[58]	valid_0's auc: 0.924687	valid_0's binary_logloss: 0.294643	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.315403
[59]	valid_0's auc: 0.924983	valid_0's binary_logloss: 0.294096	valid_1's auc: 0.909091	valid_1's binary_logloss: 0.31529
[60]	valid_0's auc: 0.925167	valid_0's binary_logloss: 0.293715	valid_1's auc: 0.908991	valid_1's binary_logloss: 0.315386
[61]	valid_0's auc: 0.925512	valid_0's binary_logloss: 0.293095	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.315297
[62]	valid_0's auc: 0.925783	valid_0's binary_logloss: 0.292625	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.315394
[63]	valid_0's auc: 0.926055	valid_0's binary_logloss: 0.29211	valid_1's auc: 0.908953	valid_1's binary_logloss: 0.315397
[64]	valid_0's auc: 0.926402	valid_0's binary_logloss: 0.291511	valid_1's auc: 0.908982	valid_1's binary_logloss: 0.315382
[65]	valid_0's auc: 0.926786	valid_0's binary_logloss: 0.290862	valid_1's auc: 0.909007	valid_1's binary_logloss: 0.31532
[66]	valid_0's auc: 0.92699	valid_0's binary_logloss: 0.29049	valid_1's auc: 0.909031	valid_1's binary_logloss: 0.315264
[67]	valid_0's auc: 0.927239	valid_0's binary_logloss: 0.290075	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.31528
[68]	valid_0's auc: 0.927526	valid_0's binary_logloss: 0.289601	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.315519
[69]	valid_0's auc: 0.927745	valid_0's binary_logloss: 0.28919	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.315623
[70]	valid_0's auc: 0.927945	valid_0's binary_logloss: 0.288799	valid_1's auc: 0.908739	valid_1's binary_logloss: 0.315671
[71]	valid_0's auc: 0.928182	valid_0's binary_logloss: 0.288379	valid_1's auc: 0.908631	valid_1's binary_logloss: 0.315797
[72]	valid_0's auc: 0.928436	valid_0's binary_logloss: 0.287961	valid_1's auc: 0.908523	valid_1's binary_logloss: 0.315984
[73]	valid_0's auc: 0.928782	valid_0's binary_logloss: 0.287393	valid_1's auc: 0.908517	valid_1's binary_logloss: 0.316032
[74]	valid_0's auc: 0.929068	valid_0's binary_logloss: 0.286899	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.316055
[75]	valid_0's auc: 0.929395	valid_0's binary_logloss: 0.286326	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.316029
[76]	valid_0's auc: 0.929599	valid_0's binary_logloss: 0.285948	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.316129
[77]	valid_0's auc: 0.929816	valid_0's binary_logloss: 0.285554	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.316251
[78]	valid_0's auc: 0.93004	valid_0's binary_logloss: 0.285133	valid_1's auc: 0.908441	valid_1's binary_logloss: 0.316173
[79]	valid_0's auc: 0.930266	valid_0's binary_logloss: 0.284748	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.316138
[80]	valid_0's auc: 0.930542	valid_0's binary_logloss: 0.28426	valid_1's auc: 0.908382	valid_1's binary_logloss: 0.316257
[81]	valid_0's auc: 0.93075	valid_0's binary_logloss: 0.283862	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316258
[82]	valid_0's auc: 0.930986	valid_0's binary_logloss: 0.283501	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316358
[83]	valid_0's auc: 0.931161	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.908334	valid_1's binary_logloss: 0.316404
[84]	valid_0's auc: 0.931393	valid_0's binary_logloss: 0.282794	valid_1's auc: 0.908283	valid_1's binary_logloss: 0.316471
[85]	valid_0's auc: 0.931658	valid_0's binary_logloss: 0.282299	valid_1's auc: 0.908191	valid_1's binary_logloss: 0.31667
[86]	valid_0's auc: 0.931883	valid_0's binary_logloss: 0.281936	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.316716
[87]	valid_0's auc: 0.932145	valid_0's binary_logloss: 0.281495	valid_1's auc: 0.908263	valid_1's binary_logloss: 0.316565
[88]	valid_0's auc: 0.932438	valid_0's binary_logloss: 0.280973	valid_1's auc: 0.908219	valid_1's binary_logloss: 0.316618
[89]	valid_0's auc: 0.932675	valid_0's binary_logloss: 0.280547	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316755
[90]	valid_0's auc: 0.932971	valid_0's binary_logloss: 0.280071	valid_1's auc: 0.908047	valid_1's binary_logloss: 0.316963
[91]	valid_0's auc: 0.93322	valid_0's binary_logloss: 0.279664	valid_1's auc: 0.907976	valid_1's binary_logloss: 0.317065
[92]	valid_0's auc: 0.933488	valid_0's binary_logloss: 0.279221	valid_1's auc: 0.907931	valid_1's binary_logloss: 0.317137
[93]	valid_0's auc: 0.933708	valid_0's binary_logloss: 0.278855	valid_1's auc: 0.907804	valid_1's binary_logloss: 0.317367
[94]	valid_0's auc: 0.933975	valid_0's binary_logloss: 0.278407	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317391
[95]	valid_0's auc: 0.934122	valid_0's binary_logloss: 0.278117	valid_1's auc: 0.907704	valid_1's binary_logloss: 0.317605
[96]	valid_0's auc: 0.934399	valid_0's binary_logloss: 0.277664	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.317775
[97]	valid_0's auc: 0.934666	valid_0's binary_logloss: 0.277252	valid_1's auc: 0.907631	valid_1's binary_logloss: 0.317793
[98]	valid_0's auc: 0.934888	valid_0's binary_logloss: 0.276893	valid_1's auc: 0.907468	valid_1's binary_logloss: 0.318063
[99]	valid_0's auc: 0.935105	valid_0's binary_logloss: 0.276511	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318194
[100]	valid_0's auc: 0.93526	valid_0's binary_logloss: 0.276189	valid_1's auc: 0.90731	valid_1's binary_logloss: 0.318313
[101]	valid_0's auc: 0.935496	valid_0's binary_logloss: 0.275784	valid_1's auc: 0.907349	valid_1's binary_logloss: 0.318327
[102]	valid_0's auc: 0.935663	valid_0's binary_logloss: 0.275472	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318516
[103]	valid_0's auc: 0.935884	valid_0's binary_logloss: 0.275078	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318718
[104]	valid_0's auc: 0.936088	valid_0's binary_logloss: 0.27471	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318854
[105]	valid_0's auc: 0.936317	valid_0's binary_logloss: 0.274273	valid_1's auc: 0.906972	valid_1's binary_logloss: 0.319061
[106]	valid_0's auc: 0.936551	valid_0's binary_logloss: 0.273872	valid_1's auc: 0.906858	valid_1's binary_logloss: 0.31929
[107]	valid_0's auc: 0.936776	valid_0's binary_logloss: 0.273498	valid_1's auc: 0.906813	valid_1's binary_logloss: 0.319375
[108]	valid_0's auc: 0.936902	valid_0's binary_logloss: 0.273229	valid_1's auc: 0.906744	valid_1's binary_logloss: 0.3195
[109]	valid_0's auc: 0.93709	valid_0's binary_logloss: 0.272894	valid_1's auc: 0.90671	valid_1's binary_logloss: 0.319547
[110]	valid_0's auc: 0.937341	valid_0's binary_logloss: 0.272452	valid_1's auc: 0.906785	valid_1's binary_logloss: 0.319388
[111]	valid_0's auc: 0.937508	valid_0's binary_logloss: 0.272141	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.319403
[112]	valid_0's auc: 0.937718	valid_0's binary_logloss: 0.271789	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319359
[113]	valid_0's auc: 0.93782	valid_0's binary_logloss: 0.271585	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319381
[114]	valid_0's auc: 0.938084	valid_0's binary_logloss: 0.271165	valid_1's auc: 0.906776	valid_1's binary_logloss: 0.319469
[115]	valid_0's auc: 0.938266	valid_0's binary_logloss: 0.270857	valid_1's auc: 0.906737	valid_1's binary_logloss: 0.319603
[116]	valid_0's auc: 0.938436	valid_0's binary_logloss: 0.270574	valid_1's auc: 0.906653	valid_1's binary_logloss: 0.319782
[117]	valid_0's auc: 0.938625	valid_0's binary_logloss: 0.270232	valid_1's auc: 0.906602	valid_1's binary_logloss: 0.319926
[118]	valid_0's auc: 0.938825	valid_0's binary_logloss: 0.269882	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.320129
[119]	valid_0's auc: 0.939	valid_0's binary_logloss: 0.269554	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.320087
[120]	valid_0's auc: 0.939166	valid_0's binary_logloss: 0.269265	valid_1's auc: 0.906422	valid_1's binary_logloss: 0.320269
[121]	valid_0's auc: 0.939309	valid_0's binary_logloss: 0.268978	valid_1's auc: 0.906342	valid_1's binary_logloss: 0.320396
[122]	valid_0's auc: 0.939493	valid_0's binary_logloss: 0.268676	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.320565
[123]	valid_0's auc: 0.939646	valid_0's binary_logloss: 0.26838	valid_1's auc: 0.906306	valid_1's binary_logloss: 0.320636
[124]	valid_0's auc: 0.939836	valid_0's binary_logloss: 0.267995	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.32075
[125]	valid_0's auc: 0.939919	valid_0's binary_logloss: 0.267796	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320867
[126]	valid_0's auc: 0.940094	valid_0's binary_logloss: 0.267491	valid_1's auc: 0.906134	valid_1's binary_logloss: 0.321028
[127]	valid_0's auc: 0.940301	valid_0's binary_logloss: 0.267094	valid_1's auc: 0.906103	valid_1's binary_logloss: 0.321137
[128]	valid_0's auc: 0.940535	valid_0's binary_logloss: 0.266721	valid_1's auc: 0.906173	valid_1's binary_logloss: 0.320977
[129]	valid_0's auc: 0.940682	valid_0's binary_logloss: 0.266442	valid_1's auc: 0.906065	valid_1's binary_logloss: 0.3212
[130]	valid_0's auc: 0.940879	valid_0's binary_logloss: 0.26606	valid_1's auc: 0.905952	valid_1's binary_logloss: 0.321387
[131]	valid_0's auc: 0.94107	valid_0's binary_logloss: 0.265705	valid_1's auc: 0.905921	valid_1's binary_logloss: 0.321485
[132]	valid_0's auc: 0.941196	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.905913	valid_1's binary_logloss: 0.321495
[133]	valid_0's auc: 0.941291	valid_0's binary_logloss: 0.265279	valid_1's auc: 0.905931	valid_1's binary_logloss: 0.321496
[134]	valid_0's auc: 0.941477	valid_0's binary_logloss: 0.264941	valid_1's auc: 0.905955	valid_1's binary_logloss: 0.321444
[135]	valid_0's auc: 0.941699	valid_0's binary_logloss: 0.264558	valid_1's auc: 0.905845	valid_1's binary_logloss: 0.321615
[136]	valid_0's auc: 0.941878	valid_0's binary_logloss: 0.264215	valid_1's auc: 0.905814	valid_1's binary_logloss: 0.321703
[137]	valid_0's auc: 0.942058	valid_0's binary_logloss: 0.263906	valid_1's auc: 0.905729	valid_1's binary_logloss: 0.321854
[138]	valid_0's auc: 0.942317	valid_0's binary_logloss: 0.263455	valid_1's auc: 0.905624	valid_1's binary_logloss: 0.322095
[139]	valid_0's auc: 0.942481	valid_0's binary_logloss: 0.263162	valid_1's auc: 0.905542	valid_1's binary_logloss: 0.322257
[140]	valid_0's auc: 0.942719	valid_0's binary_logloss: 0.262773	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.322355
[141]	valid_0's auc: 0.942903	valid_0's binary_logloss: 0.262462	valid_1's auc: 0.905295	valid_1's binary_logloss: 0.322719
[142]	valid_0's auc: 0.943022	valid_0's binary_logloss: 0.262222	valid_1's auc: 0.905373	valid_1's binary_logloss: 0.322579
[143]	valid_0's auc: 0.943175	valid_0's binary_logloss: 0.261945	valid_1's auc: 0.905431	valid_1's binary_logloss: 0.322543
Early stopping, best iteration is:
[43]	valid_0's auc: 0.919816	valid_0's binary_logloss: 0.303929	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.315456
[1]	valid_0's auc: 0.886572	valid_0's binary_logloss: 0.517393	valid_1's auc: 0.891691	valid_1's binary_logloss: 0.508845
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889325	valid_0's binary_logloss: 0.48844	valid_1's auc: 0.895182	valid_1's binary_logloss: 0.47942
[3]	valid_0's auc: 0.890907	valid_0's binary_logloss: 0.465197	valid_1's auc: 0.896562	valid_1's binary_logloss: 0.455809
[4]	valid_0's auc: 0.89514	valid_0's binary_logloss: 0.445768	valid_1's auc: 0.899296	valid_1's binary_logloss: 0.43648
[5]	valid_0's auc: 0.896951	valid_0's binary_logloss: 0.42971	valid_1's auc: 0.899718	valid_1's binary_logloss: 0.420604
[6]	valid_0's auc: 0.897889	valid_0's binary_logloss: 0.416111	valid_1's auc: 0.900881	valid_1's binary_logloss: 0.406931
[7]	valid_0's auc: 0.898689	valid_0's binary_logloss: 0.404436	valid_1's auc: 0.901422	valid_1's binary_logloss: 0.395411
[8]	valid_0's auc: 0.89958	valid_0's binary_logloss: 0.394345	valid_1's auc: 0.902597	valid_1's binary_logloss: 0.385225
[9]	valid_0's auc: 0.90032	valid_0's binary_logloss: 0.385639	valid_1's auc: 0.902948	valid_1's binary_logloss: 0.376863
[10]	valid_0's auc: 0.901296	valid_0's binary_logloss: 0.378042	valid_1's auc: 0.903458	valid_1's binary_logloss: 0.369727
[11]	valid_0's auc: 0.902004	valid_0's binary_logloss: 0.371306	valid_1's auc: 0.903438	valid_1's binary_logloss: 0.363518
[12]	valid_0's auc: 0.902758	valid_0's binary_logloss: 0.365335	valid_1's auc: 0.903948	valid_1's binary_logloss: 0.357923
[13]	valid_0's auc: 0.903856	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.904456	valid_1's binary_logloss: 0.353137
[14]	valid_0's auc: 0.904376	valid_0's binary_logloss: 0.355393	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.348708
[15]	valid_0's auc: 0.905155	valid_0's binary_logloss: 0.351161	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.345105
[16]	valid_0's auc: 0.905871	valid_0's binary_logloss: 0.347288	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.341559
[17]	valid_0's auc: 0.90683	valid_0's binary_logloss: 0.343704	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.338621
[18]	valid_0's auc: 0.90744	valid_0's binary_logloss: 0.340595	valid_1's auc: 0.906705	valid_1's binary_logloss: 0.336005
[19]	valid_0's auc: 0.908245	valid_0's binary_logloss: 0.337639	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.333835
[20]	valid_0's auc: 0.908769	valid_0's binary_logloss: 0.335121	valid_1's auc: 0.906857	valid_1's binary_logloss: 0.332
[21]	valid_0's auc: 0.909625	valid_0's binary_logloss: 0.332551	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.330061
[22]	valid_0's auc: 0.910309	valid_0's binary_logloss: 0.330205	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.328665
[23]	valid_0's auc: 0.910705	valid_0's binary_logloss: 0.32828	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.327131
[24]	valid_0's auc: 0.911375	valid_0's binary_logloss: 0.32623	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.325809
[25]	valid_0's auc: 0.911914	valid_0's binary_logloss: 0.324421	valid_1's auc: 0.907602	valid_1's binary_logloss: 0.324596
[26]	valid_0's auc: 0.912336	valid_0's binary_logloss: 0.322802	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.323522
[27]	valid_0's auc: 0.912859	valid_0's binary_logloss: 0.321261	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.322844
[28]	valid_0's auc: 0.913424	valid_0's binary_logloss: 0.319703	valid_1's auc: 0.908143	valid_1's binary_logloss: 0.321905
[29]	valid_0's auc: 0.913896	valid_0's binary_logloss: 0.318274	valid_1's auc: 0.908367	valid_1's binary_logloss: 0.320959
[30]	valid_0's auc: 0.914282	valid_0's binary_logloss: 0.317012	valid_1's auc: 0.908386	valid_1's binary_logloss: 0.320424
[31]	valid_0's auc: 0.914767	valid_0's binary_logloss: 0.31572	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.319982
[32]	valid_0's auc: 0.915194	valid_0's binary_logloss: 0.314571	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.319529
[33]	valid_0's auc: 0.915607	valid_0's binary_logloss: 0.313531	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.319073
[34]	valid_0's auc: 0.916045	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.318693
[35]	valid_0's auc: 0.916433	valid_0's binary_logloss: 0.311436	valid_1's auc: 0.908496	valid_1's binary_logloss: 0.31834
[36]	valid_0's auc: 0.916799	valid_0's binary_logloss: 0.310539	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.318183
[37]	valid_0's auc: 0.917263	valid_0's binary_logloss: 0.309483	valid_1's auc: 0.908437	valid_1's binary_logloss: 0.317954
[38]	valid_0's auc: 0.917766	valid_0's binary_logloss: 0.30852	valid_1's auc: 0.908403	valid_1's binary_logloss: 0.317848
[39]	valid_0's auc: 0.918172	valid_0's binary_logloss: 0.3076	valid_1's auc: 0.908529	valid_1's binary_logloss: 0.317562
[40]	valid_0's auc: 0.918559	valid_0's binary_logloss: 0.306776	valid_1's auc: 0.908434	valid_1's binary_logloss: 0.317469
[41]	valid_0's auc: 0.918866	valid_0's binary_logloss: 0.305998	valid_1's auc: 0.908414	valid_1's binary_logloss: 0.31731
[42]	valid_0's auc: 0.919216	valid_0's binary_logloss: 0.30518	valid_1's auc: 0.908398	valid_1's binary_logloss: 0.317191
[43]	valid_0's auc: 0.919589	valid_0's binary_logloss: 0.30439	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.317173
[44]	valid_0's auc: 0.91996	valid_0's binary_logloss: 0.303628	valid_1's auc: 0.908413	valid_1's binary_logloss: 0.316965
[45]	valid_0's auc: 0.920328	valid_0's binary_logloss: 0.302886	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.317024
[46]	valid_0's auc: 0.920652	valid_0's binary_logloss: 0.302256	valid_1's auc: 0.908283	valid_1's binary_logloss: 0.31696
[47]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.301491	valid_1's auc: 0.908378	valid_1's binary_logloss: 0.316761
[48]	valid_0's auc: 0.92142	valid_0's binary_logloss: 0.300747	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.316573
[49]	valid_0's auc: 0.921785	valid_0's binary_logloss: 0.300074	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316581
[50]	valid_0's auc: 0.922071	valid_0's binary_logloss: 0.299563	valid_1's auc: 0.908311	valid_1's binary_logloss: 0.316637
[51]	valid_0's auc: 0.922491	valid_0's binary_logloss: 0.298886	valid_1's auc: 0.90821	valid_1's binary_logloss: 0.3168
[52]	valid_0's auc: 0.922825	valid_0's binary_logloss: 0.298279	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.316724
[53]	valid_0's auc: 0.923173	valid_0's binary_logloss: 0.297619	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316809
[54]	valid_0's auc: 0.923539	valid_0's binary_logloss: 0.296976	valid_1's auc: 0.90821	valid_1's binary_logloss: 0.316646
[55]	valid_0's auc: 0.923814	valid_0's binary_logloss: 0.296438	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.316824
[56]	valid_0's auc: 0.924108	valid_0's binary_logloss: 0.295903	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.316942
[57]	valid_0's auc: 0.924357	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.907962	valid_1's binary_logloss: 0.31703
[58]	valid_0's auc: 0.924604	valid_0's binary_logloss: 0.29492	valid_1's auc: 0.90793	valid_1's binary_logloss: 0.317067
[59]	valid_0's auc: 0.924905	valid_0's binary_logloss: 0.294339	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317052
[60]	valid_0's auc: 0.925191	valid_0's binary_logloss: 0.293826	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.317022
[61]	valid_0's auc: 0.925411	valid_0's binary_logloss: 0.293354	valid_1's auc: 0.907854	valid_1's binary_logloss: 0.317145
[62]	valid_0's auc: 0.925682	valid_0's binary_logloss: 0.292869	valid_1's auc: 0.907833	valid_1's binary_logloss: 0.317196
[63]	valid_0's auc: 0.925922	valid_0's binary_logloss: 0.292435	valid_1's auc: 0.90781	valid_1's binary_logloss: 0.317237
[64]	valid_0's auc: 0.926188	valid_0's binary_logloss: 0.291982	valid_1's auc: 0.907712	valid_1's binary_logloss: 0.317364
[65]	valid_0's auc: 0.926393	valid_0's binary_logloss: 0.291572	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.317424
[66]	valid_0's auc: 0.926764	valid_0's binary_logloss: 0.290996	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.317293
[67]	valid_0's auc: 0.927104	valid_0's binary_logloss: 0.290424	valid_1's auc: 0.907817	valid_1's binary_logloss: 0.317178
[68]	valid_0's auc: 0.927276	valid_0's binary_logloss: 0.290111	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317219
[69]	valid_0's auc: 0.927533	valid_0's binary_logloss: 0.289635	valid_1's auc: 0.907759	valid_1's binary_logloss: 0.31729
[70]	valid_0's auc: 0.927837	valid_0's binary_logloss: 0.289139	valid_1's auc: 0.907756	valid_1's binary_logloss: 0.317295
[71]	valid_0's auc: 0.928046	valid_0's binary_logloss: 0.288758	valid_1's auc: 0.907778	valid_1's binary_logloss: 0.317258
[72]	valid_0's auc: 0.928296	valid_0's binary_logloss: 0.288298	valid_1's auc: 0.90767	valid_1's binary_logloss: 0.31743
[73]	valid_0's auc: 0.928512	valid_0's binary_logloss: 0.287925	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317551
[74]	valid_0's auc: 0.928731	valid_0's binary_logloss: 0.287496	valid_1's auc: 0.907523	valid_1's binary_logloss: 0.317674
[75]	valid_0's auc: 0.929057	valid_0's binary_logloss: 0.286987	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.31769
[76]	valid_0's auc: 0.929295	valid_0's binary_logloss: 0.286563	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.317738
[77]	valid_0's auc: 0.929547	valid_0's binary_logloss: 0.286116	valid_1's auc: 0.907411	valid_1's binary_logloss: 0.317866
[78]	valid_0's auc: 0.929722	valid_0's binary_logloss: 0.285782	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.317857
[79]	valid_0's auc: 0.930052	valid_0's binary_logloss: 0.285198	valid_1's auc: 0.907325	valid_1's binary_logloss: 0.318039
[80]	valid_0's auc: 0.930297	valid_0's binary_logloss: 0.284774	valid_1's auc: 0.90737	valid_1's binary_logloss: 0.317967
[81]	valid_0's auc: 0.930493	valid_0's binary_logloss: 0.284447	valid_1's auc: 0.907255	valid_1's binary_logloss: 0.318155
[82]	valid_0's auc: 0.930784	valid_0's binary_logloss: 0.283929	valid_1's auc: 0.907228	valid_1's binary_logloss: 0.318198
[83]	valid_0's auc: 0.93106	valid_0's binary_logloss: 0.283467	valid_1's auc: 0.907176	valid_1's binary_logloss: 0.318284
[84]	valid_0's auc: 0.93135	valid_0's binary_logloss: 0.282958	valid_1's auc: 0.907123	valid_1's binary_logloss: 0.318463
[85]	valid_0's auc: 0.93153	valid_0's binary_logloss: 0.282631	valid_1's auc: 0.907048	valid_1's binary_logloss: 0.318589
[86]	valid_0's auc: 0.931782	valid_0's binary_logloss: 0.282233	valid_1's auc: 0.907079	valid_1's binary_logloss: 0.318573
[87]	valid_0's auc: 0.931998	valid_0's binary_logloss: 0.281859	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.318695
[88]	valid_0's auc: 0.932169	valid_0's binary_logloss: 0.281518	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318879
[89]	valid_0's auc: 0.932401	valid_0's binary_logloss: 0.281126	valid_1's auc: 0.90683	valid_1's binary_logloss: 0.318989
[90]	valid_0's auc: 0.932652	valid_0's binary_logloss: 0.280701	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319214
[91]	valid_0's auc: 0.932829	valid_0's binary_logloss: 0.28037	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319206
[92]	valid_0's auc: 0.933072	valid_0's binary_logloss: 0.279957	valid_1's auc: 0.906607	valid_1's binary_logloss: 0.319386
[93]	valid_0's auc: 0.933271	valid_0's binary_logloss: 0.27962	valid_1's auc: 0.906606	valid_1's binary_logloss: 0.319354
[94]	valid_0's auc: 0.933536	valid_0's binary_logloss: 0.279148	valid_1's auc: 0.906476	valid_1's binary_logloss: 0.319605
[95]	valid_0's auc: 0.933723	valid_0's binary_logloss: 0.278802	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.319765
[96]	valid_0's auc: 0.934007	valid_0's binary_logloss: 0.278301	valid_1's auc: 0.906438	valid_1's binary_logloss: 0.319797
[97]	valid_0's auc: 0.934129	valid_0's binary_logloss: 0.278058	valid_1's auc: 0.90642	valid_1's binary_logloss: 0.319834
[98]	valid_0's auc: 0.9344	valid_0's binary_logloss: 0.277588	valid_1's auc: 0.906423	valid_1's binary_logloss: 0.319876
[99]	valid_0's auc: 0.934608	valid_0's binary_logloss: 0.27723	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.319961
[100]	valid_0's auc: 0.934815	valid_0's binary_logloss: 0.276881	valid_1's auc: 0.906317	valid_1's binary_logloss: 0.320131
[101]	valid_0's auc: 0.934988	valid_0's binary_logloss: 0.276567	valid_1's auc: 0.906179	valid_1's binary_logloss: 0.320355
[102]	valid_0's auc: 0.935251	valid_0's binary_logloss: 0.276152	valid_1's auc: 0.906178	valid_1's binary_logloss: 0.320406
[103]	valid_0's auc: 0.935444	valid_0's binary_logloss: 0.275822	valid_1's auc: 0.906132	valid_1's binary_logloss: 0.320441
[104]	valid_0's auc: 0.935626	valid_0's binary_logloss: 0.27552	valid_1's auc: 0.906094	valid_1's binary_logloss: 0.320485
[105]	valid_0's auc: 0.935825	valid_0's binary_logloss: 0.275177	valid_1's auc: 0.906082	valid_1's binary_logloss: 0.320535
[106]	valid_0's auc: 0.93606	valid_0's binary_logloss: 0.27477	valid_1's auc: 0.906017	valid_1's binary_logloss: 0.320679
[107]	valid_0's auc: 0.936295	valid_0's binary_logloss: 0.274371	valid_1's auc: 0.905918	valid_1's binary_logloss: 0.320893
[108]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.273994	valid_1's auc: 0.905957	valid_1's binary_logloss: 0.320858
[109]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.27367	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.320982
[110]	valid_0's auc: 0.936899	valid_0's binary_logloss: 0.273327	valid_1's auc: 0.90575	valid_1's binary_logloss: 0.321248
[111]	valid_0's auc: 0.937054	valid_0's binary_logloss: 0.273025	valid_1's auc: 0.905676	valid_1's binary_logloss: 0.321442
[112]	valid_0's auc: 0.93732	valid_0's binary_logloss: 0.27259	valid_1's auc: 0.905665	valid_1's binary_logloss: 0.321469
[113]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272268	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.321647
[114]	valid_0's auc: 0.937725	valid_0's binary_logloss: 0.271876	valid_1's auc: 0.905532	valid_1's binary_logloss: 0.321671
[115]	valid_0's auc: 0.938006	valid_0's binary_logloss: 0.271402	valid_1's auc: 0.905503	valid_1's binary_logloss: 0.321772
[116]	valid_0's auc: 0.938198	valid_0's binary_logloss: 0.27107	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.321776
[117]	valid_0's auc: 0.93844	valid_0's binary_logloss: 0.270638	valid_1's auc: 0.905536	valid_1's binary_logloss: 0.321646
[118]	valid_0's auc: 0.938594	valid_0's binary_logloss: 0.270341	valid_1's auc: 0.905547	valid_1's binary_logloss: 0.321643
[119]	valid_0's auc: 0.938857	valid_0's binary_logloss: 0.269876	valid_1's auc: 0.905419	valid_1's binary_logloss: 0.321921
[120]	valid_0's auc: 0.939076	valid_0's binary_logloss: 0.269496	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.322051
[121]	valid_0's auc: 0.939223	valid_0's binary_logloss: 0.269226	valid_1's auc: 0.905396	valid_1's binary_logloss: 0.322015
[122]	valid_0's auc: 0.939466	valid_0's binary_logloss: 0.268791	valid_1's auc: 0.905463	valid_1's binary_logloss: 0.321958
[123]	valid_0's auc: 0.939637	valid_0's binary_logloss: 0.26849	valid_1's auc: 0.905466	valid_1's binary_logloss: 0.321952
[124]	valid_0's auc: 0.939841	valid_0's binary_logloss: 0.268092	valid_1's auc: 0.905492	valid_1's binary_logloss: 0.321939
[125]	valid_0's auc: 0.939963	valid_0's binary_logloss: 0.267853	valid_1's auc: 0.905566	valid_1's binary_logloss: 0.321895
[126]	valid_0's auc: 0.94017	valid_0's binary_logloss: 0.267485	valid_1's auc: 0.905566	valid_1's binary_logloss: 0.321915
[127]	valid_0's auc: 0.940325	valid_0's binary_logloss: 0.26714	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.322114
[128]	valid_0's auc: 0.94048	valid_0's binary_logloss: 0.266849	valid_1's auc: 0.905571	valid_1's binary_logloss: 0.322058
[129]	valid_0's auc: 0.940628	valid_0's binary_logloss: 0.266551	valid_1's auc: 0.905467	valid_1's binary_logloss: 0.322261
[130]	valid_0's auc: 0.940794	valid_0's binary_logloss: 0.266233	valid_1's auc: 0.905474	valid_1's binary_logloss: 0.322286
[131]	valid_0's auc: 0.940999	valid_0's binary_logloss: 0.26585	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.322381
[132]	valid_0's auc: 0.941137	valid_0's binary_logloss: 0.265596	valid_1's auc: 0.905423	valid_1's binary_logloss: 0.322419
[133]	valid_0's auc: 0.941346	valid_0's binary_logloss: 0.265217	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322589
[134]	valid_0's auc: 0.941546	valid_0's binary_logloss: 0.264818	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.322781
Early stopping, best iteration is:
[34]	valid_0's auc: 0.916045	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.318693
[1]	valid_0's auc: 0.887983	valid_0's binary_logloss: 0.517034	valid_1's auc: 0.891755	valid_1's binary_logloss: 0.508452
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89066	valid_0's binary_logloss: 0.488464	valid_1's auc: 0.89629	valid_1's binary_logloss: 0.478946
[3]	valid_0's auc: 0.891984	valid_0's binary_logloss: 0.465365	valid_1's auc: 0.897538	valid_1's binary_logloss: 0.455741
[4]	valid_0's auc: 0.896159	valid_0's binary_logloss: 0.446069	valid_1's auc: 0.901608	valid_1's binary_logloss: 0.43617
[5]	valid_0's auc: 0.896836	valid_0's binary_logloss: 0.43022	valid_1's auc: 0.902385	valid_1's binary_logloss: 0.420003
[6]	valid_0's auc: 0.897532	valid_0's binary_logloss: 0.416675	valid_1's auc: 0.902107	valid_1's binary_logloss: 0.406595
[7]	valid_0's auc: 0.898859	valid_0's binary_logloss: 0.404875	valid_1's auc: 0.902903	valid_1's binary_logloss: 0.394907
[8]	valid_0's auc: 0.899531	valid_0's binary_logloss: 0.394951	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.384787
[9]	valid_0's auc: 0.899803	valid_0's binary_logloss: 0.386385	valid_1's auc: 0.904479	valid_1's binary_logloss: 0.376169
[10]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.378764	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.369074
[11]	valid_0's auc: 0.901544	valid_0's binary_logloss: 0.372015	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.36246
[12]	valid_0's auc: 0.902572	valid_0's binary_logloss: 0.366163	valid_1's auc: 0.905663	valid_1's binary_logloss: 0.356912
[13]	valid_0's auc: 0.903409	valid_0's binary_logloss: 0.360834	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.352169
[14]	valid_0's auc: 0.904166	valid_0's binary_logloss: 0.356033	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.347704
[15]	valid_0's auc: 0.904984	valid_0's binary_logloss: 0.351614	valid_1's auc: 0.906578	valid_1's binary_logloss: 0.344168
[16]	valid_0's auc: 0.905714	valid_0's binary_logloss: 0.347783	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.34075
[17]	valid_0's auc: 0.906246	valid_0's binary_logloss: 0.344301	valid_1's auc: 0.907143	valid_1's binary_logloss: 0.337847
[18]	valid_0's auc: 0.90728	valid_0's binary_logloss: 0.340983	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.335175
[19]	valid_0's auc: 0.907688	valid_0's binary_logloss: 0.338297	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.332981
[20]	valid_0's auc: 0.908408	valid_0's binary_logloss: 0.335618	valid_1's auc: 0.907783	valid_1's binary_logloss: 0.331061
[21]	valid_0's auc: 0.909061	valid_0's binary_logloss: 0.333145	valid_1's auc: 0.907854	valid_1's binary_logloss: 0.329397
[22]	valid_0's auc: 0.909826	valid_0's binary_logloss: 0.330782	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.327969
[23]	valid_0's auc: 0.91065	valid_0's binary_logloss: 0.328456	valid_1's auc: 0.908232	valid_1's binary_logloss: 0.326281
[24]	valid_0's auc: 0.911281	valid_0's binary_logloss: 0.326372	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.324744
[25]	valid_0's auc: 0.911828	valid_0's binary_logloss: 0.324552	valid_1's auc: 0.908584	valid_1's binary_logloss: 0.323621
[26]	valid_0's auc: 0.912259	valid_0's binary_logloss: 0.322968	valid_1's auc: 0.908733	valid_1's binary_logloss: 0.322513
[27]	valid_0's auc: 0.912769	valid_0's binary_logloss: 0.321367	valid_1's auc: 0.908998	valid_1's binary_logloss: 0.321379
[28]	valid_0's auc: 0.913292	valid_0's binary_logloss: 0.319838	valid_1's auc: 0.90903	valid_1's binary_logloss: 0.320657
[29]	valid_0's auc: 0.913879	valid_0's binary_logloss: 0.318352	valid_1's auc: 0.908965	valid_1's binary_logloss: 0.320061
[30]	valid_0's auc: 0.914273	valid_0's binary_logloss: 0.317119	valid_1's auc: 0.909043	valid_1's binary_logloss: 0.319426
[31]	valid_0's auc: 0.914778	valid_0's binary_logloss: 0.315856	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.318886
[32]	valid_0's auc: 0.915165	valid_0's binary_logloss: 0.31472	valid_1's auc: 0.90916	valid_1's binary_logloss: 0.318401
[33]	valid_0's auc: 0.915587	valid_0's binary_logloss: 0.313594	valid_1's auc: 0.909288	valid_1's binary_logloss: 0.317881
[34]	valid_0's auc: 0.916204	valid_0's binary_logloss: 0.312259	valid_1's auc: 0.90929	valid_1's binary_logloss: 0.317648
[35]	valid_0's auc: 0.916597	valid_0's binary_logloss: 0.311226	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.317119
[36]	valid_0's auc: 0.917055	valid_0's binary_logloss: 0.310184	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.316668
[37]	valid_0's auc: 0.917456	valid_0's binary_logloss: 0.309239	valid_1's auc: 0.909523	valid_1's binary_logloss: 0.316417
[38]	valid_0's auc: 0.917845	valid_0's binary_logloss: 0.308389	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.316263
[39]	valid_0's auc: 0.918247	valid_0's binary_logloss: 0.307465	valid_1's auc: 0.909394	valid_1's binary_logloss: 0.316188
[40]	valid_0's auc: 0.918689	valid_0's binary_logloss: 0.306525	valid_1's auc: 0.90919	valid_1's binary_logloss: 0.316355
[41]	valid_0's auc: 0.919074	valid_0's binary_logloss: 0.305733	valid_1's auc: 0.909194	valid_1's binary_logloss: 0.316209
[42]	valid_0's auc: 0.919468	valid_0's binary_logloss: 0.30486	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.316194
[43]	valid_0's auc: 0.919843	valid_0's binary_logloss: 0.304037	valid_1's auc: 0.909134	valid_1's binary_logloss: 0.31607
[44]	valid_0's auc: 0.92022	valid_0's binary_logloss: 0.303238	valid_1's auc: 0.909093	valid_1's binary_logloss: 0.31603
[45]	valid_0's auc: 0.920556	valid_0's binary_logloss: 0.302545	valid_1's auc: 0.909079	valid_1's binary_logloss: 0.315931
[46]	valid_0's auc: 0.920891	valid_0's binary_logloss: 0.30179	valid_1's auc: 0.909124	valid_1's binary_logloss: 0.31577
[47]	valid_0's auc: 0.921258	valid_0's binary_logloss: 0.301129	valid_1's auc: 0.909124	valid_1's binary_logloss: 0.315691
[48]	valid_0's auc: 0.921526	valid_0's binary_logloss: 0.300569	valid_1's auc: 0.909048	valid_1's binary_logloss: 0.315767
[49]	valid_0's auc: 0.921836	valid_0's binary_logloss: 0.299924	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.315706
[50]	valid_0's auc: 0.922194	valid_0's binary_logloss: 0.299257	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.31569
[51]	valid_0's auc: 0.922461	valid_0's binary_logloss: 0.298705	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.31568
[52]	valid_0's auc: 0.922743	valid_0's binary_logloss: 0.298202	valid_1's auc: 0.908913	valid_1's binary_logloss: 0.315769
[53]	valid_0's auc: 0.923049	valid_0's binary_logloss: 0.297602	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315559
[54]	valid_0's auc: 0.923299	valid_0's binary_logloss: 0.297118	valid_1's auc: 0.908834	valid_1's binary_logloss: 0.315769
[55]	valid_0's auc: 0.92355	valid_0's binary_logloss: 0.296607	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.315892
[56]	valid_0's auc: 0.923788	valid_0's binary_logloss: 0.296101	valid_1's auc: 0.908669	valid_1's binary_logloss: 0.315888
[57]	valid_0's auc: 0.92408	valid_0's binary_logloss: 0.295571	valid_1's auc: 0.908711	valid_1's binary_logloss: 0.315809
[58]	valid_0's auc: 0.924463	valid_0's binary_logloss: 0.294925	valid_1's auc: 0.9087	valid_1's binary_logloss: 0.315791
[59]	valid_0's auc: 0.924823	valid_0's binary_logloss: 0.294296	valid_1's auc: 0.908785	valid_1's binary_logloss: 0.315673
[60]	valid_0's auc: 0.925159	valid_0's binary_logloss: 0.293739	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.315886
[61]	valid_0's auc: 0.925459	valid_0's binary_logloss: 0.293252	valid_1's auc: 0.908516	valid_1's binary_logloss: 0.316177
[62]	valid_0's auc: 0.925813	valid_0's binary_logloss: 0.292643	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.316386
[63]	valid_0's auc: 0.926043	valid_0's binary_logloss: 0.292193	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.316493
[64]	valid_0's auc: 0.926286	valid_0's binary_logloss: 0.291752	valid_1's auc: 0.908255	valid_1's binary_logloss: 0.316528
[65]	valid_0's auc: 0.926536	valid_0's binary_logloss: 0.291299	valid_1's auc: 0.908362	valid_1's binary_logloss: 0.316372
[66]	valid_0's auc: 0.926795	valid_0's binary_logloss: 0.290837	valid_1's auc: 0.90826	valid_1's binary_logloss: 0.316494
[67]	valid_0's auc: 0.927055	valid_0's binary_logloss: 0.290367	valid_1's auc: 0.908259	valid_1's binary_logloss: 0.316577
[68]	valid_0's auc: 0.927235	valid_0's binary_logloss: 0.290034	valid_1's auc: 0.908203	valid_1's binary_logloss: 0.31661
[69]	valid_0's auc: 0.927487	valid_0's binary_logloss: 0.289541	valid_1's auc: 0.908148	valid_1's binary_logloss: 0.316702
[70]	valid_0's auc: 0.927764	valid_0's binary_logloss: 0.289032	valid_1's auc: 0.908076	valid_1's binary_logloss: 0.3168
[71]	valid_0's auc: 0.928041	valid_0's binary_logloss: 0.288516	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.316959
[72]	valid_0's auc: 0.928403	valid_0's binary_logloss: 0.287954	valid_1's auc: 0.908001	valid_1's binary_logloss: 0.31693
[73]	valid_0's auc: 0.92867	valid_0's binary_logloss: 0.287474	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.316926
[74]	valid_0's auc: 0.92883	valid_0's binary_logloss: 0.287143	valid_1's auc: 0.908129	valid_1's binary_logloss: 0.316815
[75]	valid_0's auc: 0.929105	valid_0's binary_logloss: 0.286651	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.316882
[76]	valid_0's auc: 0.929344	valid_0's binary_logloss: 0.286229	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.316958
[77]	valid_0's auc: 0.929541	valid_0's binary_logloss: 0.285854	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317259
[78]	valid_0's auc: 0.929747	valid_0's binary_logloss: 0.2855	valid_1's auc: 0.907871	valid_1's binary_logloss: 0.317248
[79]	valid_0's auc: 0.929961	valid_0's binary_logloss: 0.285092	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317469
[80]	valid_0's auc: 0.930182	valid_0's binary_logloss: 0.284749	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.317454
[81]	valid_0's auc: 0.930484	valid_0's binary_logloss: 0.284228	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.317445
[82]	valid_0's auc: 0.930752	valid_0's binary_logloss: 0.283799	valid_1's auc: 0.907838	valid_1's binary_logloss: 0.317316
[83]	valid_0's auc: 0.930985	valid_0's binary_logloss: 0.283347	valid_1's auc: 0.907827	valid_1's binary_logloss: 0.317368
[84]	valid_0's auc: 0.931216	valid_0's binary_logloss: 0.282959	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317368
[85]	valid_0's auc: 0.93137	valid_0's binary_logloss: 0.282683	valid_1's auc: 0.907742	valid_1's binary_logloss: 0.317544
[86]	valid_0's auc: 0.931629	valid_0's binary_logloss: 0.28225	valid_1's auc: 0.907811	valid_1's binary_logloss: 0.317469
[87]	valid_0's auc: 0.931938	valid_0's binary_logloss: 0.281722	valid_1's auc: 0.907702	valid_1's binary_logloss: 0.317662
[88]	valid_0's auc: 0.932099	valid_0's binary_logloss: 0.281383	valid_1's auc: 0.90765	valid_1's binary_logloss: 0.317798
[89]	valid_0's auc: 0.93232	valid_0's binary_logloss: 0.280998	valid_1's auc: 0.907589	valid_1's binary_logloss: 0.317898
[90]	valid_0's auc: 0.932602	valid_0's binary_logloss: 0.28053	valid_1's auc: 0.907611	valid_1's binary_logloss: 0.31792
[91]	valid_0's auc: 0.932778	valid_0's binary_logloss: 0.280208	valid_1's auc: 0.907607	valid_1's binary_logloss: 0.317958
[92]	valid_0's auc: 0.932993	valid_0's binary_logloss: 0.279821	valid_1's auc: 0.907576	valid_1's binary_logloss: 0.318052
[93]	valid_0's auc: 0.933286	valid_0's binary_logloss: 0.279352	valid_1's auc: 0.907599	valid_1's binary_logloss: 0.318108
[94]	valid_0's auc: 0.933531	valid_0's binary_logloss: 0.278951	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.3181
[95]	valid_0's auc: 0.933767	valid_0's binary_logloss: 0.27857	valid_1's auc: 0.90751	valid_1's binary_logloss: 0.318217
[96]	valid_0's auc: 0.933968	valid_0's binary_logloss: 0.278262	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.318262
[97]	valid_0's auc: 0.934129	valid_0's binary_logloss: 0.277986	valid_1's auc: 0.907454	valid_1's binary_logloss: 0.318312
[98]	valid_0's auc: 0.934335	valid_0's binary_logloss: 0.277631	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318435
[99]	valid_0's auc: 0.934541	valid_0's binary_logloss: 0.277266	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318485
[100]	valid_0's auc: 0.934777	valid_0's binary_logloss: 0.276843	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.318649
[101]	valid_0's auc: 0.93499	valid_0's binary_logloss: 0.276494	valid_1's auc: 0.907275	valid_1's binary_logloss: 0.318708
[102]	valid_0's auc: 0.935186	valid_0's binary_logloss: 0.27611	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.31884
[103]	valid_0's auc: 0.935369	valid_0's binary_logloss: 0.27581	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318753
[104]	valid_0's auc: 0.935616	valid_0's binary_logloss: 0.275373	valid_1's auc: 0.907236	valid_1's binary_logloss: 0.318815
[105]	valid_0's auc: 0.935832	valid_0's binary_logloss: 0.275026	valid_1's auc: 0.907294	valid_1's binary_logloss: 0.318702
[106]	valid_0's auc: 0.936047	valid_0's binary_logloss: 0.274648	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.31902
[107]	valid_0's auc: 0.936236	valid_0's binary_logloss: 0.274316	valid_1's auc: 0.907063	valid_1's binary_logloss: 0.319115
[108]	valid_0's auc: 0.936403	valid_0's binary_logloss: 0.274024	valid_1's auc: 0.906923	valid_1's binary_logloss: 0.319412
[109]	valid_0's auc: 0.936558	valid_0's binary_logloss: 0.273755	valid_1's auc: 0.907004	valid_1's binary_logloss: 0.319294
[110]	valid_0's auc: 0.936801	valid_0's binary_logloss: 0.273328	valid_1's auc: 0.906893	valid_1's binary_logloss: 0.319473
[111]	valid_0's auc: 0.936999	valid_0's binary_logloss: 0.27296	valid_1's auc: 0.906856	valid_1's binary_logloss: 0.319543
[112]	valid_0's auc: 0.937193	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319848
[113]	valid_0's auc: 0.937312	valid_0's binary_logloss: 0.272386	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.319922
[114]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272065	valid_1's auc: 0.906594	valid_1's binary_logloss: 0.32008
[115]	valid_0's auc: 0.937663	valid_0's binary_logloss: 0.271751	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.320239
[116]	valid_0's auc: 0.937795	valid_0's binary_logloss: 0.271507	valid_1's auc: 0.906597	valid_1's binary_logloss: 0.320137
[117]	valid_0's auc: 0.93801	valid_0's binary_logloss: 0.271106	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320143
[118]	valid_0's auc: 0.938196	valid_0's binary_logloss: 0.270758	valid_1's auc: 0.906525	valid_1's binary_logloss: 0.320335
[119]	valid_0's auc: 0.938401	valid_0's binary_logloss: 0.270423	valid_1's auc: 0.906408	valid_1's binary_logloss: 0.320509
[120]	valid_0's auc: 0.938573	valid_0's binary_logloss: 0.270139	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320625
[121]	valid_0's auc: 0.938739	valid_0's binary_logloss: 0.269845	valid_1's auc: 0.906315	valid_1's binary_logloss: 0.320734
[122]	valid_0's auc: 0.938932	valid_0's binary_logloss: 0.269495	valid_1's auc: 0.906147	valid_1's binary_logloss: 0.320985
[123]	valid_0's auc: 0.939103	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.321084
[124]	valid_0's auc: 0.939306	valid_0's binary_logloss: 0.268825	valid_1's auc: 0.906015	valid_1's binary_logloss: 0.321262
[125]	valid_0's auc: 0.939483	valid_0's binary_logloss: 0.268519	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.321408
[126]	valid_0's auc: 0.939615	valid_0's binary_logloss: 0.268263	valid_1's auc: 0.905864	valid_1's binary_logloss: 0.321589
[127]	valid_0's auc: 0.939773	valid_0's binary_logloss: 0.267957	valid_1's auc: 0.905828	valid_1's binary_logloss: 0.321712
[128]	valid_0's auc: 0.939898	valid_0's binary_logloss: 0.26772	valid_1's auc: 0.905789	valid_1's binary_logloss: 0.321791
[129]	valid_0's auc: 0.940027	valid_0's binary_logloss: 0.267469	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321854
[130]	valid_0's auc: 0.940193	valid_0's binary_logloss: 0.267161	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.32201
[131]	valid_0's auc: 0.940319	valid_0's binary_logloss: 0.26692	valid_1's auc: 0.905662	valid_1's binary_logloss: 0.322084
[132]	valid_0's auc: 0.940397	valid_0's binary_logloss: 0.266761	valid_1's auc: 0.905587	valid_1's binary_logloss: 0.322222
[133]	valid_0's auc: 0.940548	valid_0's binary_logloss: 0.266503	valid_1's auc: 0.90554	valid_1's binary_logloss: 0.322282
[134]	valid_0's auc: 0.940775	valid_0's binary_logloss: 0.266129	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.32229
[135]	valid_0's auc: 0.941025	valid_0's binary_logloss: 0.265689	valid_1's auc: 0.905494	valid_1's binary_logloss: 0.322373
[136]	valid_0's auc: 0.94115	valid_0's binary_logloss: 0.265449	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.322479
Early stopping, best iteration is:
[36]	valid_0's auc: 0.917055	valid_0's binary_logloss: 0.310184	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.316668
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8932	valid_0's binary_logloss: 0.488767	valid_1's auc: 0.898628	valid_1's binary_logloss: 0.47931
[3]	valid_0's auc: 0.893892	valid_0's binary_logloss: 0.46573	valid_1's auc: 0.899079	valid_1's binary_logloss: 0.45581
[4]	valid_0's auc: 0.895475	valid_0's binary_logloss: 0.446714	valid_1's auc: 0.900674	valid_1's binary_logloss: 0.436743
[5]	valid_0's auc: 0.897074	valid_0's binary_logloss: 0.430337	valid_1's auc: 0.90173	valid_1's binary_logloss: 0.42032
[6]	valid_0's auc: 0.898357	valid_0's binary_logloss: 0.416642	valid_1's auc: 0.902698	valid_1's binary_logloss: 0.406406
[7]	valid_0's auc: 0.899307	valid_0's binary_logloss: 0.404911	valid_1's auc: 0.903472	valid_1's binary_logloss: 0.394687
[8]	valid_0's auc: 0.900174	valid_0's binary_logloss: 0.394885	valid_1's auc: 0.904079	valid_1's binary_logloss: 0.384734
[9]	valid_0's auc: 0.901445	valid_0's binary_logloss: 0.385831	valid_1's auc: 0.904686	valid_1's binary_logloss: 0.375986
[10]	valid_0's auc: 0.901761	valid_0's binary_logloss: 0.378314	valid_1's auc: 0.905095	valid_1's binary_logloss: 0.368578
[11]	valid_0's auc: 0.902733	valid_0's binary_logloss: 0.371404	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.362191
[12]	valid_0's auc: 0.903536	valid_0's binary_logloss: 0.365482	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.356725
[13]	valid_0's auc: 0.903939	valid_0's binary_logloss: 0.360327	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.352125
[14]	valid_0's auc: 0.905183	valid_0's binary_logloss: 0.355358	valid_1's auc: 0.906337	valid_1's binary_logloss: 0.347748
[15]	valid_0's auc: 0.905915	valid_0's binary_logloss: 0.351013	valid_1's auc: 0.906789	valid_1's binary_logloss: 0.343933
[16]	valid_0's auc: 0.906648	valid_0's binary_logloss: 0.347095	valid_1's auc: 0.907136	valid_1's binary_logloss: 0.340623
[17]	valid_0's auc: 0.907042	valid_0's binary_logloss: 0.343795	valid_1's auc: 0.907146	valid_1's binary_logloss: 0.337806
[18]	valid_0's auc: 0.907613	valid_0's binary_logloss: 0.340701	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.335307
[19]	valid_0's auc: 0.9081	valid_0's binary_logloss: 0.337909	valid_1's auc: 0.907772	valid_1's binary_logloss: 0.332832
[20]	valid_0's auc: 0.908551	valid_0's binary_logloss: 0.335421	valid_1's auc: 0.907616	valid_1's binary_logloss: 0.331094
[21]	valid_0's auc: 0.909266	valid_0's binary_logloss: 0.332931	valid_1's auc: 0.907861	valid_1's binary_logloss: 0.329282
[22]	valid_0's auc: 0.909785	valid_0's binary_logloss: 0.330757	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.327887
[23]	valid_0's auc: 0.910383	valid_0's binary_logloss: 0.328569	valid_1's auc: 0.908097	valid_1's binary_logloss: 0.326331
[24]	valid_0's auc: 0.910975	valid_0's binary_logloss: 0.326595	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.325034
[25]	valid_0's auc: 0.911519	valid_0's binary_logloss: 0.324821	valid_1's auc: 0.908426	valid_1's binary_logloss: 0.323904
[26]	valid_0's auc: 0.912141	valid_0's binary_logloss: 0.323045	valid_1's auc: 0.908767	valid_1's binary_logloss: 0.322654
[27]	valid_0's auc: 0.912654	valid_0's binary_logloss: 0.321415	valid_1's auc: 0.908843	valid_1's binary_logloss: 0.321844
[28]	valid_0's auc: 0.913134	valid_0's binary_logloss: 0.319969	valid_1's auc: 0.908835	valid_1's binary_logloss: 0.321096
[29]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.318373	valid_1's auc: 0.908936	valid_1's binary_logloss: 0.320357
[30]	valid_0's auc: 0.914217	valid_0's binary_logloss: 0.317083	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.319712
[31]	valid_0's auc: 0.914768	valid_0's binary_logloss: 0.315701	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.319049
[32]	valid_0's auc: 0.915208	valid_0's binary_logloss: 0.314525	valid_1's auc: 0.909146	valid_1's binary_logloss: 0.318692
[33]	valid_0's auc: 0.915691	valid_0's binary_logloss: 0.313365	valid_1's auc: 0.909114	valid_1's binary_logloss: 0.318322
[34]	valid_0's auc: 0.916047	valid_0's binary_logloss: 0.312374	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.317849
[35]	valid_0's auc: 0.916531	valid_0's binary_logloss: 0.311286	valid_1's auc: 0.90923	valid_1's binary_logloss: 0.317481
[36]	valid_0's auc: 0.916932	valid_0's binary_logloss: 0.310326	valid_1's auc: 0.909362	valid_1's binary_logloss: 0.317036
[37]	valid_0's auc: 0.917311	valid_0's binary_logloss: 0.309497	valid_1's auc: 0.909237	valid_1's binary_logloss: 0.316952
[38]	valid_0's auc: 0.917746	valid_0's binary_logloss: 0.308587	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.31681
[39]	valid_0's auc: 0.918108	valid_0's binary_logloss: 0.307735	valid_1's auc: 0.909209	valid_1's binary_logloss: 0.316662
[40]	valid_0's auc: 0.918504	valid_0's binary_logloss: 0.30687	valid_1's auc: 0.909265	valid_1's binary_logloss: 0.316355
[41]	valid_0's auc: 0.918913	valid_0's binary_logloss: 0.306026	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.316055
[42]	valid_0's auc: 0.919225	valid_0's binary_logloss: 0.305318	valid_1's auc: 0.909454	valid_1's binary_logloss: 0.315766
[43]	valid_0's auc: 0.919511	valid_0's binary_logloss: 0.304647	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.315646
[44]	valid_0's auc: 0.919871	valid_0's binary_logloss: 0.303869	valid_1's auc: 0.909406	valid_1's binary_logloss: 0.315599
[45]	valid_0's auc: 0.920215	valid_0's binary_logloss: 0.303093	valid_1's auc: 0.909332	valid_1's binary_logloss: 0.315542
[46]	valid_0's auc: 0.920636	valid_0's binary_logloss: 0.302305	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.315391
[47]	valid_0's auc: 0.921014	valid_0's binary_logloss: 0.301572	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.31518
[48]	valid_0's auc: 0.921374	valid_0's binary_logloss: 0.300887	valid_1's auc: 0.909576	valid_1's binary_logloss: 0.31499
[49]	valid_0's auc: 0.921675	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314676
[50]	valid_0's auc: 0.922088	valid_0's binary_logloss: 0.299604	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314743
[51]	valid_0's auc: 0.922463	valid_0's binary_logloss: 0.298954	valid_1's auc: 0.90961	valid_1's binary_logloss: 0.314746
[52]	valid_0's auc: 0.922724	valid_0's binary_logloss: 0.298433	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314726
[53]	valid_0's auc: 0.923039	valid_0's binary_logloss: 0.2978	valid_1's auc: 0.909624	valid_1's binary_logloss: 0.314541
[54]	valid_0's auc: 0.923312	valid_0's binary_logloss: 0.297236	valid_1's auc: 0.909536	valid_1's binary_logloss: 0.314566
[55]	valid_0's auc: 0.923702	valid_0's binary_logloss: 0.296604	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.3145
[56]	valid_0's auc: 0.924015	valid_0's binary_logloss: 0.29603	valid_1's auc: 0.909508	valid_1's binary_logloss: 0.314549
[57]	valid_0's auc: 0.924248	valid_0's binary_logloss: 0.295612	valid_1's auc: 0.909419	valid_1's binary_logloss: 0.314627
[58]	valid_0's auc: 0.924539	valid_0's binary_logloss: 0.295069	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.314842
[59]	valid_0's auc: 0.9249	valid_0's binary_logloss: 0.294407	valid_1's auc: 0.909087	valid_1's binary_logloss: 0.315108
[60]	valid_0's auc: 0.925204	valid_0's binary_logloss: 0.293899	valid_1's auc: 0.908966	valid_1's binary_logloss: 0.315257
[61]	valid_0's auc: 0.925557	valid_0's binary_logloss: 0.293315	valid_1's auc: 0.908992	valid_1's binary_logloss: 0.315222
[62]	valid_0's auc: 0.925914	valid_0's binary_logloss: 0.292743	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.315425
[63]	valid_0's auc: 0.926273	valid_0's binary_logloss: 0.292108	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.315355
[64]	valid_0's auc: 0.926577	valid_0's binary_logloss: 0.29156	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315387
[65]	valid_0's auc: 0.92686	valid_0's binary_logloss: 0.291077	valid_1's auc: 0.908848	valid_1's binary_logloss: 0.315337
[66]	valid_0's auc: 0.927178	valid_0's binary_logloss: 0.290535	valid_1's auc: 0.908839	valid_1's binary_logloss: 0.315405
[67]	valid_0's auc: 0.927402	valid_0's binary_logloss: 0.290102	valid_1's auc: 0.908924	valid_1's binary_logloss: 0.315265
[68]	valid_0's auc: 0.927704	valid_0's binary_logloss: 0.289578	valid_1's auc: 0.908815	valid_1's binary_logloss: 0.315435
[69]	valid_0's auc: 0.927945	valid_0's binary_logloss: 0.289142	valid_1's auc: 0.908698	valid_1's binary_logloss: 0.315628
[70]	valid_0's auc: 0.928201	valid_0's binary_logloss: 0.288689	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.315722
[71]	valid_0's auc: 0.928469	valid_0's binary_logloss: 0.288194	valid_1's auc: 0.908536	valid_1's binary_logloss: 0.315815
[72]	valid_0's auc: 0.928753	valid_0's binary_logloss: 0.287728	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.315861
[73]	valid_0's auc: 0.928968	valid_0's binary_logloss: 0.287353	valid_1's auc: 0.908454	valid_1's binary_logloss: 0.315948
[74]	valid_0's auc: 0.929261	valid_0's binary_logloss: 0.286877	valid_1's auc: 0.908341	valid_1's binary_logloss: 0.316054
[75]	valid_0's auc: 0.929478	valid_0's binary_logloss: 0.28648	valid_1's auc: 0.908271	valid_1's binary_logloss: 0.31615
[76]	valid_0's auc: 0.929763	valid_0's binary_logloss: 0.286003	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.316199
[77]	valid_0's auc: 0.93001	valid_0's binary_logloss: 0.285585	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.316322
[78]	valid_0's auc: 0.930324	valid_0's binary_logloss: 0.284986	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.316583
[79]	valid_0's auc: 0.930566	valid_0's binary_logloss: 0.284558	valid_1's auc: 0.908012	valid_1's binary_logloss: 0.316613
[80]	valid_0's auc: 0.930865	valid_0's binary_logloss: 0.284025	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.316538
[81]	valid_0's auc: 0.931077	valid_0's binary_logloss: 0.283626	valid_1's auc: 0.908084	valid_1's binary_logloss: 0.316525
[82]	valid_0's auc: 0.93139	valid_0's binary_logloss: 0.283085	valid_1's auc: 0.908009	valid_1's binary_logloss: 0.316653
[83]	valid_0's auc: 0.931652	valid_0's binary_logloss: 0.282661	valid_1's auc: 0.907995	valid_1's binary_logloss: 0.316681
[84]	valid_0's auc: 0.931934	valid_0's binary_logloss: 0.282182	valid_1's auc: 0.907998	valid_1's binary_logloss: 0.316722
[85]	valid_0's auc: 0.932186	valid_0's binary_logloss: 0.281767	valid_1's auc: 0.907948	valid_1's binary_logloss: 0.316798
[86]	valid_0's auc: 0.932442	valid_0's binary_logloss: 0.281326	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.316882
[87]	valid_0's auc: 0.932631	valid_0's binary_logloss: 0.280966	valid_1's auc: 0.907888	valid_1's binary_logloss: 0.316957
[88]	valid_0's auc: 0.93282	valid_0's binary_logloss: 0.280629	valid_1's auc: 0.907909	valid_1's binary_logloss: 0.316945
[89]	valid_0's auc: 0.933104	valid_0's binary_logloss: 0.280152	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.31701
[90]	valid_0's auc: 0.93336	valid_0's binary_logloss: 0.279675	valid_1's auc: 0.907683	valid_1's binary_logloss: 0.31735
[91]	valid_0's auc: 0.93356	valid_0's binary_logloss: 0.279337	valid_1's auc: 0.907747	valid_1's binary_logloss: 0.317254
[92]	valid_0's auc: 0.933782	valid_0's binary_logloss: 0.278958	valid_1's auc: 0.907664	valid_1's binary_logloss: 0.317437
[93]	valid_0's auc: 0.934021	valid_0's binary_logloss: 0.278582	valid_1's auc: 0.907579	valid_1's binary_logloss: 0.317572
[94]	valid_0's auc: 0.934212	valid_0's binary_logloss: 0.278248	valid_1's auc: 0.907515	valid_1's binary_logloss: 0.317668
[95]	valid_0's auc: 0.934444	valid_0's binary_logloss: 0.27786	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.317755
[96]	valid_0's auc: 0.934636	valid_0's binary_logloss: 0.277537	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.317832
[97]	valid_0's auc: 0.934823	valid_0's binary_logloss: 0.277222	valid_1's auc: 0.907458	valid_1's binary_logloss: 0.317821
[98]	valid_0's auc: 0.935064	valid_0's binary_logloss: 0.276787	valid_1's auc: 0.907402	valid_1's binary_logloss: 0.317956
[99]	valid_0's auc: 0.935276	valid_0's binary_logloss: 0.276432	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.317839
[100]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.276143	valid_1's auc: 0.90747	valid_1's binary_logloss: 0.317915
[101]	valid_0's auc: 0.935644	valid_0's binary_logloss: 0.275714	valid_1's auc: 0.907447	valid_1's binary_logloss: 0.317948
[102]	valid_0's auc: 0.935851	valid_0's binary_logloss: 0.275366	valid_1's auc: 0.907465	valid_1's binary_logloss: 0.317915
[103]	valid_0's auc: 0.936053	valid_0's binary_logloss: 0.275008	valid_1's auc: 0.90744	valid_1's binary_logloss: 0.317973
[104]	valid_0's auc: 0.936313	valid_0's binary_logloss: 0.274583	valid_1's auc: 0.907374	valid_1's binary_logloss: 0.318049
[105]	valid_0's auc: 0.936509	valid_0's binary_logloss: 0.274243	valid_1's auc: 0.907359	valid_1's binary_logloss: 0.318051
[106]	valid_0's auc: 0.936716	valid_0's binary_logloss: 0.273881	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318062
[107]	valid_0's auc: 0.936891	valid_0's binary_logloss: 0.273579	valid_1's auc: 0.907397	valid_1's binary_logloss: 0.318025
[108]	valid_0's auc: 0.937127	valid_0's binary_logloss: 0.273147	valid_1's auc: 0.907435	valid_1's binary_logloss: 0.318015
[109]	valid_0's auc: 0.937406	valid_0's binary_logloss: 0.272674	valid_1's auc: 0.90745	valid_1's binary_logloss: 0.318016
[110]	valid_0's auc: 0.937577	valid_0's binary_logloss: 0.272386	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.318049
[111]	valid_0's auc: 0.937795	valid_0's binary_logloss: 0.272011	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.318174
[112]	valid_0's auc: 0.937922	valid_0's binary_logloss: 0.271759	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.318238
[113]	valid_0's auc: 0.938076	valid_0's binary_logloss: 0.271455	valid_1's auc: 0.907386	valid_1's binary_logloss: 0.318249
[114]	valid_0's auc: 0.938275	valid_0's binary_logloss: 0.271114	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318283
[115]	valid_0's auc: 0.938412	valid_0's binary_logloss: 0.270862	valid_1's auc: 0.907305	valid_1's binary_logloss: 0.31843
[116]	valid_0's auc: 0.938632	valid_0's binary_logloss: 0.270469	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318564
[117]	valid_0's auc: 0.938786	valid_0's binary_logloss: 0.270171	valid_1's auc: 0.907203	valid_1's binary_logloss: 0.318655
[118]	valid_0's auc: 0.939012	valid_0's binary_logloss: 0.269741	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.318886
[119]	valid_0's auc: 0.939209	valid_0's binary_logloss: 0.269365	valid_1's auc: 0.90705	valid_1's binary_logloss: 0.318959
[120]	valid_0's auc: 0.93942	valid_0's binary_logloss: 0.268992	valid_1's auc: 0.907004	valid_1's binary_logloss: 0.319076
[121]	valid_0's auc: 0.939536	valid_0's binary_logloss: 0.268791	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.319086
[122]	valid_0's auc: 0.939826	valid_0's binary_logloss: 0.268325	valid_1's auc: 0.906932	valid_1's binary_logloss: 0.319206
[123]	valid_0's auc: 0.940043	valid_0's binary_logloss: 0.267903	valid_1's auc: 0.906868	valid_1's binary_logloss: 0.319365
[124]	valid_0's auc: 0.940161	valid_0's binary_logloss: 0.267668	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319495
[125]	valid_0's auc: 0.940282	valid_0's binary_logloss: 0.267431	valid_1's auc: 0.90667	valid_1's binary_logloss: 0.319727
[126]	valid_0's auc: 0.940576	valid_0's binary_logloss: 0.266942	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.319905
[127]	valid_0's auc: 0.940732	valid_0's binary_logloss: 0.266683	valid_1's auc: 0.906588	valid_1's binary_logloss: 0.319875
[128]	valid_0's auc: 0.940842	valid_0's binary_logloss: 0.266468	valid_1's auc: 0.906595	valid_1's binary_logloss: 0.319894
[129]	valid_0's auc: 0.941003	valid_0's binary_logloss: 0.266163	valid_1's auc: 0.906545	valid_1's binary_logloss: 0.320003
[130]	valid_0's auc: 0.94109	valid_0's binary_logloss: 0.265972	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.319999
[131]	valid_0's auc: 0.941191	valid_0's binary_logloss: 0.26577	valid_1's auc: 0.90649	valid_1's binary_logloss: 0.320172
[132]	valid_0's auc: 0.941419	valid_0's binary_logloss: 0.265374	valid_1's auc: 0.906375	valid_1's binary_logloss: 0.320401
[133]	valid_0's auc: 0.941617	valid_0's binary_logloss: 0.265022	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320689
[134]	valid_0's auc: 0.941752	valid_0's binary_logloss: 0.264787	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.320727
[135]	valid_0's auc: 0.941954	valid_0's binary_logloss: 0.264419	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.320908
[136]	valid_0's auc: 0.942126	valid_0's binary_logloss: 0.26411	valid_1's auc: 0.906023	valid_1's binary_logloss: 0.321062
[137]	valid_0's auc: 0.942355	valid_0's binary_logloss: 0.263696	valid_1's auc: 0.906081	valid_1's binary_logloss: 0.320968
[138]	valid_0's auc: 0.942582	valid_0's binary_logloss: 0.263291	valid_1's auc: 0.90603	valid_1's binary_logloss: 0.321118
[139]	valid_0's auc: 0.942756	valid_0's binary_logloss: 0.262965	valid_1's auc: 0.906009	valid_1's binary_logloss: 0.321225
[140]	valid_0's auc: 0.942866	valid_0's binary_logloss: 0.262712	valid_1's auc: 0.905917	valid_1's binary_logloss: 0.321456
[141]	valid_0's auc: 0.943043	valid_0's binary_logloss: 0.262361	valid_1's auc: 0.905968	valid_1's binary_logloss: 0.321378
[142]	valid_0's auc: 0.943243	valid_0's binary_logloss: 0.262006	valid_1's auc: 0.905863	valid_1's binary_logloss: 0.321487
[143]	valid_0's auc: 0.943439	valid_0's binary_logloss: 0.261645	valid_1's auc: 0.905849	valid_1's binary_logloss: 0.321548
[144]	valid_0's auc: 0.94357	valid_0's binary_logloss: 0.261404	valid_1's auc: 0.905788	valid_1's binary_logloss: 0.32168
[145]	valid_0's auc: 0.943704	valid_0's binary_logloss: 0.261131	valid_1's auc: 0.905757	valid_1's binary_logloss: 0.32177
[146]	valid_0's auc: 0.94389	valid_0's binary_logloss: 0.26079	valid_1's auc: 0.905746	valid_1's binary_logloss: 0.321802
[147]	valid_0's auc: 0.944025	valid_0's binary_logloss: 0.260532	valid_1's auc: 0.905625	valid_1's binary_logloss: 0.322039
[148]	valid_0's auc: 0.944146	valid_0's binary_logloss: 0.260281	valid_1's auc: 0.905558	valid_1's binary_logloss: 0.322194
[149]	valid_0's auc: 0.944251	valid_0's binary_logloss: 0.260031	valid_1's auc: 0.905528	valid_1's binary_logloss: 0.322313
Early stopping, best iteration is:
[49]	valid_0's auc: 0.921675	valid_0's binary_logloss: 0.300282	valid_1's auc: 0.909713	valid_1's binary_logloss: 0.314676
[1]	valid_0's auc: 0.888033	valid_0's binary_logloss: 0.517843	valid_1's auc: 0.894415	valid_1's binary_logloss: 0.508761
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891314	valid_0's binary_logloss: 0.489285	valid_1's auc: 0.895027	valid_1's binary_logloss: 0.479894
[3]	valid_0's auc: 0.894088	valid_0's binary_logloss: 0.465958	valid_1's auc: 0.896489	valid_1's binary_logloss: 0.456524
[4]	valid_0's auc: 0.89488	valid_0's binary_logloss: 0.446911	valid_1's auc: 0.898262	valid_1's binary_logloss: 0.43713
[5]	valid_0's auc: 0.896689	valid_0's binary_logloss: 0.430552	valid_1's auc: 0.899869	valid_1's binary_logloss: 0.420594
[6]	valid_0's auc: 0.898013	valid_0's binary_logloss: 0.416849	valid_1's auc: 0.901707	valid_1's binary_logloss: 0.406699
[7]	valid_0's auc: 0.898754	valid_0's binary_logloss: 0.405125	valid_1's auc: 0.90195	valid_1's binary_logloss: 0.395204
[8]	valid_0's auc: 0.899284	valid_0's binary_logloss: 0.395187	valid_1's auc: 0.903018	valid_1's binary_logloss: 0.385059
[9]	valid_0's auc: 0.90024	valid_0's binary_logloss: 0.386298	valid_1's auc: 0.903497	valid_1's binary_logloss: 0.376501
[10]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.378777	valid_1's auc: 0.903423	valid_1's binary_logloss: 0.369439
[11]	valid_0's auc: 0.901409	valid_0's binary_logloss: 0.372036	valid_1's auc: 0.903966	valid_1's binary_logloss: 0.362807
[12]	valid_0's auc: 0.902026	valid_0's binary_logloss: 0.366154	valid_1's auc: 0.904417	valid_1's binary_logloss: 0.357196
[13]	valid_0's auc: 0.903075	valid_0's binary_logloss: 0.360671	valid_1's auc: 0.905081	valid_1's binary_logloss: 0.352152
[14]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.355876	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.347773
[15]	valid_0's auc: 0.904685	valid_0's binary_logloss: 0.351691	valid_1's auc: 0.905867	valid_1's binary_logloss: 0.344181
[16]	valid_0's auc: 0.905378	valid_0's binary_logloss: 0.34781	valid_1's auc: 0.906444	valid_1's binary_logloss: 0.340635
[17]	valid_0's auc: 0.905952	valid_0's binary_logloss: 0.344376	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.337845
[18]	valid_0's auc: 0.906788	valid_0's binary_logloss: 0.341233	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.335275
[19]	valid_0's auc: 0.907429	valid_0's binary_logloss: 0.33838	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.333194
[20]	valid_0's auc: 0.908014	valid_0's binary_logloss: 0.33582	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.330977
[21]	valid_0's auc: 0.908813	valid_0's binary_logloss: 0.333265	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.329429
[22]	valid_0's auc: 0.909387	valid_0's binary_logloss: 0.331028	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.327796
[23]	valid_0's auc: 0.910076	valid_0's binary_logloss: 0.328812	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.326067
[24]	valid_0's auc: 0.91072	valid_0's binary_logloss: 0.326703	valid_1's auc: 0.90799	valid_1's binary_logloss: 0.324865
[25]	valid_0's auc: 0.911306	valid_0's binary_logloss: 0.324845	valid_1's auc: 0.908288	valid_1's binary_logloss: 0.32359
[26]	valid_0's auc: 0.911952	valid_0's binary_logloss: 0.323026	valid_1's auc: 0.908484	valid_1's binary_logloss: 0.322428
[27]	valid_0's auc: 0.912603	valid_0's binary_logloss: 0.321361	valid_1's auc: 0.908713	valid_1's binary_logloss: 0.321371
[28]	valid_0's auc: 0.913075	valid_0's binary_logloss: 0.319884	valid_1's auc: 0.9088	valid_1's binary_logloss: 0.320513
[29]	valid_0's auc: 0.913574	valid_0's binary_logloss: 0.318534	valid_1's auc: 0.908848	valid_1's binary_logloss: 0.319844
[30]	valid_0's auc: 0.914068	valid_0's binary_logloss: 0.317246	valid_1's auc: 0.90885	valid_1's binary_logloss: 0.319283
[31]	valid_0's auc: 0.914558	valid_0's binary_logloss: 0.315953	valid_1's auc: 0.908851	valid_1's binary_logloss: 0.31876
[32]	valid_0's auc: 0.915051	valid_0's binary_logloss: 0.314752	valid_1's auc: 0.908787	valid_1's binary_logloss: 0.318444
[33]	valid_0's auc: 0.915516	valid_0's binary_logloss: 0.313565	valid_1's auc: 0.908979	valid_1's binary_logloss: 0.317865
[34]	valid_0's auc: 0.915933	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.909156	valid_1's binary_logloss: 0.317224
[35]	valid_0's auc: 0.9164	valid_0's binary_logloss: 0.311405	valid_1's auc: 0.909273	valid_1's binary_logloss: 0.316712
[36]	valid_0's auc: 0.916866	valid_0's binary_logloss: 0.310416	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.31645
[37]	valid_0's auc: 0.917376	valid_0's binary_logloss: 0.309342	valid_1's auc: 0.90948	valid_1's binary_logloss: 0.316021
[38]	valid_0's auc: 0.917736	valid_0's binary_logloss: 0.308518	valid_1's auc: 0.909562	valid_1's binary_logloss: 0.315703
[39]	valid_0's auc: 0.918141	valid_0's binary_logloss: 0.30761	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.315473
[40]	valid_0's auc: 0.918511	valid_0's binary_logloss: 0.306774	valid_1's auc: 0.909581	valid_1's binary_logloss: 0.315304
[41]	valid_0's auc: 0.918862	valid_0's binary_logloss: 0.305981	valid_1's auc: 0.909711	valid_1's binary_logloss: 0.314919
[42]	valid_0's auc: 0.919237	valid_0's binary_logloss: 0.305176	valid_1's auc: 0.909696	valid_1's binary_logloss: 0.314794
[43]	valid_0's auc: 0.919649	valid_0's binary_logloss: 0.304385	valid_1's auc: 0.909872	valid_1's binary_logloss: 0.314427
[44]	valid_0's auc: 0.92006	valid_0's binary_logloss: 0.303621	valid_1's auc: 0.909908	valid_1's binary_logloss: 0.314309
[45]	valid_0's auc: 0.920424	valid_0's binary_logloss: 0.302856	valid_1's auc: 0.90984	valid_1's binary_logloss: 0.314228
[46]	valid_0's auc: 0.92078	valid_0's binary_logloss: 0.302162	valid_1's auc: 0.909869	valid_1's binary_logloss: 0.314149
[47]	valid_0's auc: 0.921103	valid_0's binary_logloss: 0.301468	valid_1's auc: 0.909695	valid_1's binary_logloss: 0.31432
[48]	valid_0's auc: 0.921407	valid_0's binary_logloss: 0.300835	valid_1's auc: 0.909703	valid_1's binary_logloss: 0.314221
[49]	valid_0's auc: 0.921742	valid_0's binary_logloss: 0.300203	valid_1's auc: 0.909684	valid_1's binary_logloss: 0.314222
[50]	valid_0's auc: 0.922068	valid_0's binary_logloss: 0.299605	valid_1's auc: 0.909722	valid_1's binary_logloss: 0.314049
[51]	valid_0's auc: 0.92241	valid_0's binary_logloss: 0.299013	valid_1's auc: 0.90956	valid_1's binary_logloss: 0.314204
[52]	valid_0's auc: 0.922698	valid_0's binary_logloss: 0.298393	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.31423
[53]	valid_0's auc: 0.922979	valid_0's binary_logloss: 0.297847	valid_1's auc: 0.909309	valid_1's binary_logloss: 0.314386
[54]	valid_0's auc: 0.923202	valid_0's binary_logloss: 0.297397	valid_1's auc: 0.909122	valid_1's binary_logloss: 0.314568
[55]	valid_0's auc: 0.923501	valid_0's binary_logloss: 0.296789	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.31469
[56]	valid_0's auc: 0.923814	valid_0's binary_logloss: 0.296245	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.314751
[57]	valid_0's auc: 0.924188	valid_0's binary_logloss: 0.295611	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.314752
[58]	valid_0's auc: 0.924446	valid_0's binary_logloss: 0.295122	valid_1's auc: 0.908888	valid_1's binary_logloss: 0.314958
[59]	valid_0's auc: 0.924765	valid_0's binary_logloss: 0.294524	valid_1's auc: 0.908787	valid_1's binary_logloss: 0.315081
[60]	valid_0's auc: 0.925074	valid_0's binary_logloss: 0.293961	valid_1's auc: 0.908717	valid_1's binary_logloss: 0.315153
[61]	valid_0's auc: 0.925376	valid_0's binary_logloss: 0.293458	valid_1's auc: 0.908761	valid_1's binary_logloss: 0.315089
[62]	valid_0's auc: 0.925659	valid_0's binary_logloss: 0.292935	valid_1's auc: 0.908605	valid_1's binary_logloss: 0.315292
[63]	valid_0's auc: 0.92594	valid_0's binary_logloss: 0.292443	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.315389
[64]	valid_0's auc: 0.926168	valid_0's binary_logloss: 0.292072	valid_1's auc: 0.908463	valid_1's binary_logloss: 0.315507
[65]	valid_0's auc: 0.926447	valid_0's binary_logloss: 0.291576	valid_1's auc: 0.908295	valid_1's binary_logloss: 0.3158
[66]	valid_0's auc: 0.926655	valid_0's binary_logloss: 0.291194	valid_1's auc: 0.908308	valid_1's binary_logloss: 0.315757
[67]	valid_0's auc: 0.926891	valid_0's binary_logloss: 0.290776	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.315707
[68]	valid_0's auc: 0.927161	valid_0's binary_logloss: 0.290318	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.315735
[69]	valid_0's auc: 0.927406	valid_0's binary_logloss: 0.289888	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.315815
[70]	valid_0's auc: 0.927699	valid_0's binary_logloss: 0.289355	valid_1's auc: 0.908193	valid_1's binary_logloss: 0.315914
[71]	valid_0's auc: 0.927929	valid_0's binary_logloss: 0.288973	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316051
[72]	valid_0's auc: 0.928152	valid_0's binary_logloss: 0.288574	valid_1's auc: 0.908114	valid_1's binary_logloss: 0.31603
[73]	valid_0's auc: 0.928397	valid_0's binary_logloss: 0.288138	valid_1's auc: 0.908018	valid_1's binary_logloss: 0.316201
[74]	valid_0's auc: 0.928656	valid_0's binary_logloss: 0.287708	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.316333
[75]	valid_0's auc: 0.929009	valid_0's binary_logloss: 0.287071	valid_1's auc: 0.907949	valid_1's binary_logloss: 0.316399
[76]	valid_0's auc: 0.929218	valid_0's binary_logloss: 0.286708	valid_1's auc: 0.907982	valid_1's binary_logloss: 0.316422
[77]	valid_0's auc: 0.929509	valid_0's binary_logloss: 0.286212	valid_1's auc: 0.907871	valid_1's binary_logloss: 0.316624
[78]	valid_0's auc: 0.929697	valid_0's binary_logloss: 0.285859	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.316737
[79]	valid_0's auc: 0.929912	valid_0's binary_logloss: 0.285493	valid_1's auc: 0.907642	valid_1's binary_logloss: 0.317008
[80]	valid_0's auc: 0.930135	valid_0's binary_logloss: 0.285137	valid_1's auc: 0.907484	valid_1's binary_logloss: 0.317235
[81]	valid_0's auc: 0.930342	valid_0's binary_logloss: 0.284743	valid_1's auc: 0.907501	valid_1's binary_logloss: 0.317238
[82]	valid_0's auc: 0.930568	valid_0's binary_logloss: 0.284323	valid_1's auc: 0.907496	valid_1's binary_logloss: 0.317282
[83]	valid_0's auc: 0.930786	valid_0's binary_logloss: 0.283952	valid_1's auc: 0.907493	valid_1's binary_logloss: 0.317267
[84]	valid_0's auc: 0.931222	valid_0's binary_logloss: 0.283239	valid_1's auc: 0.907379	valid_1's binary_logloss: 0.317404
[85]	valid_0's auc: 0.931417	valid_0's binary_logloss: 0.282891	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.317416
[86]	valid_0's auc: 0.931632	valid_0's binary_logloss: 0.282534	valid_1's auc: 0.907333	valid_1's binary_logloss: 0.317515
[87]	valid_0's auc: 0.931843	valid_0's binary_logloss: 0.282189	valid_1's auc: 0.907222	valid_1's binary_logloss: 0.317719
[88]	valid_0's auc: 0.932074	valid_0's binary_logloss: 0.281805	valid_1's auc: 0.907161	valid_1's binary_logloss: 0.317841
[89]	valid_0's auc: 0.932304	valid_0's binary_logloss: 0.281428	valid_1's auc: 0.907186	valid_1's binary_logloss: 0.317801
[90]	valid_0's auc: 0.932562	valid_0's binary_logloss: 0.280979	valid_1's auc: 0.907064	valid_1's binary_logloss: 0.317998
[91]	valid_0's auc: 0.932774	valid_0's binary_logloss: 0.280626	valid_1's auc: 0.907028	valid_1's binary_logloss: 0.318076
[92]	valid_0's auc: 0.933082	valid_0's binary_logloss: 0.280148	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.318142
[93]	valid_0's auc: 0.933281	valid_0's binary_logloss: 0.279776	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.318293
[94]	valid_0's auc: 0.933525	valid_0's binary_logloss: 0.279344	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.318441
[95]	valid_0's auc: 0.933784	valid_0's binary_logloss: 0.278871	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.318425
[96]	valid_0's auc: 0.934022	valid_0's binary_logloss: 0.278469	valid_1's auc: 0.906717	valid_1's binary_logloss: 0.318635
[97]	valid_0's auc: 0.934263	valid_0's binary_logloss: 0.278055	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.318543
[98]	valid_0's auc: 0.934457	valid_0's binary_logloss: 0.277703	valid_1's auc: 0.906762	valid_1's binary_logloss: 0.318644
[99]	valid_0's auc: 0.934655	valid_0's binary_logloss: 0.277349	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.318755
[100]	valid_0's auc: 0.934872	valid_0's binary_logloss: 0.277017	valid_1's auc: 0.906666	valid_1's binary_logloss: 0.31879
[101]	valid_0's auc: 0.935102	valid_0's binary_logloss: 0.276596	valid_1's auc: 0.90661	valid_1's binary_logloss: 0.31892
[102]	valid_0's auc: 0.935303	valid_0's binary_logloss: 0.276263	valid_1's auc: 0.906577	valid_1's binary_logloss: 0.31893
[103]	valid_0's auc: 0.935513	valid_0's binary_logloss: 0.275929	valid_1's auc: 0.906651	valid_1's binary_logloss: 0.318777
[104]	valid_0's auc: 0.935808	valid_0's binary_logloss: 0.275425	valid_1's auc: 0.906557	valid_1's binary_logloss: 0.318935
[105]	valid_0's auc: 0.936087	valid_0's binary_logloss: 0.274937	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.318834
[106]	valid_0's auc: 0.936247	valid_0's binary_logloss: 0.274631	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.318816
[107]	valid_0's auc: 0.936479	valid_0's binary_logloss: 0.274226	valid_1's auc: 0.906645	valid_1's binary_logloss: 0.318853
[108]	valid_0's auc: 0.936629	valid_0's binary_logloss: 0.273954	valid_1's auc: 0.906586	valid_1's binary_logloss: 0.318956
[109]	valid_0's auc: 0.936911	valid_0's binary_logloss: 0.273455	valid_1's auc: 0.90657	valid_1's binary_logloss: 0.318974
[110]	valid_0's auc: 0.937063	valid_0's binary_logloss: 0.273161	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.319045
[111]	valid_0's auc: 0.937286	valid_0's binary_logloss: 0.272764	valid_1's auc: 0.906541	valid_1's binary_logloss: 0.319083
[112]	valid_0's auc: 0.937442	valid_0's binary_logloss: 0.272485	valid_1's auc: 0.906427	valid_1's binary_logloss: 0.319304
[113]	valid_0's auc: 0.937607	valid_0's binary_logloss: 0.272161	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.319314
[114]	valid_0's auc: 0.937814	valid_0's binary_logloss: 0.271768	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.319279
[115]	valid_0's auc: 0.937948	valid_0's binary_logloss: 0.271523	valid_1's auc: 0.906272	valid_1's binary_logloss: 0.319493
[116]	valid_0's auc: 0.938176	valid_0's binary_logloss: 0.271117	valid_1's auc: 0.906295	valid_1's binary_logloss: 0.319481
[117]	valid_0's auc: 0.93832	valid_0's binary_logloss: 0.270858	valid_1's auc: 0.906302	valid_1's binary_logloss: 0.319525
[118]	valid_0's auc: 0.938539	valid_0's binary_logloss: 0.27048	valid_1's auc: 0.906269	valid_1's binary_logloss: 0.319558
[119]	valid_0's auc: 0.938731	valid_0's binary_logloss: 0.270106	valid_1's auc: 0.906241	valid_1's binary_logloss: 0.319615
[120]	valid_0's auc: 0.938832	valid_0's binary_logloss: 0.269895	valid_1's auc: 0.906175	valid_1's binary_logloss: 0.319733
[121]	valid_0's auc: 0.939085	valid_0's binary_logloss: 0.269444	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.319898
[122]	valid_0's auc: 0.939271	valid_0's binary_logloss: 0.269064	valid_1's auc: 0.906087	valid_1's binary_logloss: 0.319963
[123]	valid_0's auc: 0.939446	valid_0's binary_logloss: 0.268732	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.319934
[124]	valid_0's auc: 0.939751	valid_0's binary_logloss: 0.268197	valid_1's auc: 0.906137	valid_1's binary_logloss: 0.31993
[125]	valid_0's auc: 0.939953	valid_0's binary_logloss: 0.267854	valid_1's auc: 0.906114	valid_1's binary_logloss: 0.319967
[126]	valid_0's auc: 0.940155	valid_0's binary_logloss: 0.267477	valid_1's auc: 0.905991	valid_1's binary_logloss: 0.320203
[127]	valid_0's auc: 0.940377	valid_0's binary_logloss: 0.267102	valid_1's auc: 0.905884	valid_1's binary_logloss: 0.320402
[128]	valid_0's auc: 0.940461	valid_0's binary_logloss: 0.266968	valid_1's auc: 0.905811	valid_1's binary_logloss: 0.320519
[129]	valid_0's auc: 0.940603	valid_0's binary_logloss: 0.266682	valid_1's auc: 0.905678	valid_1's binary_logloss: 0.320746
[130]	valid_0's auc: 0.940723	valid_0's binary_logloss: 0.266452	valid_1's auc: 0.905646	valid_1's binary_logloss: 0.320798
[131]	valid_0's auc: 0.940886	valid_0's binary_logloss: 0.266154	valid_1's auc: 0.905564	valid_1's binary_logloss: 0.320951
[132]	valid_0's auc: 0.941082	valid_0's binary_logloss: 0.265797	valid_1's auc: 0.905555	valid_1's binary_logloss: 0.321029
[133]	valid_0's auc: 0.941258	valid_0's binary_logloss: 0.26548	valid_1's auc: 0.905499	valid_1's binary_logloss: 0.321176
[134]	valid_0's auc: 0.941408	valid_0's binary_logloss: 0.265197	valid_1's auc: 0.905504	valid_1's binary_logloss: 0.321212
[135]	valid_0's auc: 0.941585	valid_0's binary_logloss: 0.264899	valid_1's auc: 0.905472	valid_1's binary_logloss: 0.321283
[136]	valid_0's auc: 0.941752	valid_0's binary_logloss: 0.264596	valid_1's auc: 0.905475	valid_1's binary_logloss: 0.321274
[137]	valid_0's auc: 0.941876	valid_0's binary_logloss: 0.264318	valid_1's auc: 0.90545	valid_1's binary_logloss: 0.321395
[138]	valid_0's auc: 0.941984	valid_0's binary_logloss: 0.264114	valid_1's auc: 0.905349	valid_1's binary_logloss: 0.32161
[139]	valid_0's auc: 0.942105	valid_0's binary_logloss: 0.2639	valid_1's auc: 0.905276	valid_1's binary_logloss: 0.321741
[140]	valid_0's auc: 0.942265	valid_0's binary_logloss: 0.263611	valid_1's auc: 0.905243	valid_1's binary_logloss: 0.321833
[141]	valid_0's auc: 0.942442	valid_0's binary_logloss: 0.263265	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.321973
[142]	valid_0's auc: 0.942583	valid_0's binary_logloss: 0.262999	valid_1's auc: 0.905187	valid_1's binary_logloss: 0.322021
[143]	valid_0's auc: 0.942771	valid_0's binary_logloss: 0.262666	valid_1's auc: 0.905251	valid_1's binary_logloss: 0.321921
[144]	valid_0's auc: 0.942945	valid_0's binary_logloss: 0.262335	valid_1's auc: 0.905303	valid_1's binary_logloss: 0.321872
Early stopping, best iteration is:
[44]	valid_0's auc: 0.92006	valid_0's binary_logloss: 0.303621	valid_1's auc: 0.909908	valid_1's binary_logloss: 0.314309
[1]	valid_0's auc: 0.887858	valid_0's binary_logloss: 0.516982	valid_1's auc: 0.894799	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89299	valid_0's binary_logloss: 0.488143	valid_1's auc: 0.899409	valid_1's binary_logloss: 0.478442
[3]	valid_0's auc: 0.894141	valid_0's binary_logloss: 0.464911	valid_1's auc: 0.900492	valid_1's binary_logloss: 0.454848
[4]	valid_0's auc: 0.89588	valid_0's binary_logloss: 0.445631	valid_1's auc: 0.9015	valid_1's binary_logloss: 0.435366
[5]	valid_0's auc: 0.896299	valid_0's binary_logloss: 0.429674	valid_1's auc: 0.902037	valid_1's binary_logloss: 0.419456
[6]	valid_0's auc: 0.897764	valid_0's binary_logloss: 0.415869	valid_1's auc: 0.90356	valid_1's binary_logloss: 0.405588
[7]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.40445	valid_1's auc: 0.903498	valid_1's binary_logloss: 0.394181
[8]	valid_0's auc: 0.899739	valid_0's binary_logloss: 0.394387	valid_1's auc: 0.904256	valid_1's binary_logloss: 0.384278
[9]	valid_0's auc: 0.900665	valid_0's binary_logloss: 0.385622	valid_1's auc: 0.90431	valid_1's binary_logloss: 0.376255
[10]	valid_0's auc: 0.901172	valid_0's binary_logloss: 0.378008	valid_1's auc: 0.904383	valid_1's binary_logloss: 0.369035
[11]	valid_0's auc: 0.901958	valid_0's binary_logloss: 0.371271	valid_1's auc: 0.904536	valid_1's binary_logloss: 0.362695
[12]	valid_0's auc: 0.902712	valid_0's binary_logloss: 0.365325	valid_1's auc: 0.904917	valid_1's binary_logloss: 0.357165
[13]	valid_0's auc: 0.903607	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.905448	valid_1's binary_logloss: 0.352189
[14]	valid_0's auc: 0.90411	valid_0's binary_logloss: 0.355367	valid_1's auc: 0.905582	valid_1's binary_logloss: 0.347845
[15]	valid_0's auc: 0.905142	valid_0's binary_logloss: 0.351087	valid_1's auc: 0.905872	valid_1's binary_logloss: 0.344197
[16]	valid_0's auc: 0.905715	valid_0's binary_logloss: 0.347394	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.340902
[17]	valid_0's auc: 0.906452	valid_0's binary_logloss: 0.343859	valid_1's auc: 0.906377	valid_1's binary_logloss: 0.338101
[18]	valid_0's auc: 0.907111	valid_0's binary_logloss: 0.340666	valid_1's auc: 0.906431	valid_1's binary_logloss: 0.335674
[19]	valid_0's auc: 0.908026	valid_0's binary_logloss: 0.337582	valid_1's auc: 0.906587	valid_1's binary_logloss: 0.333435
[20]	valid_0's auc: 0.908829	valid_0's binary_logloss: 0.334831	valid_1's auc: 0.906869	valid_1's binary_logloss: 0.331543
[21]	valid_0's auc: 0.909441	valid_0's binary_logloss: 0.332471	valid_1's auc: 0.907297	valid_1's binary_logloss: 0.329665
[22]	valid_0's auc: 0.91014	valid_0's binary_logloss: 0.330146	valid_1's auc: 0.907746	valid_1's binary_logloss: 0.327827
[23]	valid_0's auc: 0.910809	valid_0's binary_logloss: 0.327961	valid_1's auc: 0.907802	valid_1's binary_logloss: 0.326481
[24]	valid_0's auc: 0.911434	valid_0's binary_logloss: 0.325861	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.325187
[25]	valid_0's auc: 0.911977	valid_0's binary_logloss: 0.324096	valid_1's auc: 0.908145	valid_1's binary_logloss: 0.32394
[26]	valid_0's auc: 0.912594	valid_0's binary_logloss: 0.322352	valid_1's auc: 0.908181	valid_1's binary_logloss: 0.322983
[27]	valid_0's auc: 0.913045	valid_0's binary_logloss: 0.320869	valid_1's auc: 0.908244	valid_1's binary_logloss: 0.32208
[28]	valid_0's auc: 0.913716	valid_0's binary_logloss: 0.319176	valid_1's auc: 0.90844	valid_1's binary_logloss: 0.321187
[29]	valid_0's auc: 0.914226	valid_0's binary_logloss: 0.317778	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.320412
[30]	valid_0's auc: 0.914698	valid_0's binary_logloss: 0.316445	valid_1's auc: 0.908478	valid_1's binary_logloss: 0.32001
[31]	valid_0's auc: 0.915169	valid_0's binary_logloss: 0.315202	valid_1's auc: 0.908574	valid_1's binary_logloss: 0.319465
[32]	valid_0's auc: 0.915602	valid_0's binary_logloss: 0.314007	valid_1's auc: 0.908716	valid_1's binary_logloss: 0.318874
[33]	valid_0's auc: 0.916023	valid_0's binary_logloss: 0.31286	valid_1's auc: 0.908919	valid_1's binary_logloss: 0.318228
[34]	valid_0's auc: 0.91644	valid_0's binary_logloss: 0.311748	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.317768
[35]	valid_0's auc: 0.916777	valid_0's binary_logloss: 0.310816	valid_1's auc: 0.908961	valid_1's binary_logloss: 0.317525
[36]	valid_0's auc: 0.91713	valid_0's binary_logloss: 0.309928	valid_1's auc: 0.908993	valid_1's binary_logloss: 0.317207
[37]	valid_0's auc: 0.917571	valid_0's binary_logloss: 0.308946	valid_1's auc: 0.909045	valid_1's binary_logloss: 0.316908
[38]	valid_0's auc: 0.918087	valid_0's binary_logloss: 0.307902	valid_1's auc: 0.909173	valid_1's binary_logloss: 0.316577
[39]	valid_0's auc: 0.918438	valid_0's binary_logloss: 0.307028	valid_1's auc: 0.909105	valid_1's binary_logloss: 0.316393
[40]	valid_0's auc: 0.918855	valid_0's binary_logloss: 0.306172	valid_1's auc: 0.90932	valid_1's binary_logloss: 0.315911
[41]	valid_0's auc: 0.919183	valid_0's binary_logloss: 0.3054	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.315829
[42]	valid_0's auc: 0.919459	valid_0's binary_logloss: 0.3047	valid_1's auc: 0.909185	valid_1's binary_logloss: 0.315841
[43]	valid_0's auc: 0.919816	valid_0's binary_logloss: 0.303929	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.315456
[44]	valid_0's auc: 0.920082	valid_0's binary_logloss: 0.303293	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.315411
[45]	valid_0's auc: 0.92055	valid_0's binary_logloss: 0.302468	valid_1's auc: 0.909361	valid_1's binary_logloss: 0.315353
[46]	valid_0's auc: 0.920827	valid_0's binary_logloss: 0.301886	valid_1's auc: 0.909336	valid_1's binary_logloss: 0.315287
[47]	valid_0's auc: 0.921206	valid_0's binary_logloss: 0.301167	valid_1's auc: 0.90928	valid_1's binary_logloss: 0.315288
[48]	valid_0's auc: 0.921498	valid_0's binary_logloss: 0.300584	valid_1's auc: 0.90929	valid_1's binary_logloss: 0.315197
[49]	valid_0's auc: 0.921886	valid_0's binary_logloss: 0.299891	valid_1's auc: 0.909219	valid_1's binary_logloss: 0.315312
[50]	valid_0's auc: 0.922149	valid_0's binary_logloss: 0.299339	valid_1's auc: 0.909228	valid_1's binary_logloss: 0.315256
[51]	valid_0's auc: 0.92257	valid_0's binary_logloss: 0.29862	valid_1's auc: 0.909199	valid_1's binary_logloss: 0.31522
[52]	valid_0's auc: 0.922878	valid_0's binary_logloss: 0.298042	valid_1's auc: 0.909171	valid_1's binary_logloss: 0.315223
[53]	valid_0's auc: 0.923201	valid_0's binary_logloss: 0.297448	valid_1's auc: 0.909102	valid_1's binary_logloss: 0.315331
[54]	valid_0's auc: 0.923492	valid_0's binary_logloss: 0.296867	valid_1's auc: 0.909004	valid_1's binary_logloss: 0.315434
[55]	valid_0's auc: 0.923733	valid_0's binary_logloss: 0.296339	valid_1's auc: 0.909076	valid_1's binary_logloss: 0.315373
[56]	valid_0's auc: 0.924035	valid_0's binary_logloss: 0.295774	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.315384
[57]	valid_0's auc: 0.924395	valid_0's binary_logloss: 0.295161	valid_1's auc: 0.909025	valid_1's binary_logloss: 0.315401
[58]	valid_0's auc: 0.924687	valid_0's binary_logloss: 0.294643	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.315403
[59]	valid_0's auc: 0.924983	valid_0's binary_logloss: 0.294096	valid_1's auc: 0.909091	valid_1's binary_logloss: 0.31529
[60]	valid_0's auc: 0.925167	valid_0's binary_logloss: 0.293715	valid_1's auc: 0.908991	valid_1's binary_logloss: 0.315386
[61]	valid_0's auc: 0.925512	valid_0's binary_logloss: 0.293095	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.315297
[62]	valid_0's auc: 0.925783	valid_0's binary_logloss: 0.292625	valid_1's auc: 0.908989	valid_1's binary_logloss: 0.315394
[63]	valid_0's auc: 0.926055	valid_0's binary_logloss: 0.29211	valid_1's auc: 0.908953	valid_1's binary_logloss: 0.315397
[64]	valid_0's auc: 0.926402	valid_0's binary_logloss: 0.291511	valid_1's auc: 0.908982	valid_1's binary_logloss: 0.315382
[65]	valid_0's auc: 0.926786	valid_0's binary_logloss: 0.290862	valid_1's auc: 0.909007	valid_1's binary_logloss: 0.31532
[66]	valid_0's auc: 0.92699	valid_0's binary_logloss: 0.29049	valid_1's auc: 0.909031	valid_1's binary_logloss: 0.315264
[67]	valid_0's auc: 0.927239	valid_0's binary_logloss: 0.290075	valid_1's auc: 0.909009	valid_1's binary_logloss: 0.31528
[68]	valid_0's auc: 0.927526	valid_0's binary_logloss: 0.289601	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.315519
[69]	valid_0's auc: 0.927745	valid_0's binary_logloss: 0.28919	valid_1's auc: 0.90879	valid_1's binary_logloss: 0.315623
[70]	valid_0's auc: 0.927945	valid_0's binary_logloss: 0.288799	valid_1's auc: 0.908739	valid_1's binary_logloss: 0.315671
[71]	valid_0's auc: 0.928182	valid_0's binary_logloss: 0.288379	valid_1's auc: 0.908631	valid_1's binary_logloss: 0.315797
[72]	valid_0's auc: 0.928436	valid_0's binary_logloss: 0.287961	valid_1's auc: 0.908523	valid_1's binary_logloss: 0.315984
[73]	valid_0's auc: 0.928782	valid_0's binary_logloss: 0.287393	valid_1's auc: 0.908517	valid_1's binary_logloss: 0.316032
[74]	valid_0's auc: 0.929068	valid_0's binary_logloss: 0.286899	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.316055
[75]	valid_0's auc: 0.929395	valid_0's binary_logloss: 0.286326	valid_1's auc: 0.908512	valid_1's binary_logloss: 0.316029
[76]	valid_0's auc: 0.929599	valid_0's binary_logloss: 0.285948	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.316129
[77]	valid_0's auc: 0.929816	valid_0's binary_logloss: 0.285554	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.316251
[78]	valid_0's auc: 0.93004	valid_0's binary_logloss: 0.285133	valid_1's auc: 0.908441	valid_1's binary_logloss: 0.316173
[79]	valid_0's auc: 0.930266	valid_0's binary_logloss: 0.284748	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.316138
[80]	valid_0's auc: 0.930542	valid_0's binary_logloss: 0.28426	valid_1's auc: 0.908382	valid_1's binary_logloss: 0.316257
[81]	valid_0's auc: 0.93075	valid_0's binary_logloss: 0.283862	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316258
[82]	valid_0's auc: 0.930986	valid_0's binary_logloss: 0.283501	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316358
[83]	valid_0's auc: 0.931161	valid_0's binary_logloss: 0.283184	valid_1's auc: 0.908334	valid_1's binary_logloss: 0.316404
[84]	valid_0's auc: 0.931393	valid_0's binary_logloss: 0.282794	valid_1's auc: 0.908283	valid_1's binary_logloss: 0.316471
[85]	valid_0's auc: 0.931658	valid_0's binary_logloss: 0.282299	valid_1's auc: 0.908191	valid_1's binary_logloss: 0.31667
[86]	valid_0's auc: 0.931883	valid_0's binary_logloss: 0.281936	valid_1's auc: 0.90817	valid_1's binary_logloss: 0.316716
[87]	valid_0's auc: 0.932145	valid_0's binary_logloss: 0.281495	valid_1's auc: 0.908263	valid_1's binary_logloss: 0.316565
[88]	valid_0's auc: 0.932438	valid_0's binary_logloss: 0.280973	valid_1's auc: 0.908219	valid_1's binary_logloss: 0.316618
[89]	valid_0's auc: 0.932675	valid_0's binary_logloss: 0.280547	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316755
[90]	valid_0's auc: 0.932971	valid_0's binary_logloss: 0.280071	valid_1's auc: 0.908047	valid_1's binary_logloss: 0.316963
[91]	valid_0's auc: 0.93322	valid_0's binary_logloss: 0.279664	valid_1's auc: 0.907976	valid_1's binary_logloss: 0.317065
[92]	valid_0's auc: 0.933488	valid_0's binary_logloss: 0.279221	valid_1's auc: 0.907931	valid_1's binary_logloss: 0.317137
[93]	valid_0's auc: 0.933708	valid_0's binary_logloss: 0.278855	valid_1's auc: 0.907804	valid_1's binary_logloss: 0.317367
[94]	valid_0's auc: 0.933975	valid_0's binary_logloss: 0.278407	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.317391
[95]	valid_0's auc: 0.934122	valid_0's binary_logloss: 0.278117	valid_1's auc: 0.907704	valid_1's binary_logloss: 0.317605
[96]	valid_0's auc: 0.934399	valid_0's binary_logloss: 0.277664	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.317775
[97]	valid_0's auc: 0.934666	valid_0's binary_logloss: 0.277252	valid_1's auc: 0.907631	valid_1's binary_logloss: 0.317793
[98]	valid_0's auc: 0.934888	valid_0's binary_logloss: 0.276893	valid_1's auc: 0.907468	valid_1's binary_logloss: 0.318063
[99]	valid_0's auc: 0.935105	valid_0's binary_logloss: 0.276511	valid_1's auc: 0.907382	valid_1's binary_logloss: 0.318194
[100]	valid_0's auc: 0.93526	valid_0's binary_logloss: 0.276189	valid_1's auc: 0.90731	valid_1's binary_logloss: 0.318313
[101]	valid_0's auc: 0.935496	valid_0's binary_logloss: 0.275784	valid_1's auc: 0.907349	valid_1's binary_logloss: 0.318327
[102]	valid_0's auc: 0.935663	valid_0's binary_logloss: 0.275472	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318516
[103]	valid_0's auc: 0.935884	valid_0's binary_logloss: 0.275078	valid_1's auc: 0.907141	valid_1's binary_logloss: 0.318718
[104]	valid_0's auc: 0.936088	valid_0's binary_logloss: 0.27471	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318854
[105]	valid_0's auc: 0.936317	valid_0's binary_logloss: 0.274273	valid_1's auc: 0.906972	valid_1's binary_logloss: 0.319061
[106]	valid_0's auc: 0.936551	valid_0's binary_logloss: 0.273872	valid_1's auc: 0.906858	valid_1's binary_logloss: 0.31929
[107]	valid_0's auc: 0.936776	valid_0's binary_logloss: 0.273498	valid_1's auc: 0.906813	valid_1's binary_logloss: 0.319375
[108]	valid_0's auc: 0.936902	valid_0's binary_logloss: 0.273229	valid_1's auc: 0.906744	valid_1's binary_logloss: 0.3195
[109]	valid_0's auc: 0.93709	valid_0's binary_logloss: 0.272894	valid_1's auc: 0.90671	valid_1's binary_logloss: 0.319547
[110]	valid_0's auc: 0.937341	valid_0's binary_logloss: 0.272452	valid_1's auc: 0.906785	valid_1's binary_logloss: 0.319388
[111]	valid_0's auc: 0.937508	valid_0's binary_logloss: 0.272141	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.319403
[112]	valid_0's auc: 0.937718	valid_0's binary_logloss: 0.271789	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319359
[113]	valid_0's auc: 0.93782	valid_0's binary_logloss: 0.271585	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319381
[114]	valid_0's auc: 0.938084	valid_0's binary_logloss: 0.271165	valid_1's auc: 0.906776	valid_1's binary_logloss: 0.319469
[115]	valid_0's auc: 0.938266	valid_0's binary_logloss: 0.270857	valid_1's auc: 0.906737	valid_1's binary_logloss: 0.319603
[116]	valid_0's auc: 0.938436	valid_0's binary_logloss: 0.270574	valid_1's auc: 0.906653	valid_1's binary_logloss: 0.319782
[117]	valid_0's auc: 0.938625	valid_0's binary_logloss: 0.270232	valid_1's auc: 0.906602	valid_1's binary_logloss: 0.319926
[118]	valid_0's auc: 0.938825	valid_0's binary_logloss: 0.269882	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.320129
[119]	valid_0's auc: 0.939	valid_0's binary_logloss: 0.269554	valid_1's auc: 0.906505	valid_1's binary_logloss: 0.320087
[120]	valid_0's auc: 0.939166	valid_0's binary_logloss: 0.269265	valid_1's auc: 0.906422	valid_1's binary_logloss: 0.320269
[121]	valid_0's auc: 0.939309	valid_0's binary_logloss: 0.268978	valid_1's auc: 0.906342	valid_1's binary_logloss: 0.320396
[122]	valid_0's auc: 0.939493	valid_0's binary_logloss: 0.268676	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.320565
[123]	valid_0's auc: 0.939646	valid_0's binary_logloss: 0.26838	valid_1's auc: 0.906306	valid_1's binary_logloss: 0.320636
[124]	valid_0's auc: 0.939836	valid_0's binary_logloss: 0.267995	valid_1's auc: 0.906257	valid_1's binary_logloss: 0.32075
[125]	valid_0's auc: 0.939919	valid_0's binary_logloss: 0.267796	valid_1's auc: 0.9062	valid_1's binary_logloss: 0.320867
[126]	valid_0's auc: 0.940094	valid_0's binary_logloss: 0.267491	valid_1's auc: 0.906134	valid_1's binary_logloss: 0.321028
[127]	valid_0's auc: 0.940301	valid_0's binary_logloss: 0.267094	valid_1's auc: 0.906103	valid_1's binary_logloss: 0.321137
[128]	valid_0's auc: 0.940535	valid_0's binary_logloss: 0.266721	valid_1's auc: 0.906173	valid_1's binary_logloss: 0.320977
[129]	valid_0's auc: 0.940682	valid_0's binary_logloss: 0.266442	valid_1's auc: 0.906065	valid_1's binary_logloss: 0.3212
[130]	valid_0's auc: 0.940879	valid_0's binary_logloss: 0.26606	valid_1's auc: 0.905952	valid_1's binary_logloss: 0.321387
[131]	valid_0's auc: 0.94107	valid_0's binary_logloss: 0.265705	valid_1's auc: 0.905921	valid_1's binary_logloss: 0.321485
[132]	valid_0's auc: 0.941196	valid_0's binary_logloss: 0.265472	valid_1's auc: 0.905913	valid_1's binary_logloss: 0.321495
[133]	valid_0's auc: 0.941291	valid_0's binary_logloss: 0.265279	valid_1's auc: 0.905931	valid_1's binary_logloss: 0.321496
[134]	valid_0's auc: 0.941477	valid_0's binary_logloss: 0.264941	valid_1's auc: 0.905955	valid_1's binary_logloss: 0.321444
[135]	valid_0's auc: 0.941699	valid_0's binary_logloss: 0.264558	valid_1's auc: 0.905845	valid_1's binary_logloss: 0.321615
[136]	valid_0's auc: 0.941878	valid_0's binary_logloss: 0.264215	valid_1's auc: 0.905814	valid_1's binary_logloss: 0.321703
[137]	valid_0's auc: 0.942058	valid_0's binary_logloss: 0.263906	valid_1's auc: 0.905729	valid_1's binary_logloss: 0.321854
[138]	valid_0's auc: 0.942317	valid_0's binary_logloss: 0.263455	valid_1's auc: 0.905624	valid_1's binary_logloss: 0.322095
[139]	valid_0's auc: 0.942481	valid_0's binary_logloss: 0.263162	valid_1's auc: 0.905542	valid_1's binary_logloss: 0.322257
[140]	valid_0's auc: 0.942719	valid_0's binary_logloss: 0.262773	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.322355
[141]	valid_0's auc: 0.942903	valid_0's binary_logloss: 0.262462	valid_1's auc: 0.905295	valid_1's binary_logloss: 0.322719
[142]	valid_0's auc: 0.943022	valid_0's binary_logloss: 0.262222	valid_1's auc: 0.905373	valid_1's binary_logloss: 0.322579
[143]	valid_0's auc: 0.943175	valid_0's binary_logloss: 0.261945	valid_1's auc: 0.905431	valid_1's binary_logloss: 0.322543
Early stopping, best iteration is:
[43]	valid_0's auc: 0.919816	valid_0's binary_logloss: 0.303929	valid_1's auc: 0.909366	valid_1's binary_logloss: 0.315456
[1]	valid_0's auc: 0.886572	valid_0's binary_logloss: 0.517393	valid_1's auc: 0.891691	valid_1's binary_logloss: 0.508845
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889325	valid_0's binary_logloss: 0.48844	valid_1's auc: 0.895182	valid_1's binary_logloss: 0.47942
[3]	valid_0's auc: 0.890907	valid_0's binary_logloss: 0.465197	valid_1's auc: 0.896562	valid_1's binary_logloss: 0.455809
[4]	valid_0's auc: 0.89514	valid_0's binary_logloss: 0.445768	valid_1's auc: 0.899296	valid_1's binary_logloss: 0.43648
[5]	valid_0's auc: 0.896951	valid_0's binary_logloss: 0.42971	valid_1's auc: 0.899718	valid_1's binary_logloss: 0.420604
[6]	valid_0's auc: 0.897889	valid_0's binary_logloss: 0.416111	valid_1's auc: 0.900881	valid_1's binary_logloss: 0.406931
[7]	valid_0's auc: 0.898689	valid_0's binary_logloss: 0.404436	valid_1's auc: 0.901422	valid_1's binary_logloss: 0.395411
[8]	valid_0's auc: 0.89958	valid_0's binary_logloss: 0.394345	valid_1's auc: 0.902597	valid_1's binary_logloss: 0.385225
[9]	valid_0's auc: 0.90032	valid_0's binary_logloss: 0.385639	valid_1's auc: 0.902948	valid_1's binary_logloss: 0.376863
[10]	valid_0's auc: 0.901296	valid_0's binary_logloss: 0.378042	valid_1's auc: 0.903458	valid_1's binary_logloss: 0.369727
[11]	valid_0's auc: 0.902004	valid_0's binary_logloss: 0.371306	valid_1's auc: 0.903438	valid_1's binary_logloss: 0.363518
[12]	valid_0's auc: 0.902758	valid_0's binary_logloss: 0.365335	valid_1's auc: 0.903948	valid_1's binary_logloss: 0.357923
[13]	valid_0's auc: 0.903856	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.904456	valid_1's binary_logloss: 0.353137
[14]	valid_0's auc: 0.904376	valid_0's binary_logloss: 0.355393	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.348708
[15]	valid_0's auc: 0.905155	valid_0's binary_logloss: 0.351161	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.345105
[16]	valid_0's auc: 0.905871	valid_0's binary_logloss: 0.347288	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.341559
[17]	valid_0's auc: 0.90683	valid_0's binary_logloss: 0.343704	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.338621
[18]	valid_0's auc: 0.90744	valid_0's binary_logloss: 0.340595	valid_1's auc: 0.906705	valid_1's binary_logloss: 0.336005
[19]	valid_0's auc: 0.908245	valid_0's binary_logloss: 0.337639	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.333835
[20]	valid_0's auc: 0.908769	valid_0's binary_logloss: 0.335121	valid_1's auc: 0.906857	valid_1's binary_logloss: 0.332
[21]	valid_0's auc: 0.909625	valid_0's binary_logloss: 0.332551	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.330061
[22]	valid_0's auc: 0.910309	valid_0's binary_logloss: 0.330205	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.328665
[23]	valid_0's auc: 0.910705	valid_0's binary_logloss: 0.32828	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.327131
[24]	valid_0's auc: 0.911375	valid_0's binary_logloss: 0.32623	valid_1's auc: 0.9075	valid_1's binary_logloss: 0.325809
[25]	valid_0's auc: 0.911914	valid_0's binary_logloss: 0.324421	valid_1's auc: 0.907602	valid_1's binary_logloss: 0.324596
[26]	valid_0's auc: 0.912336	valid_0's binary_logloss: 0.322802	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.323522
[27]	valid_0's auc: 0.912859	valid_0's binary_logloss: 0.321261	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.322844
[28]	valid_0's auc: 0.913424	valid_0's binary_logloss: 0.319703	valid_1's auc: 0.908143	valid_1's binary_logloss: 0.321905
[29]	valid_0's auc: 0.913896	valid_0's binary_logloss: 0.318274	valid_1's auc: 0.908367	valid_1's binary_logloss: 0.320959
[30]	valid_0's auc: 0.914282	valid_0's binary_logloss: 0.317012	valid_1's auc: 0.908386	valid_1's binary_logloss: 0.320424
[31]	valid_0's auc: 0.914767	valid_0's binary_logloss: 0.31572	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.319982
[32]	valid_0's auc: 0.915194	valid_0's binary_logloss: 0.314571	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.319529
[33]	valid_0's auc: 0.915607	valid_0's binary_logloss: 0.313531	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.319073
[34]	valid_0's auc: 0.916045	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.318693
[35]	valid_0's auc: 0.916433	valid_0's binary_logloss: 0.311436	valid_1's auc: 0.908496	valid_1's binary_logloss: 0.31834
[36]	valid_0's auc: 0.916799	valid_0's binary_logloss: 0.310539	valid_1's auc: 0.908423	valid_1's binary_logloss: 0.318183
[37]	valid_0's auc: 0.917263	valid_0's binary_logloss: 0.309483	valid_1's auc: 0.908437	valid_1's binary_logloss: 0.317954
[38]	valid_0's auc: 0.917766	valid_0's binary_logloss: 0.30852	valid_1's auc: 0.908403	valid_1's binary_logloss: 0.317848
[39]	valid_0's auc: 0.918172	valid_0's binary_logloss: 0.3076	valid_1's auc: 0.908529	valid_1's binary_logloss: 0.317562
[40]	valid_0's auc: 0.918559	valid_0's binary_logloss: 0.306776	valid_1's auc: 0.908434	valid_1's binary_logloss: 0.317469
[41]	valid_0's auc: 0.918866	valid_0's binary_logloss: 0.305998	valid_1's auc: 0.908414	valid_1's binary_logloss: 0.31731
[42]	valid_0's auc: 0.919216	valid_0's binary_logloss: 0.30518	valid_1's auc: 0.908398	valid_1's binary_logloss: 0.317191
[43]	valid_0's auc: 0.919589	valid_0's binary_logloss: 0.30439	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.317173
[44]	valid_0's auc: 0.91996	valid_0's binary_logloss: 0.303628	valid_1's auc: 0.908413	valid_1's binary_logloss: 0.316965
[45]	valid_0's auc: 0.920328	valid_0's binary_logloss: 0.302886	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.317024
[46]	valid_0's auc: 0.920652	valid_0's binary_logloss: 0.302256	valid_1's auc: 0.908283	valid_1's binary_logloss: 0.31696
[47]	valid_0's auc: 0.921047	valid_0's binary_logloss: 0.301491	valid_1's auc: 0.908378	valid_1's binary_logloss: 0.316761
[48]	valid_0's auc: 0.92142	valid_0's binary_logloss: 0.300747	valid_1's auc: 0.908466	valid_1's binary_logloss: 0.316573
[49]	valid_0's auc: 0.921785	valid_0's binary_logloss: 0.300074	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316581
[50]	valid_0's auc: 0.922071	valid_0's binary_logloss: 0.299563	valid_1's auc: 0.908311	valid_1's binary_logloss: 0.316637
[51]	valid_0's auc: 0.922491	valid_0's binary_logloss: 0.298886	valid_1's auc: 0.90821	valid_1's binary_logloss: 0.3168
[52]	valid_0's auc: 0.922825	valid_0's binary_logloss: 0.298279	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.316724
[53]	valid_0's auc: 0.923173	valid_0's binary_logloss: 0.297619	valid_1's auc: 0.908161	valid_1's binary_logloss: 0.316809
[54]	valid_0's auc: 0.923539	valid_0's binary_logloss: 0.296976	valid_1's auc: 0.90821	valid_1's binary_logloss: 0.316646
[55]	valid_0's auc: 0.923814	valid_0's binary_logloss: 0.296438	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.316824
[56]	valid_0's auc: 0.924108	valid_0's binary_logloss: 0.295903	valid_1's auc: 0.908006	valid_1's binary_logloss: 0.316942
[57]	valid_0's auc: 0.924357	valid_0's binary_logloss: 0.295422	valid_1's auc: 0.907962	valid_1's binary_logloss: 0.31703
[58]	valid_0's auc: 0.924604	valid_0's binary_logloss: 0.29492	valid_1's auc: 0.90793	valid_1's binary_logloss: 0.317067
[59]	valid_0's auc: 0.924905	valid_0's binary_logloss: 0.294339	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317052
[60]	valid_0's auc: 0.925191	valid_0's binary_logloss: 0.293826	valid_1's auc: 0.907934	valid_1's binary_logloss: 0.317022
[61]	valid_0's auc: 0.925411	valid_0's binary_logloss: 0.293354	valid_1's auc: 0.907854	valid_1's binary_logloss: 0.317145
[62]	valid_0's auc: 0.925682	valid_0's binary_logloss: 0.292869	valid_1's auc: 0.907833	valid_1's binary_logloss: 0.317196
[63]	valid_0's auc: 0.925922	valid_0's binary_logloss: 0.292435	valid_1's auc: 0.90781	valid_1's binary_logloss: 0.317237
[64]	valid_0's auc: 0.926188	valid_0's binary_logloss: 0.291982	valid_1's auc: 0.907712	valid_1's binary_logloss: 0.317364
[65]	valid_0's auc: 0.926393	valid_0's binary_logloss: 0.291572	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.317424
[66]	valid_0's auc: 0.926764	valid_0's binary_logloss: 0.290996	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.317293
[67]	valid_0's auc: 0.927104	valid_0's binary_logloss: 0.290424	valid_1's auc: 0.907817	valid_1's binary_logloss: 0.317178
[68]	valid_0's auc: 0.927276	valid_0's binary_logloss: 0.290111	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317219
[69]	valid_0's auc: 0.927533	valid_0's binary_logloss: 0.289635	valid_1's auc: 0.907759	valid_1's binary_logloss: 0.31729
[70]	valid_0's auc: 0.927837	valid_0's binary_logloss: 0.289139	valid_1's auc: 0.907756	valid_1's binary_logloss: 0.317295
[71]	valid_0's auc: 0.928046	valid_0's binary_logloss: 0.288758	valid_1's auc: 0.907778	valid_1's binary_logloss: 0.317258
[72]	valid_0's auc: 0.928296	valid_0's binary_logloss: 0.288298	valid_1's auc: 0.90767	valid_1's binary_logloss: 0.31743
[73]	valid_0's auc: 0.928512	valid_0's binary_logloss: 0.287925	valid_1's auc: 0.907594	valid_1's binary_logloss: 0.317551
[74]	valid_0's auc: 0.928731	valid_0's binary_logloss: 0.287496	valid_1's auc: 0.907523	valid_1's binary_logloss: 0.317674
[75]	valid_0's auc: 0.929057	valid_0's binary_logloss: 0.286987	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.31769
[76]	valid_0's auc: 0.929295	valid_0's binary_logloss: 0.286563	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.317738
[77]	valid_0's auc: 0.929547	valid_0's binary_logloss: 0.286116	valid_1's auc: 0.907411	valid_1's binary_logloss: 0.317866
[78]	valid_0's auc: 0.929722	valid_0's binary_logloss: 0.285782	valid_1's auc: 0.907433	valid_1's binary_logloss: 0.317857
[79]	valid_0's auc: 0.930052	valid_0's binary_logloss: 0.285198	valid_1's auc: 0.907325	valid_1's binary_logloss: 0.318039
[80]	valid_0's auc: 0.930297	valid_0's binary_logloss: 0.284774	valid_1's auc: 0.90737	valid_1's binary_logloss: 0.317967
[81]	valid_0's auc: 0.930493	valid_0's binary_logloss: 0.284447	valid_1's auc: 0.907255	valid_1's binary_logloss: 0.318155
[82]	valid_0's auc: 0.930784	valid_0's binary_logloss: 0.283929	valid_1's auc: 0.907228	valid_1's binary_logloss: 0.318198
[83]	valid_0's auc: 0.93106	valid_0's binary_logloss: 0.283467	valid_1's auc: 0.907176	valid_1's binary_logloss: 0.318284
[84]	valid_0's auc: 0.93135	valid_0's binary_logloss: 0.282958	valid_1's auc: 0.907123	valid_1's binary_logloss: 0.318463
[85]	valid_0's auc: 0.93153	valid_0's binary_logloss: 0.282631	valid_1's auc: 0.907048	valid_1's binary_logloss: 0.318589
[86]	valid_0's auc: 0.931782	valid_0's binary_logloss: 0.282233	valid_1's auc: 0.907079	valid_1's binary_logloss: 0.318573
[87]	valid_0's auc: 0.931998	valid_0's binary_logloss: 0.281859	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.318695
[88]	valid_0's auc: 0.932169	valid_0's binary_logloss: 0.281518	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318879
[89]	valid_0's auc: 0.932401	valid_0's binary_logloss: 0.281126	valid_1's auc: 0.90683	valid_1's binary_logloss: 0.318989
[90]	valid_0's auc: 0.932652	valid_0's binary_logloss: 0.280701	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319214
[91]	valid_0's auc: 0.932829	valid_0's binary_logloss: 0.28037	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319206
[92]	valid_0's auc: 0.933072	valid_0's binary_logloss: 0.279957	valid_1's auc: 0.906607	valid_1's binary_logloss: 0.319386
[93]	valid_0's auc: 0.933271	valid_0's binary_logloss: 0.27962	valid_1's auc: 0.906606	valid_1's binary_logloss: 0.319354
[94]	valid_0's auc: 0.933536	valid_0's binary_logloss: 0.279148	valid_1's auc: 0.906476	valid_1's binary_logloss: 0.319605
[95]	valid_0's auc: 0.933723	valid_0's binary_logloss: 0.278802	valid_1's auc: 0.906436	valid_1's binary_logloss: 0.319765
[96]	valid_0's auc: 0.934007	valid_0's binary_logloss: 0.278301	valid_1's auc: 0.906438	valid_1's binary_logloss: 0.319797
[97]	valid_0's auc: 0.934129	valid_0's binary_logloss: 0.278058	valid_1's auc: 0.90642	valid_1's binary_logloss: 0.319834
[98]	valid_0's auc: 0.9344	valid_0's binary_logloss: 0.277588	valid_1's auc: 0.906423	valid_1's binary_logloss: 0.319876
[99]	valid_0's auc: 0.934608	valid_0's binary_logloss: 0.27723	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.319961
[100]	valid_0's auc: 0.934815	valid_0's binary_logloss: 0.276881	valid_1's auc: 0.906317	valid_1's binary_logloss: 0.320131
[101]	valid_0's auc: 0.934988	valid_0's binary_logloss: 0.276567	valid_1's auc: 0.906179	valid_1's binary_logloss: 0.320355
[102]	valid_0's auc: 0.935251	valid_0's binary_logloss: 0.276152	valid_1's auc: 0.906178	valid_1's binary_logloss: 0.320406
[103]	valid_0's auc: 0.935444	valid_0's binary_logloss: 0.275822	valid_1's auc: 0.906132	valid_1's binary_logloss: 0.320441
[104]	valid_0's auc: 0.935626	valid_0's binary_logloss: 0.27552	valid_1's auc: 0.906094	valid_1's binary_logloss: 0.320485
[105]	valid_0's auc: 0.935825	valid_0's binary_logloss: 0.275177	valid_1's auc: 0.906082	valid_1's binary_logloss: 0.320535
[106]	valid_0's auc: 0.93606	valid_0's binary_logloss: 0.27477	valid_1's auc: 0.906017	valid_1's binary_logloss: 0.320679
[107]	valid_0's auc: 0.936295	valid_0's binary_logloss: 0.274371	valid_1's auc: 0.905918	valid_1's binary_logloss: 0.320893
[108]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.273994	valid_1's auc: 0.905957	valid_1's binary_logloss: 0.320858
[109]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.27367	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.320982
[110]	valid_0's auc: 0.936899	valid_0's binary_logloss: 0.273327	valid_1's auc: 0.90575	valid_1's binary_logloss: 0.321248
[111]	valid_0's auc: 0.937054	valid_0's binary_logloss: 0.273025	valid_1's auc: 0.905676	valid_1's binary_logloss: 0.321442
[112]	valid_0's auc: 0.93732	valid_0's binary_logloss: 0.27259	valid_1's auc: 0.905665	valid_1's binary_logloss: 0.321469
[113]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272268	valid_1's auc: 0.905569	valid_1's binary_logloss: 0.321647
[114]	valid_0's auc: 0.937725	valid_0's binary_logloss: 0.271876	valid_1's auc: 0.905532	valid_1's binary_logloss: 0.321671
[115]	valid_0's auc: 0.938006	valid_0's binary_logloss: 0.271402	valid_1's auc: 0.905503	valid_1's binary_logloss: 0.321772
[116]	valid_0's auc: 0.938198	valid_0's binary_logloss: 0.27107	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.321776
[117]	valid_0's auc: 0.93844	valid_0's binary_logloss: 0.270638	valid_1's auc: 0.905536	valid_1's binary_logloss: 0.321646
[118]	valid_0's auc: 0.938594	valid_0's binary_logloss: 0.270341	valid_1's auc: 0.905547	valid_1's binary_logloss: 0.321643
[119]	valid_0's auc: 0.938857	valid_0's binary_logloss: 0.269876	valid_1's auc: 0.905419	valid_1's binary_logloss: 0.321921
[120]	valid_0's auc: 0.939076	valid_0's binary_logloss: 0.269496	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.322051
[121]	valid_0's auc: 0.939223	valid_0's binary_logloss: 0.269226	valid_1's auc: 0.905396	valid_1's binary_logloss: 0.322015
[122]	valid_0's auc: 0.939466	valid_0's binary_logloss: 0.268791	valid_1's auc: 0.905463	valid_1's binary_logloss: 0.321958
[123]	valid_0's auc: 0.939637	valid_0's binary_logloss: 0.26849	valid_1's auc: 0.905466	valid_1's binary_logloss: 0.321952
[124]	valid_0's auc: 0.939841	valid_0's binary_logloss: 0.268092	valid_1's auc: 0.905492	valid_1's binary_logloss: 0.321939
[125]	valid_0's auc: 0.939963	valid_0's binary_logloss: 0.267853	valid_1's auc: 0.905566	valid_1's binary_logloss: 0.321895
[126]	valid_0's auc: 0.94017	valid_0's binary_logloss: 0.267485	valid_1's auc: 0.905566	valid_1's binary_logloss: 0.321915
[127]	valid_0's auc: 0.940325	valid_0's binary_logloss: 0.26714	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.322114
[128]	valid_0's auc: 0.94048	valid_0's binary_logloss: 0.266849	valid_1's auc: 0.905571	valid_1's binary_logloss: 0.322058
[129]	valid_0's auc: 0.940628	valid_0's binary_logloss: 0.266551	valid_1's auc: 0.905467	valid_1's binary_logloss: 0.322261
[130]	valid_0's auc: 0.940794	valid_0's binary_logloss: 0.266233	valid_1's auc: 0.905474	valid_1's binary_logloss: 0.322286
[131]	valid_0's auc: 0.940999	valid_0's binary_logloss: 0.26585	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.322381
[132]	valid_0's auc: 0.941137	valid_0's binary_logloss: 0.265596	valid_1's auc: 0.905423	valid_1's binary_logloss: 0.322419
[133]	valid_0's auc: 0.941346	valid_0's binary_logloss: 0.265217	valid_1's auc: 0.905346	valid_1's binary_logloss: 0.322589
[134]	valid_0's auc: 0.941546	valid_0's binary_logloss: 0.264818	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.322781
Early stopping, best iteration is:
[34]	valid_0's auc: 0.916045	valid_0's binary_logloss: 0.312468	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.318693
[1]	valid_0's auc: 0.887983	valid_0's binary_logloss: 0.517034	valid_1's auc: 0.891755	valid_1's binary_logloss: 0.508452
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89066	valid_0's binary_logloss: 0.488464	valid_1's auc: 0.89629	valid_1's binary_logloss: 0.478946
[3]	valid_0's auc: 0.891984	valid_0's binary_logloss: 0.465365	valid_1's auc: 0.897538	valid_1's binary_logloss: 0.455741
[4]	valid_0's auc: 0.896159	valid_0's binary_logloss: 0.446069	valid_1's auc: 0.901608	valid_1's binary_logloss: 0.43617
[5]	valid_0's auc: 0.896836	valid_0's binary_logloss: 0.43022	valid_1's auc: 0.902385	valid_1's binary_logloss: 0.420003
[6]	valid_0's auc: 0.897532	valid_0's binary_logloss: 0.416675	valid_1's auc: 0.902107	valid_1's binary_logloss: 0.406595
[7]	valid_0's auc: 0.898859	valid_0's binary_logloss: 0.404875	valid_1's auc: 0.902903	valid_1's binary_logloss: 0.394907
[8]	valid_0's auc: 0.899531	valid_0's binary_logloss: 0.394951	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.384787
[9]	valid_0's auc: 0.899803	valid_0's binary_logloss: 0.386385	valid_1's auc: 0.904479	valid_1's binary_logloss: 0.376169
[10]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.378764	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.369074
[11]	valid_0's auc: 0.901544	valid_0's binary_logloss: 0.372015	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.36246
[12]	valid_0's auc: 0.902572	valid_0's binary_logloss: 0.366163	valid_1's auc: 0.905663	valid_1's binary_logloss: 0.356912
[13]	valid_0's auc: 0.903409	valid_0's binary_logloss: 0.360834	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.352169
[14]	valid_0's auc: 0.904166	valid_0's binary_logloss: 0.356033	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.347704
[15]	valid_0's auc: 0.904984	valid_0's binary_logloss: 0.351614	valid_1's auc: 0.906578	valid_1's binary_logloss: 0.344168
[16]	valid_0's auc: 0.905714	valid_0's binary_logloss: 0.347783	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.34075
[17]	valid_0's auc: 0.906246	valid_0's binary_logloss: 0.344301	valid_1's auc: 0.907143	valid_1's binary_logloss: 0.337847
[18]	valid_0's auc: 0.90728	valid_0's binary_logloss: 0.340983	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.335175
[19]	valid_0's auc: 0.907688	valid_0's binary_logloss: 0.338297	valid_1's auc: 0.90762	valid_1's binary_logloss: 0.332981
[20]	valid_0's auc: 0.908408	valid_0's binary_logloss: 0.335618	valid_1's auc: 0.907783	valid_1's binary_logloss: 0.331061
[21]	valid_0's auc: 0.909061	valid_0's binary_logloss: 0.333145	valid_1's auc: 0.907854	valid_1's binary_logloss: 0.329397
[22]	valid_0's auc: 0.909826	valid_0's binary_logloss: 0.330782	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.327969
[23]	valid_0's auc: 0.91065	valid_0's binary_logloss: 0.328456	valid_1's auc: 0.908232	valid_1's binary_logloss: 0.326281
[24]	valid_0's auc: 0.911281	valid_0's binary_logloss: 0.326372	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.324744
[25]	valid_0's auc: 0.911828	valid_0's binary_logloss: 0.324552	valid_1's auc: 0.908584	valid_1's binary_logloss: 0.323621
[26]	valid_0's auc: 0.912259	valid_0's binary_logloss: 0.322968	valid_1's auc: 0.908733	valid_1's binary_logloss: 0.322513
[27]	valid_0's auc: 0.912769	valid_0's binary_logloss: 0.321367	valid_1's auc: 0.908998	valid_1's binary_logloss: 0.321379
[28]	valid_0's auc: 0.913292	valid_0's binary_logloss: 0.319838	valid_1's auc: 0.90903	valid_1's binary_logloss: 0.320657
[29]	valid_0's auc: 0.913879	valid_0's binary_logloss: 0.318352	valid_1's auc: 0.908965	valid_1's binary_logloss: 0.320061
[30]	valid_0's auc: 0.914273	valid_0's binary_logloss: 0.317119	valid_1's auc: 0.909043	valid_1's binary_logloss: 0.319426
[31]	valid_0's auc: 0.914778	valid_0's binary_logloss: 0.315856	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.318886
[32]	valid_0's auc: 0.915165	valid_0's binary_logloss: 0.31472	valid_1's auc: 0.90916	valid_1's binary_logloss: 0.318401
[33]	valid_0's auc: 0.915587	valid_0's binary_logloss: 0.313594	valid_1's auc: 0.909288	valid_1's binary_logloss: 0.317881
[34]	valid_0's auc: 0.916204	valid_0's binary_logloss: 0.312259	valid_1's auc: 0.90929	valid_1's binary_logloss: 0.317648
[35]	valid_0's auc: 0.916597	valid_0's binary_logloss: 0.311226	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.317119
[36]	valid_0's auc: 0.917055	valid_0's binary_logloss: 0.310184	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.316668
[37]	valid_0's auc: 0.917456	valid_0's binary_logloss: 0.309239	valid_1's auc: 0.909523	valid_1's binary_logloss: 0.316417
[38]	valid_0's auc: 0.917845	valid_0's binary_logloss: 0.308389	valid_1's auc: 0.909469	valid_1's binary_logloss: 0.316263
[39]	valid_0's auc: 0.918247	valid_0's binary_logloss: 0.307465	valid_1's auc: 0.909394	valid_1's binary_logloss: 0.316188
[40]	valid_0's auc: 0.918689	valid_0's binary_logloss: 0.306525	valid_1's auc: 0.90919	valid_1's binary_logloss: 0.316355
[41]	valid_0's auc: 0.919074	valid_0's binary_logloss: 0.305733	valid_1's auc: 0.909194	valid_1's binary_logloss: 0.316209
[42]	valid_0's auc: 0.919468	valid_0's binary_logloss: 0.30486	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.316194
[43]	valid_0's auc: 0.919843	valid_0's binary_logloss: 0.304037	valid_1's auc: 0.909134	valid_1's binary_logloss: 0.31607
[44]	valid_0's auc: 0.92022	valid_0's binary_logloss: 0.303238	valid_1's auc: 0.909093	valid_1's binary_logloss: 0.31603
[45]	valid_0's auc: 0.920556	valid_0's binary_logloss: 0.302545	valid_1's auc: 0.909079	valid_1's binary_logloss: 0.315931
[46]	valid_0's auc: 0.920891	valid_0's binary_logloss: 0.30179	valid_1's auc: 0.909124	valid_1's binary_logloss: 0.31577
[47]	valid_0's auc: 0.921258	valid_0's binary_logloss: 0.301129	valid_1's auc: 0.909124	valid_1's binary_logloss: 0.315691
[48]	valid_0's auc: 0.921526	valid_0's binary_logloss: 0.300569	valid_1's auc: 0.909048	valid_1's binary_logloss: 0.315767
[49]	valid_0's auc: 0.921836	valid_0's binary_logloss: 0.299924	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.315706
[50]	valid_0's auc: 0.922194	valid_0's binary_logloss: 0.299257	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.31569
[51]	valid_0's auc: 0.922461	valid_0's binary_logloss: 0.298705	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.31568
[52]	valid_0's auc: 0.922743	valid_0's binary_logloss: 0.298202	valid_1's auc: 0.908913	valid_1's binary_logloss: 0.315769
[53]	valid_0's auc: 0.923049	valid_0's binary_logloss: 0.297602	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315559
[54]	valid_0's auc: 0.923299	valid_0's binary_logloss: 0.297118	valid_1's auc: 0.908834	valid_1's binary_logloss: 0.315769
[55]	valid_0's auc: 0.92355	valid_0's binary_logloss: 0.296607	valid_1's auc: 0.908724	valid_1's binary_logloss: 0.315892
[56]	valid_0's auc: 0.923788	valid_0's binary_logloss: 0.296101	valid_1's auc: 0.908669	valid_1's binary_logloss: 0.315888
[57]	valid_0's auc: 0.92408	valid_0's binary_logloss: 0.295571	valid_1's auc: 0.908711	valid_1's binary_logloss: 0.315809
[58]	valid_0's auc: 0.924463	valid_0's binary_logloss: 0.294925	valid_1's auc: 0.9087	valid_1's binary_logloss: 0.315791
[59]	valid_0's auc: 0.924823	valid_0's binary_logloss: 0.294296	valid_1's auc: 0.908785	valid_1's binary_logloss: 0.315673
[60]	valid_0's auc: 0.925159	valid_0's binary_logloss: 0.293739	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.315886
[61]	valid_0's auc: 0.925459	valid_0's binary_logloss: 0.293252	valid_1's auc: 0.908516	valid_1's binary_logloss: 0.316177
[62]	valid_0's auc: 0.925813	valid_0's binary_logloss: 0.292643	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.316386
[63]	valid_0's auc: 0.926043	valid_0's binary_logloss: 0.292193	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.316493
[64]	valid_0's auc: 0.926286	valid_0's binary_logloss: 0.291752	valid_1's auc: 0.908255	valid_1's binary_logloss: 0.316528
[65]	valid_0's auc: 0.926536	valid_0's binary_logloss: 0.291299	valid_1's auc: 0.908362	valid_1's binary_logloss: 0.316372
[66]	valid_0's auc: 0.926795	valid_0's binary_logloss: 0.290837	valid_1's auc: 0.90826	valid_1's binary_logloss: 0.316494
[67]	valid_0's auc: 0.927055	valid_0's binary_logloss: 0.290367	valid_1's auc: 0.908259	valid_1's binary_logloss: 0.316577
[68]	valid_0's auc: 0.927235	valid_0's binary_logloss: 0.290034	valid_1's auc: 0.908203	valid_1's binary_logloss: 0.31661
[69]	valid_0's auc: 0.927487	valid_0's binary_logloss: 0.289541	valid_1's auc: 0.908148	valid_1's binary_logloss: 0.316702
[70]	valid_0's auc: 0.927764	valid_0's binary_logloss: 0.289032	valid_1's auc: 0.908076	valid_1's binary_logloss: 0.3168
[71]	valid_0's auc: 0.928041	valid_0's binary_logloss: 0.288516	valid_1's auc: 0.907992	valid_1's binary_logloss: 0.316959
[72]	valid_0's auc: 0.928403	valid_0's binary_logloss: 0.287954	valid_1's auc: 0.908001	valid_1's binary_logloss: 0.31693
[73]	valid_0's auc: 0.92867	valid_0's binary_logloss: 0.287474	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.316926
[74]	valid_0's auc: 0.92883	valid_0's binary_logloss: 0.287143	valid_1's auc: 0.908129	valid_1's binary_logloss: 0.316815
[75]	valid_0's auc: 0.929105	valid_0's binary_logloss: 0.286651	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.316882
[76]	valid_0's auc: 0.929344	valid_0's binary_logloss: 0.286229	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.316958
[77]	valid_0's auc: 0.929541	valid_0's binary_logloss: 0.285854	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317259
[78]	valid_0's auc: 0.929747	valid_0's binary_logloss: 0.2855	valid_1's auc: 0.907871	valid_1's binary_logloss: 0.317248
[79]	valid_0's auc: 0.929961	valid_0's binary_logloss: 0.285092	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317469
[80]	valid_0's auc: 0.930182	valid_0's binary_logloss: 0.284749	valid_1's auc: 0.90779	valid_1's binary_logloss: 0.317454
[81]	valid_0's auc: 0.930484	valid_0's binary_logloss: 0.284228	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.317445
[82]	valid_0's auc: 0.930752	valid_0's binary_logloss: 0.283799	valid_1's auc: 0.907838	valid_1's binary_logloss: 0.317316
[83]	valid_0's auc: 0.930985	valid_0's binary_logloss: 0.283347	valid_1's auc: 0.907827	valid_1's binary_logloss: 0.317368
[84]	valid_0's auc: 0.931216	valid_0's binary_logloss: 0.282959	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317368
[85]	valid_0's auc: 0.93137	valid_0's binary_logloss: 0.282683	valid_1's auc: 0.907742	valid_1's binary_logloss: 0.317544
[86]	valid_0's auc: 0.931629	valid_0's binary_logloss: 0.28225	valid_1's auc: 0.907811	valid_1's binary_logloss: 0.317469
[87]	valid_0's auc: 0.931938	valid_0's binary_logloss: 0.281722	valid_1's auc: 0.907702	valid_1's binary_logloss: 0.317662
[88]	valid_0's auc: 0.932099	valid_0's binary_logloss: 0.281383	valid_1's auc: 0.90765	valid_1's binary_logloss: 0.317798
[89]	valid_0's auc: 0.93232	valid_0's binary_logloss: 0.280998	valid_1's auc: 0.907589	valid_1's binary_logloss: 0.317898
[90]	valid_0's auc: 0.932602	valid_0's binary_logloss: 0.28053	valid_1's auc: 0.907611	valid_1's binary_logloss: 0.31792
[91]	valid_0's auc: 0.932778	valid_0's binary_logloss: 0.280208	valid_1's auc: 0.907607	valid_1's binary_logloss: 0.317958
[92]	valid_0's auc: 0.932993	valid_0's binary_logloss: 0.279821	valid_1's auc: 0.907576	valid_1's binary_logloss: 0.318052
[93]	valid_0's auc: 0.933286	valid_0's binary_logloss: 0.279352	valid_1's auc: 0.907599	valid_1's binary_logloss: 0.318108
[94]	valid_0's auc: 0.933531	valid_0's binary_logloss: 0.278951	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.3181
[95]	valid_0's auc: 0.933767	valid_0's binary_logloss: 0.27857	valid_1's auc: 0.90751	valid_1's binary_logloss: 0.318217
[96]	valid_0's auc: 0.933968	valid_0's binary_logloss: 0.278262	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.318262
[97]	valid_0's auc: 0.934129	valid_0's binary_logloss: 0.277986	valid_1's auc: 0.907454	valid_1's binary_logloss: 0.318312
[98]	valid_0's auc: 0.934335	valid_0's binary_logloss: 0.277631	valid_1's auc: 0.90736	valid_1's binary_logloss: 0.318435
[99]	valid_0's auc: 0.934541	valid_0's binary_logloss: 0.277266	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318485
[100]	valid_0's auc: 0.934777	valid_0's binary_logloss: 0.276843	valid_1's auc: 0.907282	valid_1's binary_logloss: 0.318649
[101]	valid_0's auc: 0.93499	valid_0's binary_logloss: 0.276494	valid_1's auc: 0.907275	valid_1's binary_logloss: 0.318708
[102]	valid_0's auc: 0.935186	valid_0's binary_logloss: 0.27611	valid_1's auc: 0.907215	valid_1's binary_logloss: 0.31884
[103]	valid_0's auc: 0.935369	valid_0's binary_logloss: 0.27581	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318753
[104]	valid_0's auc: 0.935616	valid_0's binary_logloss: 0.275373	valid_1's auc: 0.907236	valid_1's binary_logloss: 0.318815
[105]	valid_0's auc: 0.935832	valid_0's binary_logloss: 0.275026	valid_1's auc: 0.907294	valid_1's binary_logloss: 0.318702
[106]	valid_0's auc: 0.936047	valid_0's binary_logloss: 0.274648	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.31902
[107]	valid_0's auc: 0.936236	valid_0's binary_logloss: 0.274316	valid_1's auc: 0.907063	valid_1's binary_logloss: 0.319115
[108]	valid_0's auc: 0.936403	valid_0's binary_logloss: 0.274024	valid_1's auc: 0.906923	valid_1's binary_logloss: 0.319412
[109]	valid_0's auc: 0.936558	valid_0's binary_logloss: 0.273755	valid_1's auc: 0.907004	valid_1's binary_logloss: 0.319294
[110]	valid_0's auc: 0.936801	valid_0's binary_logloss: 0.273328	valid_1's auc: 0.906893	valid_1's binary_logloss: 0.319473
[111]	valid_0's auc: 0.936999	valid_0's binary_logloss: 0.27296	valid_1's auc: 0.906856	valid_1's binary_logloss: 0.319543
[112]	valid_0's auc: 0.937193	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.319848
[113]	valid_0's auc: 0.937312	valid_0's binary_logloss: 0.272386	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.319922
[114]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272065	valid_1's auc: 0.906594	valid_1's binary_logloss: 0.32008
[115]	valid_0's auc: 0.937663	valid_0's binary_logloss: 0.271751	valid_1's auc: 0.906521	valid_1's binary_logloss: 0.320239
[116]	valid_0's auc: 0.937795	valid_0's binary_logloss: 0.271507	valid_1's auc: 0.906597	valid_1's binary_logloss: 0.320137
[117]	valid_0's auc: 0.93801	valid_0's binary_logloss: 0.271106	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320143
[118]	valid_0's auc: 0.938196	valid_0's binary_logloss: 0.270758	valid_1's auc: 0.906525	valid_1's binary_logloss: 0.320335
[119]	valid_0's auc: 0.938401	valid_0's binary_logloss: 0.270423	valid_1's auc: 0.906408	valid_1's binary_logloss: 0.320509
[120]	valid_0's auc: 0.938573	valid_0's binary_logloss: 0.270139	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320625
[121]	valid_0's auc: 0.938739	valid_0's binary_logloss: 0.269845	valid_1's auc: 0.906315	valid_1's binary_logloss: 0.320734
[122]	valid_0's auc: 0.938932	valid_0's binary_logloss: 0.269495	valid_1's auc: 0.906147	valid_1's binary_logloss: 0.320985
[123]	valid_0's auc: 0.939103	valid_0's binary_logloss: 0.269178	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.321084
[124]	valid_0's auc: 0.939306	valid_0's binary_logloss: 0.268825	valid_1's auc: 0.906015	valid_1's binary_logloss: 0.321262
[125]	valid_0's auc: 0.939483	valid_0's binary_logloss: 0.268519	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.321408
[126]	valid_0's auc: 0.939615	valid_0's binary_logloss: 0.268263	valid_1's auc: 0.905864	valid_1's binary_logloss: 0.321589
[127]	valid_0's auc: 0.939773	valid_0's binary_logloss: 0.267957	valid_1's auc: 0.905828	valid_1's binary_logloss: 0.321712
[128]	valid_0's auc: 0.939898	valid_0's binary_logloss: 0.26772	valid_1's auc: 0.905789	valid_1's binary_logloss: 0.321791
[129]	valid_0's auc: 0.940027	valid_0's binary_logloss: 0.267469	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321854
[130]	valid_0's auc: 0.940193	valid_0's binary_logloss: 0.267161	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.32201
[131]	valid_0's auc: 0.940319	valid_0's binary_logloss: 0.26692	valid_1's auc: 0.905662	valid_1's binary_logloss: 0.322084
[132]	valid_0's auc: 0.940397	valid_0's binary_logloss: 0.266761	valid_1's auc: 0.905587	valid_1's binary_logloss: 0.322222
[133]	valid_0's auc: 0.940548	valid_0's binary_logloss: 0.266503	valid_1's auc: 0.90554	valid_1's binary_logloss: 0.322282
[134]	valid_0's auc: 0.940775	valid_0's binary_logloss: 0.266129	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.32229
[135]	valid_0's auc: 0.941025	valid_0's binary_logloss: 0.265689	valid_1's auc: 0.905494	valid_1's binary_logloss: 0.322373
[136]	valid_0's auc: 0.94115	valid_0's binary_logloss: 0.265449	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.322479
Early stopping, best iteration is:
[36]	valid_0's auc: 0.917055	valid_0's binary_logloss: 0.310184	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.316668
[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893965	valid_0's binary_logloss: 0.48775	valid_1's auc: 0.898564	valid_1's binary_logloss: 0.47888
[3]	valid_0's auc: 0.895655	valid_0's binary_logloss: 0.464581	valid_1's auc: 0.900964	valid_1's binary_logloss: 0.455298
[4]	valid_0's auc: 0.897539	valid_0's binary_logloss: 0.445277	valid_1's auc: 0.902035	valid_1's binary_logloss: 0.435832
[5]	valid_0's auc: 0.898387	valid_0's binary_logloss: 0.429396	valid_1's auc: 0.902551	valid_1's binary_logloss: 0.419909
[6]	valid_0's auc: 0.899784	valid_0's binary_logloss: 0.415601	valid_1's auc: 0.903665	valid_1's binary_logloss: 0.405988
[7]	valid_0's auc: 0.900824	valid_0's binary_logloss: 0.403723	valid_1's auc: 0.904429	valid_1's binary_logloss: 0.394052
[8]	valid_0's auc: 0.902088	valid_0's binary_logloss: 0.39344	valid_1's auc: 0.904468	valid_1's binary_logloss: 0.384577
[9]	valid_0's auc: 0.902694	valid_0's binary_logloss: 0.384752	valid_1's auc: 0.904777	valid_1's binary_logloss: 0.376082
[10]	valid_0's auc: 0.903391	valid_0's binary_logloss: 0.377109	valid_1's auc: 0.905176	valid_1's binary_logloss: 0.368864
[11]	valid_0's auc: 0.904096	valid_0's binary_logloss: 0.370215	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.362563
[12]	valid_0's auc: 0.904953	valid_0's binary_logloss: 0.36405	valid_1's auc: 0.90565	valid_1's binary_logloss: 0.356965
[13]	valid_0's auc: 0.905971	valid_0's binary_logloss: 0.358588	valid_1's auc: 0.906212	valid_1's binary_logloss: 0.351909
[14]	valid_0's auc: 0.90702	valid_0's binary_logloss: 0.35362	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.347828
[15]	valid_0's auc: 0.907713	valid_0's binary_logloss: 0.349262	valid_1's auc: 0.906916	valid_1's binary_logloss: 0.344105
[16]	valid_0's auc: 0.908381	valid_0's binary_logloss: 0.345411	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.34082
[17]	valid_0's auc: 0.908924	valid_0's binary_logloss: 0.34202	valid_1's auc: 0.907311	valid_1's binary_logloss: 0.338023
[18]	valid_0's auc: 0.909721	valid_0's binary_logloss: 0.338681	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.335254
[19]	valid_0's auc: 0.91022	valid_0's binary_logloss: 0.335887	valid_1's auc: 0.907815	valid_1's binary_logloss: 0.333127
[20]	valid_0's auc: 0.910801	valid_0's binary_logloss: 0.333212	valid_1's auc: 0.907714	valid_1's binary_logloss: 0.33124
[21]	valid_0's auc: 0.911408	valid_0's binary_logloss: 0.330734	valid_1's auc: 0.907928	valid_1's binary_logloss: 0.329457
[22]	valid_0's auc: 0.911972	valid_0's binary_logloss: 0.328387	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.327816
[23]	valid_0's auc: 0.912761	valid_0's binary_logloss: 0.326142	valid_1's auc: 0.908197	valid_1's binary_logloss: 0.326528
[24]	valid_0's auc: 0.913524	valid_0's binary_logloss: 0.323941	valid_1's auc: 0.908612	valid_1's binary_logloss: 0.324926
[25]	valid_0's auc: 0.914174	valid_0's binary_logloss: 0.321948	valid_1's auc: 0.908783	valid_1's binary_logloss: 0.323723
[26]	valid_0's auc: 0.914852	valid_0's binary_logloss: 0.319983	valid_1's auc: 0.908928	valid_1's binary_logloss: 0.322644
[27]	valid_0's auc: 0.915466	valid_0's binary_logloss: 0.318315	valid_1's auc: 0.909014	valid_1's binary_logloss: 0.321733
[28]	valid_0's auc: 0.916026	valid_0's binary_logloss: 0.316677	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.320995
[29]	valid_0's auc: 0.916624	valid_0's binary_logloss: 0.315105	valid_1's auc: 0.909	valid_1's binary_logloss: 0.320399
[30]	valid_0's auc: 0.917074	valid_0's binary_logloss: 0.313791	valid_1's auc: 0.908976	valid_1's binary_logloss: 0.319869
[31]	valid_0's auc: 0.917669	valid_0's binary_logloss: 0.312373	valid_1's auc: 0.908985	valid_1's binary_logloss: 0.319336
[32]	valid_0's auc: 0.918185	valid_0's binary_logloss: 0.311106	valid_1's auc: 0.908975	valid_1's binary_logloss: 0.318913
[33]	valid_0's auc: 0.918688	valid_0's binary_logloss: 0.309854	valid_1's auc: 0.909075	valid_1's binary_logloss: 0.318445
[34]	valid_0's auc: 0.919132	valid_0's binary_logloss: 0.308681	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.318088
[35]	valid_0's auc: 0.919628	valid_0's binary_logloss: 0.307502	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317632
[36]	valid_0's auc: 0.920057	valid_0's binary_logloss: 0.306455	valid_1's auc: 0.909115	valid_1's binary_logloss: 0.317404
[37]	valid_0's auc: 0.920619	valid_0's binary_logloss: 0.305373	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.317138
[38]	valid_0's auc: 0.921063	valid_0's binary_logloss: 0.3044	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.31714
[39]	valid_0's auc: 0.921527	valid_0's binary_logloss: 0.303407	valid_1's auc: 0.908999	valid_1's binary_logloss: 0.316944
[40]	valid_0's auc: 0.921993	valid_0's binary_logloss: 0.302462	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.316911
[41]	valid_0's auc: 0.922464	valid_0's binary_logloss: 0.301427	valid_1's auc: 0.908767	valid_1's binary_logloss: 0.31694
[42]	valid_0's auc: 0.922911	valid_0's binary_logloss: 0.30047	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.31667
[43]	valid_0's auc: 0.923327	valid_0's binary_logloss: 0.299654	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.316418
[44]	valid_0's auc: 0.923745	valid_0's binary_logloss: 0.298826	valid_1's auc: 0.908948	valid_1's binary_logloss: 0.31623
[45]	valid_0's auc: 0.924137	valid_0's binary_logloss: 0.298016	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.316185
[46]	valid_0's auc: 0.924505	valid_0's binary_logloss: 0.29724	valid_1's auc: 0.90897	valid_1's binary_logloss: 0.316023
[47]	valid_0's auc: 0.924849	valid_0's binary_logloss: 0.296548	valid_1's auc: 0.908886	valid_1's binary_logloss: 0.316063
[48]	valid_0's auc: 0.925234	valid_0's binary_logloss: 0.295834	valid_1's auc: 0.908919	valid_1's binary_logloss: 0.315925
[49]	valid_0's auc: 0.92565	valid_0's binary_logloss: 0.29507	valid_1's auc: 0.90888	valid_1's binary_logloss: 0.3159
[50]	valid_0's auc: 0.926046	valid_0's binary_logloss: 0.294374	valid_1's auc: 0.908865	valid_1's binary_logloss: 0.31583
[51]	valid_0's auc: 0.926434	valid_0's binary_logloss: 0.293628	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.315792
[52]	valid_0's auc: 0.926786	valid_0's binary_logloss: 0.292948	valid_1's auc: 0.90876	valid_1's binary_logloss: 0.315922
[53]	valid_0's auc: 0.927211	valid_0's binary_logloss: 0.29213	valid_1's auc: 0.908748	valid_1's binary_logloss: 0.315878
[54]	valid_0's auc: 0.927665	valid_0's binary_logloss: 0.29132	valid_1's auc: 0.908625	valid_1's binary_logloss: 0.315966
[55]	valid_0's auc: 0.927959	valid_0's binary_logloss: 0.290725	valid_1's auc: 0.908632	valid_1's binary_logloss: 0.315958
[56]	valid_0's auc: 0.928243	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.908654	valid_1's binary_logloss: 0.315877
[57]	valid_0's auc: 0.928567	valid_0's binary_logloss: 0.28949	valid_1's auc: 0.908579	valid_1's binary_logloss: 0.315982
[58]	valid_0's auc: 0.928916	valid_0's binary_logloss: 0.2889	valid_1's auc: 0.908532	valid_1's binary_logloss: 0.316041
[59]	valid_0's auc: 0.929229	valid_0's binary_logloss: 0.28829	valid_1's auc: 0.90853	valid_1's binary_logloss: 0.316035
[60]	valid_0's auc: 0.92953	valid_0's binary_logloss: 0.287708	valid_1's auc: 0.908526	valid_1's binary_logloss: 0.315974
[61]	valid_0's auc: 0.92995	valid_0's binary_logloss: 0.287003	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.316386
[62]	valid_0's auc: 0.930386	valid_0's binary_logloss: 0.286305	valid_1's auc: 0.908235	valid_1's binary_logloss: 0.316457
[63]	valid_0's auc: 0.930679	valid_0's binary_logloss: 0.285782	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.316658
[64]	valid_0's auc: 0.931084	valid_0's binary_logloss: 0.285147	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.316635
[65]	valid_0's auc: 0.931427	valid_0's binary_logloss: 0.284507	valid_1's auc: 0.908243	valid_1's binary_logloss: 0.316525
[66]	valid_0's auc: 0.931846	valid_0's binary_logloss: 0.283753	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316724
[67]	valid_0's auc: 0.932211	valid_0's binary_logloss: 0.283163	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.316634
[68]	valid_0's auc: 0.932451	valid_0's binary_logloss: 0.282688	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.31672
[69]	valid_0's auc: 0.932807	valid_0's binary_logloss: 0.282106	valid_1's auc: 0.90792	valid_1's binary_logloss: 0.317004
[70]	valid_0's auc: 0.933086	valid_0's binary_logloss: 0.281647	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317093
[71]	valid_0's auc: 0.933387	valid_0's binary_logloss: 0.281075	valid_1's auc: 0.907877	valid_1's binary_logloss: 0.317059
[72]	valid_0's auc: 0.933649	valid_0's binary_logloss: 0.28059	valid_1's auc: 0.907922	valid_1's binary_logloss: 0.317019
[73]	valid_0's auc: 0.933981	valid_0's binary_logloss: 0.280024	valid_1's auc: 0.908019	valid_1's binary_logloss: 0.316932
[74]	valid_0's auc: 0.93426	valid_0's binary_logloss: 0.279527	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.316902
[75]	valid_0's auc: 0.934497	valid_0's binary_logloss: 0.279065	valid_1's auc: 0.90808	valid_1's binary_logloss: 0.316832
[76]	valid_0's auc: 0.934717	valid_0's binary_logloss: 0.278678	valid_1's auc: 0.908004	valid_1's binary_logloss: 0.316904
[77]	valid_0's auc: 0.935024	valid_0's binary_logloss: 0.278147	valid_1's auc: 0.907907	valid_1's binary_logloss: 0.317068
[78]	valid_0's auc: 0.935454	valid_0's binary_logloss: 0.277438	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.317063
[79]	valid_0's auc: 0.935705	valid_0's binary_logloss: 0.276937	valid_1's auc: 0.907881	valid_1's binary_logloss: 0.317098
[80]	valid_0's auc: 0.936004	valid_0's binary_logloss: 0.276435	valid_1's auc: 0.907801	valid_1's binary_logloss: 0.317228
[81]	valid_0's auc: 0.936242	valid_0's binary_logloss: 0.276002	valid_1's auc: 0.907795	valid_1's binary_logloss: 0.317266
[82]	valid_0's auc: 0.936516	valid_0's binary_logloss: 0.27551	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317244
[83]	valid_0's auc: 0.936823	valid_0's binary_logloss: 0.274999	valid_1's auc: 0.907898	valid_1's binary_logloss: 0.317089
[84]	valid_0's auc: 0.937077	valid_0's binary_logloss: 0.274532	valid_1's auc: 0.907907	valid_1's binary_logloss: 0.317078
[85]	valid_0's auc: 0.937354	valid_0's binary_logloss: 0.274045	valid_1's auc: 0.907749	valid_1's binary_logloss: 0.317288
[86]	valid_0's auc: 0.937625	valid_0's binary_logloss: 0.273585	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.317505
[87]	valid_0's auc: 0.937925	valid_0's binary_logloss: 0.273025	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.317575
[88]	valid_0's auc: 0.938269	valid_0's binary_logloss: 0.272487	valid_1's auc: 0.907592	valid_1's binary_logloss: 0.317594
[89]	valid_0's auc: 0.938599	valid_0's binary_logloss: 0.271899	valid_1's auc: 0.907574	valid_1's binary_logloss: 0.317589
[90]	valid_0's auc: 0.938847	valid_0's binary_logloss: 0.271442	valid_1's auc: 0.907462	valid_1's binary_logloss: 0.317798
[91]	valid_0's auc: 0.939119	valid_0's binary_logloss: 0.270984	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317913
[92]	valid_0's auc: 0.939419	valid_0's binary_logloss: 0.270451	valid_1's auc: 0.907457	valid_1's binary_logloss: 0.317854
[93]	valid_0's auc: 0.939613	valid_0's binary_logloss: 0.270076	valid_1's auc: 0.907331	valid_1's binary_logloss: 0.318094
[94]	valid_0's auc: 0.939761	valid_0's binary_logloss: 0.269744	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.318092
[95]	valid_0's auc: 0.940023	valid_0's binary_logloss: 0.269299	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.318038
[96]	valid_0's auc: 0.940215	valid_0's binary_logloss: 0.268928	valid_1's auc: 0.907351	valid_1's binary_logloss: 0.31808
[97]	valid_0's auc: 0.940479	valid_0's binary_logloss: 0.268467	valid_1's auc: 0.907305	valid_1's binary_logloss: 0.318128
[98]	valid_0's auc: 0.940824	valid_0's binary_logloss: 0.267894	valid_1's auc: 0.907295	valid_1's binary_logloss: 0.318114
[99]	valid_0's auc: 0.941002	valid_0's binary_logloss: 0.267463	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.3182
[100]	valid_0's auc: 0.94123	valid_0's binary_logloss: 0.267028	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.318203
[101]	valid_0's auc: 0.941449	valid_0's binary_logloss: 0.266659	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.318452
[102]	valid_0's auc: 0.941718	valid_0's binary_logloss: 0.266204	valid_1's auc: 0.906896	valid_1's binary_logloss: 0.318786
[103]	valid_0's auc: 0.941925	valid_0's binary_logloss: 0.265825	valid_1's auc: 0.906946	valid_1's binary_logloss: 0.318703
[104]	valid_0's auc: 0.942146	valid_0's binary_logloss: 0.265435	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.318721
[105]	valid_0's auc: 0.942325	valid_0's binary_logloss: 0.265093	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.31894
[106]	valid_0's auc: 0.942521	valid_0's binary_logloss: 0.26473	valid_1's auc: 0.906753	valid_1's binary_logloss: 0.319089
[107]	valid_0's auc: 0.942703	valid_0's binary_logloss: 0.264364	valid_1's auc: 0.906773	valid_1's binary_logloss: 0.319083
[108]	valid_0's auc: 0.942888	valid_0's binary_logloss: 0.264016	valid_1's auc: 0.906736	valid_1's binary_logloss: 0.319193
[109]	valid_0's auc: 0.94307	valid_0's binary_logloss: 0.263653	valid_1's auc: 0.906687	valid_1's binary_logloss: 0.319271
[110]	valid_0's auc: 0.943393	valid_0's binary_logloss: 0.263107	valid_1's auc: 0.906534	valid_1's binary_logloss: 0.319521
[111]	valid_0's auc: 0.943652	valid_0's binary_logloss: 0.262643	valid_1's auc: 0.906465	valid_1's binary_logloss: 0.319624
[112]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.262249	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.319721
[113]	valid_0's auc: 0.944041	valid_0's binary_logloss: 0.261857	valid_1's auc: 0.906314	valid_1's binary_logloss: 0.319963
[114]	valid_0's auc: 0.944212	valid_0's binary_logloss: 0.261534	valid_1's auc: 0.906243	valid_1's binary_logloss: 0.320085
[115]	valid_0's auc: 0.944439	valid_0's binary_logloss: 0.261101	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.320253
[116]	valid_0's auc: 0.944635	valid_0's binary_logloss: 0.260696	valid_1's auc: 0.906071	valid_1's binary_logloss: 0.320428
[117]	valid_0's auc: 0.944897	valid_0's binary_logloss: 0.260166	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.320501
[118]	valid_0's auc: 0.94514	valid_0's binary_logloss: 0.259702	valid_1's auc: 0.905902	valid_1's binary_logloss: 0.320775
[119]	valid_0's auc: 0.945403	valid_0's binary_logloss: 0.259189	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320681
[120]	valid_0's auc: 0.94555	valid_0's binary_logloss: 0.258843	valid_1's auc: 0.905956	valid_1's binary_logloss: 0.320782
[121]	valid_0's auc: 0.945742	valid_0's binary_logloss: 0.258454	valid_1's auc: 0.906073	valid_1's binary_logloss: 0.320636
[122]	valid_0's auc: 0.945903	valid_0's binary_logloss: 0.25812	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320737
[123]	valid_0's auc: 0.946118	valid_0's binary_logloss: 0.257727	valid_1's auc: 0.905951	valid_1's binary_logloss: 0.320873
[124]	valid_0's auc: 0.946279	valid_0's binary_logloss: 0.257401	valid_1's auc: 0.905949	valid_1's binary_logloss: 0.320859
[125]	valid_0's auc: 0.9464	valid_0's binary_logloss: 0.257113	valid_1's auc: 0.905998	valid_1's binary_logloss: 0.320838
[126]	valid_0's auc: 0.946541	valid_0's binary_logloss: 0.256815	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.32099
[127]	valid_0's auc: 0.946714	valid_0's binary_logloss: 0.256514	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.321113
[128]	valid_0's auc: 0.946933	valid_0's binary_logloss: 0.256127	valid_1's auc: 0.905836	valid_1's binary_logloss: 0.321208
[129]	valid_0's auc: 0.947157	valid_0's binary_logloss: 0.255684	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.321399
[130]	valid_0's auc: 0.947413	valid_0's binary_logloss: 0.255215	valid_1's auc: 0.905755	valid_1's binary_logloss: 0.32142
[131]	valid_0's auc: 0.947626	valid_0's binary_logloss: 0.254818	valid_1's auc: 0.905794	valid_1's binary_logloss: 0.321344
[132]	valid_0's auc: 0.947755	valid_0's binary_logloss: 0.254555	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321386
[133]	valid_0's auc: 0.947924	valid_0's binary_logloss: 0.25423	valid_1's auc: 0.905691	valid_1's binary_logloss: 0.321548
[134]	valid_0's auc: 0.948092	valid_0's binary_logloss: 0.253925	valid_1's auc: 0.90572	valid_1's binary_logloss: 0.321508
[135]	valid_0's auc: 0.948211	valid_0's binary_logloss: 0.25366	valid_1's auc: 0.905675	valid_1's binary_logloss: 0.321587
Early stopping, best iteration is:
[35]	valid_0's auc: 0.919628	valid_0's binary_logloss: 0.307502	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317632
[1]	valid_0's auc: 0.883716	valid_0's binary_logloss: 0.517437	valid_1's auc: 0.891829	valid_1's binary_logloss: 0.508331
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890073	valid_0's binary_logloss: 0.488559	valid_1's auc: 0.895643	valid_1's binary_logloss: 0.47903
[3]	valid_0's auc: 0.89469	valid_0's binary_logloss: 0.465046	valid_1's auc: 0.899849	valid_1's binary_logloss: 0.455412
[4]	valid_0's auc: 0.896069	valid_0's binary_logloss: 0.445806	valid_1's auc: 0.901287	valid_1's binary_logloss: 0.435833
[5]	valid_0's auc: 0.897389	valid_0's binary_logloss: 0.429622	valid_1's auc: 0.901269	valid_1's binary_logloss: 0.419878
[6]	valid_0's auc: 0.898537	valid_0's binary_logloss: 0.415829	valid_1's auc: 0.90164	valid_1's binary_logloss: 0.406518
[7]	valid_0's auc: 0.899913	valid_0's binary_logloss: 0.404082	valid_1's auc: 0.90253	valid_1's binary_logloss: 0.394728
[8]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.394009	valid_1's auc: 0.90316	valid_1's binary_logloss: 0.384967
[9]	valid_0's auc: 0.901575	valid_0's binary_logloss: 0.385168	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.376241
[10]	valid_0's auc: 0.902151	valid_0's binary_logloss: 0.377494	valid_1's auc: 0.904329	valid_1's binary_logloss: 0.368945
[11]	valid_0's auc: 0.903157	valid_0's binary_logloss: 0.370649	valid_1's auc: 0.904521	valid_1's binary_logloss: 0.362422
[12]	valid_0's auc: 0.904146	valid_0's binary_logloss: 0.364509	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.357161
[13]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.358996	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.352531
[14]	valid_0's auc: 0.905821	valid_0's binary_logloss: 0.354303	valid_1's auc: 0.905235	valid_1's binary_logloss: 0.348331
[15]	valid_0's auc: 0.906501	valid_0's binary_logloss: 0.350005	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.344659
[16]	valid_0's auc: 0.907197	valid_0's binary_logloss: 0.346171	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.341413
[17]	valid_0's auc: 0.907706	valid_0's binary_logloss: 0.342767	valid_1's auc: 0.906119	valid_1's binary_logloss: 0.33838
[18]	valid_0's auc: 0.90833	valid_0's binary_logloss: 0.339529	valid_1's auc: 0.906432	valid_1's binary_logloss: 0.335707
[19]	valid_0's auc: 0.909141	valid_0's binary_logloss: 0.336667	valid_1's auc: 0.906907	valid_1's binary_logloss: 0.33344
[20]	valid_0's auc: 0.909876	valid_0's binary_logloss: 0.333932	valid_1's auc: 0.906948	valid_1's binary_logloss: 0.331682
[21]	valid_0's auc: 0.91072	valid_0's binary_logloss: 0.331312	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.329863
[22]	valid_0's auc: 0.911318	valid_0's binary_logloss: 0.329059	valid_1's auc: 0.90775	valid_1's binary_logloss: 0.327885
[23]	valid_0's auc: 0.912182	valid_0's binary_logloss: 0.326642	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.326267
[24]	valid_0's auc: 0.912963	valid_0's binary_logloss: 0.324378	valid_1's auc: 0.908239	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.913644	valid_0's binary_logloss: 0.322409	valid_1's auc: 0.908413	valid_1's binary_logloss: 0.323279
[26]	valid_0's auc: 0.914223	valid_0's binary_logloss: 0.320614	valid_1's auc: 0.908625	valid_1's binary_logloss: 0.322223
[27]	valid_0's auc: 0.914803	valid_0's binary_logloss: 0.318976	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.321136
[28]	valid_0's auc: 0.915536	valid_0's binary_logloss: 0.317202	valid_1's auc: 0.909073	valid_1's binary_logloss: 0.320222
[29]	valid_0's auc: 0.916209	valid_0's binary_logloss: 0.31558	valid_1's auc: 0.909141	valid_1's binary_logloss: 0.319585
[30]	valid_0's auc: 0.916656	valid_0's binary_logloss: 0.314205	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.318964
[31]	valid_0's auc: 0.917221	valid_0's binary_logloss: 0.312808	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.318274
[32]	valid_0's auc: 0.917821	valid_0's binary_logloss: 0.311401	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.317757
[33]	valid_0's auc: 0.918299	valid_0's binary_logloss: 0.310204	valid_1's auc: 0.909571	valid_1's binary_logloss: 0.317191
[34]	valid_0's auc: 0.918779	valid_0's binary_logloss: 0.309067	valid_1's auc: 0.909576	valid_1's binary_logloss: 0.316784
[35]	valid_0's auc: 0.91933	valid_0's binary_logloss: 0.307859	valid_1's auc: 0.909686	valid_1's binary_logloss: 0.316332
[36]	valid_0's auc: 0.919711	valid_0's binary_logloss: 0.306854	valid_1's auc: 0.90985	valid_1's binary_logloss: 0.315794
[37]	valid_0's auc: 0.920148	valid_0's binary_logloss: 0.305776	valid_1's auc: 0.909915	valid_1's binary_logloss: 0.315482
[38]	valid_0's auc: 0.920644	valid_0's binary_logloss: 0.304716	valid_1's auc: 0.90996	valid_1's binary_logloss: 0.315194
[39]	valid_0's auc: 0.921279	valid_0's binary_logloss: 0.303523	valid_1's auc: 0.910021	valid_1's binary_logloss: 0.31493
[40]	valid_0's auc: 0.921695	valid_0's binary_logloss: 0.302625	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314992
[41]	valid_0's auc: 0.922157	valid_0's binary_logloss: 0.301742	valid_1's auc: 0.909853	valid_1's binary_logloss: 0.314822
[42]	valid_0's auc: 0.922604	valid_0's binary_logloss: 0.300806	valid_1's auc: 0.909692	valid_1's binary_logloss: 0.314968
[43]	valid_0's auc: 0.923044	valid_0's binary_logloss: 0.299986	valid_1's auc: 0.909703	valid_1's binary_logloss: 0.314858
[44]	valid_0's auc: 0.923508	valid_0's binary_logloss: 0.29913	valid_1's auc: 0.909722	valid_1's binary_logloss: 0.314687
[45]	valid_0's auc: 0.923968	valid_0's binary_logloss: 0.298278	valid_1's auc: 0.909802	valid_1's binary_logloss: 0.314548
[46]	valid_0's auc: 0.924346	valid_0's binary_logloss: 0.297515	valid_1's auc: 0.909635	valid_1's binary_logloss: 0.314591
[47]	valid_0's auc: 0.924759	valid_0's binary_logloss: 0.296739	valid_1's auc: 0.909625	valid_1's binary_logloss: 0.314549
[48]	valid_0's auc: 0.92511	valid_0's binary_logloss: 0.296031	valid_1's auc: 0.909672	valid_1's binary_logloss: 0.314395
[49]	valid_0's auc: 0.925568	valid_0's binary_logloss: 0.295128	valid_1's auc: 0.909747	valid_1's binary_logloss: 0.314213
[50]	valid_0's auc: 0.925897	valid_0's binary_logloss: 0.294497	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314313
[51]	valid_0's auc: 0.926313	valid_0's binary_logloss: 0.293828	valid_1's auc: 0.909642	valid_1's binary_logloss: 0.314248
[52]	valid_0's auc: 0.926717	valid_0's binary_logloss: 0.293088	valid_1's auc: 0.909586	valid_1's binary_logloss: 0.314252
[53]	valid_0's auc: 0.927075	valid_0's binary_logloss: 0.292434	valid_1's auc: 0.909528	valid_1's binary_logloss: 0.314305
[54]	valid_0's auc: 0.927507	valid_0's binary_logloss: 0.291637	valid_1's auc: 0.909546	valid_1's binary_logloss: 0.314247
[55]	valid_0's auc: 0.927929	valid_0's binary_logloss: 0.290889	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314349
[56]	valid_0's auc: 0.928351	valid_0's binary_logloss: 0.290158	valid_1's auc: 0.909407	valid_1's binary_logloss: 0.314391
[57]	valid_0's auc: 0.928749	valid_0's binary_logloss: 0.289457	valid_1's auc: 0.909303	valid_1's binary_logloss: 0.314463
[58]	valid_0's auc: 0.929162	valid_0's binary_logloss: 0.28868	valid_1's auc: 0.909262	valid_1's binary_logloss: 0.314567
[59]	valid_0's auc: 0.929451	valid_0's binary_logloss: 0.288145	valid_1's auc: 0.909166	valid_1's binary_logloss: 0.314703
[60]	valid_0's auc: 0.929891	valid_0's binary_logloss: 0.287437	valid_1's auc: 0.909176	valid_1's binary_logloss: 0.314728
[61]	valid_0's auc: 0.93032	valid_0's binary_logloss: 0.286724	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.31478
[62]	valid_0's auc: 0.930593	valid_0's binary_logloss: 0.286258	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.31478
[63]	valid_0's auc: 0.930979	valid_0's binary_logloss: 0.285624	valid_1's auc: 0.908985	valid_1's binary_logloss: 0.314955
[64]	valid_0's auc: 0.93134	valid_0's binary_logloss: 0.284907	valid_1's auc: 0.908987	valid_1's binary_logloss: 0.31491
[65]	valid_0's auc: 0.931648	valid_0's binary_logloss: 0.284345	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.315108
[66]	valid_0's auc: 0.9319	valid_0's binary_logloss: 0.283886	valid_1's auc: 0.908727	valid_1's binary_logloss: 0.315314
[67]	valid_0's auc: 0.932118	valid_0's binary_logloss: 0.283497	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315394
[68]	valid_0's auc: 0.932411	valid_0's binary_logloss: 0.282974	valid_1's auc: 0.908585	valid_1's binary_logloss: 0.315563
[69]	valid_0's auc: 0.932861	valid_0's binary_logloss: 0.282215	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.31572
[70]	valid_0's auc: 0.933228	valid_0's binary_logloss: 0.281536	valid_1's auc: 0.908479	valid_1's binary_logloss: 0.315735
[71]	valid_0's auc: 0.933522	valid_0's binary_logloss: 0.281033	valid_1's auc: 0.90843	valid_1's binary_logloss: 0.315787
[72]	valid_0's auc: 0.933741	valid_0's binary_logloss: 0.28055	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.315925
[73]	valid_0's auc: 0.934042	valid_0's binary_logloss: 0.280057	valid_1's auc: 0.908377	valid_1's binary_logloss: 0.315895
[74]	valid_0's auc: 0.934439	valid_0's binary_logloss: 0.279357	valid_1's auc: 0.908457	valid_1's binary_logloss: 0.315747
[75]	valid_0's auc: 0.934726	valid_0's binary_logloss: 0.278811	valid_1's auc: 0.90845	valid_1's binary_logloss: 0.315763
[76]	valid_0's auc: 0.935012	valid_0's binary_logloss: 0.278326	valid_1's auc: 0.908309	valid_1's binary_logloss: 0.315998
[77]	valid_0's auc: 0.935323	valid_0's binary_logloss: 0.277766	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.316255
[78]	valid_0's auc: 0.935515	valid_0's binary_logloss: 0.277332	valid_1's auc: 0.908093	valid_1's binary_logloss: 0.316266
[79]	valid_0's auc: 0.935859	valid_0's binary_logloss: 0.276762	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.316437
[80]	valid_0's auc: 0.93612	valid_0's binary_logloss: 0.276266	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.31654
[81]	valid_0's auc: 0.936335	valid_0's binary_logloss: 0.275818	valid_1's auc: 0.907773	valid_1's binary_logloss: 0.316834
[82]	valid_0's auc: 0.936578	valid_0's binary_logloss: 0.275412	valid_1's auc: 0.907601	valid_1's binary_logloss: 0.317083
[83]	valid_0's auc: 0.936838	valid_0's binary_logloss: 0.274894	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.31711
[84]	valid_0's auc: 0.937126	valid_0's binary_logloss: 0.274355	valid_1's auc: 0.907741	valid_1's binary_logloss: 0.316892
[85]	valid_0's auc: 0.937387	valid_0's binary_logloss: 0.273881	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.316927
[86]	valid_0's auc: 0.937546	valid_0's binary_logloss: 0.273513	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.317048
[87]	valid_0's auc: 0.937706	valid_0's binary_logloss: 0.273204	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.317093
[88]	valid_0's auc: 0.938026	valid_0's binary_logloss: 0.272696	valid_1's auc: 0.907376	valid_1's binary_logloss: 0.317353
[89]	valid_0's auc: 0.938304	valid_0's binary_logloss: 0.272184	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.317393
[90]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.271714	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.317594
[91]	valid_0's auc: 0.938902	valid_0's binary_logloss: 0.271134	valid_1's auc: 0.907232	valid_1's binary_logloss: 0.317636
[92]	valid_0's auc: 0.939151	valid_0's binary_logloss: 0.270674	valid_1's auc: 0.907232	valid_1's binary_logloss: 0.31764
[93]	valid_0's auc: 0.939491	valid_0's binary_logloss: 0.270076	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.317499
[94]	valid_0's auc: 0.939719	valid_0's binary_logloss: 0.269674	valid_1's auc: 0.907154	valid_1's binary_logloss: 0.317748
[95]	valid_0's auc: 0.939992	valid_0's binary_logloss: 0.269238	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.317764
[96]	valid_0's auc: 0.940181	valid_0's binary_logloss: 0.268792	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.317883
[97]	valid_0's auc: 0.940423	valid_0's binary_logloss: 0.268352	valid_1's auc: 0.907011	valid_1's binary_logloss: 0.318037
[98]	valid_0's auc: 0.940635	valid_0's binary_logloss: 0.267984	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318218
[99]	valid_0's auc: 0.940888	valid_0's binary_logloss: 0.267474	valid_1's auc: 0.906799	valid_1's binary_logloss: 0.318482
[100]	valid_0's auc: 0.941141	valid_0's binary_logloss: 0.267033	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.318632
[101]	valid_0's auc: 0.941373	valid_0's binary_logloss: 0.266543	valid_1's auc: 0.906715	valid_1's binary_logloss: 0.318703
[102]	valid_0's auc: 0.941567	valid_0's binary_logloss: 0.266138	valid_1's auc: 0.906674	valid_1's binary_logloss: 0.318819
[103]	valid_0's auc: 0.941898	valid_0's binary_logloss: 0.265578	valid_1's auc: 0.906632	valid_1's binary_logloss: 0.318852
[104]	valid_0's auc: 0.942122	valid_0's binary_logloss: 0.265155	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.318882
[105]	valid_0's auc: 0.942433	valid_0's binary_logloss: 0.264627	valid_1's auc: 0.906589	valid_1's binary_logloss: 0.318949
[106]	valid_0's auc: 0.942633	valid_0's binary_logloss: 0.264241	valid_1's auc: 0.906558	valid_1's binary_logloss: 0.31901
[107]	valid_0's auc: 0.942846	valid_0's binary_logloss: 0.263807	valid_1's auc: 0.90645	valid_1's binary_logloss: 0.319319
[108]	valid_0's auc: 0.943	valid_0's binary_logloss: 0.263477	valid_1's auc: 0.906395	valid_1's binary_logloss: 0.31937
[109]	valid_0's auc: 0.943283	valid_0's binary_logloss: 0.26295	valid_1's auc: 0.906323	valid_1's binary_logloss: 0.319464
[110]	valid_0's auc: 0.943459	valid_0's binary_logloss: 0.26259	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.319555
[111]	valid_0's auc: 0.943607	valid_0's binary_logloss: 0.262293	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.319712
[112]	valid_0's auc: 0.943738	valid_0's binary_logloss: 0.261985	valid_1's auc: 0.906186	valid_1's binary_logloss: 0.319751
[113]	valid_0's auc: 0.943912	valid_0's binary_logloss: 0.261662	valid_1's auc: 0.906145	valid_1's binary_logloss: 0.319803
[114]	valid_0's auc: 0.944255	valid_0's binary_logloss: 0.261059	valid_1's auc: 0.906052	valid_1's binary_logloss: 0.31996
[115]	valid_0's auc: 0.944417	valid_0's binary_logloss: 0.260722	valid_1's auc: 0.905902	valid_1's binary_logloss: 0.320284
[116]	valid_0's auc: 0.944659	valid_0's binary_logloss: 0.260273	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.320234
[117]	valid_0's auc: 0.944967	valid_0's binary_logloss: 0.259769	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.320148
[118]	valid_0's auc: 0.945235	valid_0's binary_logloss: 0.259296	valid_1's auc: 0.9059	valid_1's binary_logloss: 0.320273
[119]	valid_0's auc: 0.945469	valid_0's binary_logloss: 0.258902	valid_1's auc: 0.905856	valid_1's binary_logloss: 0.320406
[120]	valid_0's auc: 0.945672	valid_0's binary_logloss: 0.258545	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.320478
[121]	valid_0's auc: 0.945858	valid_0's binary_logloss: 0.25815	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.320589
[122]	valid_0's auc: 0.946017	valid_0's binary_logloss: 0.257846	valid_1's auc: 0.905775	valid_1's binary_logloss: 0.320583
[123]	valid_0's auc: 0.946165	valid_0's binary_logloss: 0.257531	valid_1's auc: 0.905724	valid_1's binary_logloss: 0.320695
[124]	valid_0's auc: 0.946424	valid_0's binary_logloss: 0.257024	valid_1's auc: 0.905564	valid_1's binary_logloss: 0.321096
[125]	valid_0's auc: 0.946646	valid_0's binary_logloss: 0.256642	valid_1's auc: 0.905433	valid_1's binary_logloss: 0.321306
[126]	valid_0's auc: 0.946865	valid_0's binary_logloss: 0.256242	valid_1's auc: 0.905412	valid_1's binary_logloss: 0.321339
[127]	valid_0's auc: 0.946988	valid_0's binary_logloss: 0.255992	valid_1's auc: 0.905418	valid_1's binary_logloss: 0.321381
[128]	valid_0's auc: 0.947212	valid_0's binary_logloss: 0.255559	valid_1's auc: 0.905408	valid_1's binary_logloss: 0.321409
[129]	valid_0's auc: 0.947468	valid_0's binary_logloss: 0.255076	valid_1's auc: 0.905305	valid_1's binary_logloss: 0.321584
[130]	valid_0's auc: 0.947655	valid_0's binary_logloss: 0.254702	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.321679
[131]	valid_0's auc: 0.947854	valid_0's binary_logloss: 0.254322	valid_1's auc: 0.905169	valid_1's binary_logloss: 0.321851
[132]	valid_0's auc: 0.948046	valid_0's binary_logloss: 0.253945	valid_1's auc: 0.905126	valid_1's binary_logloss: 0.321916
[133]	valid_0's auc: 0.948226	valid_0's binary_logloss: 0.253593	valid_1's auc: 0.905042	valid_1's binary_logloss: 0.322104
[134]	valid_0's auc: 0.948452	valid_0's binary_logloss: 0.253205	valid_1's auc: 0.905074	valid_1's binary_logloss: 0.322097
[135]	valid_0's auc: 0.948617	valid_0's binary_logloss: 0.252867	valid_1's auc: 0.905022	valid_1's binary_logloss: 0.322243
[136]	valid_0's auc: 0.948783	valid_0's binary_logloss: 0.252531	valid_1's auc: 0.904996	valid_1's binary_logloss: 0.322311
[137]	valid_0's auc: 0.948943	valid_0's binary_logloss: 0.252197	valid_1's auc: 0.904861	valid_1's binary_logloss: 0.322582
[138]	valid_0's auc: 0.949227	valid_0's binary_logloss: 0.251677	valid_1's auc: 0.90482	valid_1's binary_logloss: 0.322665
[139]	valid_0's auc: 0.949439	valid_0's binary_logloss: 0.251306	valid_1's auc: 0.904761	valid_1's binary_logloss: 0.322785
Early stopping, best iteration is:
[39]	valid_0's auc: 0.921279	valid_0's binary_logloss: 0.303523	valid_1's auc: 0.910021	valid_1's binary_logloss: 0.31493
[1]	valid_0's auc: 0.889031	valid_0's binary_logloss: 0.516579	valid_1's auc: 0.896723	valid_1's binary_logloss: 0.507458
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892164	valid_0's binary_logloss: 0.487355	valid_1's auc: 0.898379	valid_1's binary_logloss: 0.477426
[3]	valid_0's auc: 0.893991	valid_0's binary_logloss: 0.463908	valid_1's auc: 0.900966	valid_1's binary_logloss: 0.453477
[4]	valid_0's auc: 0.895536	valid_0's binary_logloss: 0.444506	valid_1's auc: 0.900916	valid_1's binary_logloss: 0.43446
[5]	valid_0's auc: 0.895846	valid_0's binary_logloss: 0.428496	valid_1's auc: 0.900658	valid_1's binary_logloss: 0.41849
[6]	valid_0's auc: 0.897167	valid_0's binary_logloss: 0.414703	valid_1's auc: 0.901702	valid_1's binary_logloss: 0.404942
[7]	valid_0's auc: 0.897784	valid_0's binary_logloss: 0.403095	valid_1's auc: 0.902279	valid_1's binary_logloss: 0.393273
[8]	valid_0's auc: 0.898713	valid_0's binary_logloss: 0.393054	valid_1's auc: 0.902347	valid_1's binary_logloss: 0.383885
[9]	valid_0's auc: 0.902294	valid_0's binary_logloss: 0.38416	valid_1's auc: 0.904294	valid_1's binary_logloss: 0.375629
[10]	valid_0's auc: 0.903355	valid_0's binary_logloss: 0.376336	valid_1's auc: 0.904676	valid_1's binary_logloss: 0.368481
[11]	valid_0's auc: 0.903988	valid_0's binary_logloss: 0.369543	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.362239
[12]	valid_0's auc: 0.904553	valid_0's binary_logloss: 0.363566	valid_1's auc: 0.904913	valid_1's binary_logloss: 0.356787
[13]	valid_0's auc: 0.905538	valid_0's binary_logloss: 0.35817	valid_1's auc: 0.905471	valid_1's binary_logloss: 0.351875
[14]	valid_0's auc: 0.906094	valid_0's binary_logloss: 0.353414	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.347498
[15]	valid_0's auc: 0.906689	valid_0's binary_logloss: 0.349218	valid_1's auc: 0.905742	valid_1's binary_logloss: 0.344195
[16]	valid_0's auc: 0.907549	valid_0's binary_logloss: 0.345324	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.341113
[17]	valid_0's auc: 0.908531	valid_0's binary_logloss: 0.341711	valid_1's auc: 0.906322	valid_1's binary_logloss: 0.338306
[18]	valid_0's auc: 0.909453	valid_0's binary_logloss: 0.338332	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.335814
[19]	valid_0's auc: 0.910388	valid_0's binary_logloss: 0.33525	valid_1's auc: 0.906792	valid_1's binary_logloss: 0.333475
[20]	valid_0's auc: 0.911139	valid_0's binary_logloss: 0.332531	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.33174
[21]	valid_0's auc: 0.911701	valid_0's binary_logloss: 0.330035	valid_1's auc: 0.907003	valid_1's binary_logloss: 0.330016
[22]	valid_0's auc: 0.912346	valid_0's binary_logloss: 0.327668	valid_1's auc: 0.907381	valid_1's binary_logloss: 0.328148
[23]	valid_0's auc: 0.913149	valid_0's binary_logloss: 0.325309	valid_1's auc: 0.907966	valid_1's binary_logloss: 0.326408
[24]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.323223	valid_1's auc: 0.908068	valid_1's binary_logloss: 0.325125
[25]	valid_0's auc: 0.914402	valid_0's binary_logloss: 0.321208	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.323593
[26]	valid_0's auc: 0.915043	valid_0's binary_logloss: 0.319422	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.322682
[27]	valid_0's auc: 0.915496	valid_0's binary_logloss: 0.317822	valid_1's auc: 0.90877	valid_1's binary_logloss: 0.321641
[28]	valid_0's auc: 0.916075	valid_0's binary_logloss: 0.316294	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.321013
[29]	valid_0's auc: 0.916595	valid_0's binary_logloss: 0.314772	valid_1's auc: 0.908808	valid_1's binary_logloss: 0.320348
[30]	valid_0's auc: 0.917022	valid_0's binary_logloss: 0.313416	valid_1's auc: 0.908898	valid_1's binary_logloss: 0.319672
[31]	valid_0's auc: 0.917535	valid_0's binary_logloss: 0.31208	valid_1's auc: 0.909017	valid_1's binary_logloss: 0.319072
[32]	valid_0's auc: 0.918038	valid_0's binary_logloss: 0.310843	valid_1's auc: 0.908875	valid_1's binary_logloss: 0.318855
[33]	valid_0's auc: 0.918517	valid_0's binary_logloss: 0.3096	valid_1's auc: 0.908986	valid_1's binary_logloss: 0.318273
[34]	valid_0's auc: 0.919063	valid_0's binary_logloss: 0.308395	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.318103
[35]	valid_0's auc: 0.91951	valid_0's binary_logloss: 0.307291	valid_1's auc: 0.908911	valid_1's binary_logloss: 0.317738
[36]	valid_0's auc: 0.919965	valid_0's binary_logloss: 0.306194	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.317147
[37]	valid_0's auc: 0.920416	valid_0's binary_logloss: 0.30515	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.316823
[38]	valid_0's auc: 0.920831	valid_0's binary_logloss: 0.304245	valid_1's auc: 0.909252	valid_1's binary_logloss: 0.316523
[39]	valid_0's auc: 0.921265	valid_0's binary_logloss: 0.303314	valid_1's auc: 0.909288	valid_1's binary_logloss: 0.316267
[40]	valid_0's auc: 0.921798	valid_0's binary_logloss: 0.30226	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.316199
[41]	valid_0's auc: 0.922235	valid_0's binary_logloss: 0.301311	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.315801
[42]	valid_0's auc: 0.922572	valid_0's binary_logloss: 0.300602	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.3159
[43]	valid_0's auc: 0.922999	valid_0's binary_logloss: 0.299787	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.315991
[44]	valid_0's auc: 0.923325	valid_0's binary_logloss: 0.299099	valid_1's auc: 0.909061	valid_1's binary_logloss: 0.316024
[45]	valid_0's auc: 0.92378	valid_0's binary_logloss: 0.298221	valid_1's auc: 0.909003	valid_1's binary_logloss: 0.315971
[46]	valid_0's auc: 0.924198	valid_0's binary_logloss: 0.297425	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.316146
[47]	valid_0's auc: 0.924591	valid_0's binary_logloss: 0.296645	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.316098
[48]	valid_0's auc: 0.925021	valid_0's binary_logloss: 0.295803	valid_1's auc: 0.908896	valid_1's binary_logloss: 0.315979
[49]	valid_0's auc: 0.925344	valid_0's binary_logloss: 0.295139	valid_1's auc: 0.908958	valid_1's binary_logloss: 0.315833
[50]	valid_0's auc: 0.925711	valid_0's binary_logloss: 0.294445	valid_1's auc: 0.908883	valid_1's binary_logloss: 0.315863
[51]	valid_0's auc: 0.926134	valid_0's binary_logloss: 0.293662	valid_1's auc: 0.908882	valid_1's binary_logloss: 0.315842
[52]	valid_0's auc: 0.926471	valid_0's binary_logloss: 0.293008	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.316001
[53]	valid_0's auc: 0.926798	valid_0's binary_logloss: 0.292391	valid_1's auc: 0.908831	valid_1's binary_logloss: 0.315821
[54]	valid_0's auc: 0.92719	valid_0's binary_logloss: 0.291686	valid_1's auc: 0.908765	valid_1's binary_logloss: 0.315895
[55]	valid_0's auc: 0.927649	valid_0's binary_logloss: 0.290885	valid_1's auc: 0.908759	valid_1's binary_logloss: 0.315868
[56]	valid_0's auc: 0.928015	valid_0's binary_logloss: 0.29023	valid_1's auc: 0.908856	valid_1's binary_logloss: 0.315779
[57]	valid_0's auc: 0.928312	valid_0's binary_logloss: 0.289624	valid_1's auc: 0.908909	valid_1's binary_logloss: 0.315678
[58]	valid_0's auc: 0.928693	valid_0's binary_logloss: 0.288987	valid_1's auc: 0.908728	valid_1's binary_logloss: 0.315955
[59]	valid_0's auc: 0.929068	valid_0's binary_logloss: 0.288364	valid_1's auc: 0.908633	valid_1's binary_logloss: 0.316082
[60]	valid_0's auc: 0.929442	valid_0's binary_logloss: 0.287648	valid_1's auc: 0.908658	valid_1's binary_logloss: 0.316001
[61]	valid_0's auc: 0.929719	valid_0's binary_logloss: 0.287091	valid_1's auc: 0.908664	valid_1's binary_logloss: 0.315935
[62]	valid_0's auc: 0.929943	valid_0's binary_logloss: 0.286678	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.316004
[63]	valid_0's auc: 0.930195	valid_0's binary_logloss: 0.286172	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.316094
[64]	valid_0's auc: 0.930525	valid_0's binary_logloss: 0.285608	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.316014
[65]	valid_0's auc: 0.930875	valid_0's binary_logloss: 0.284978	valid_1's auc: 0.908549	valid_1's binary_logloss: 0.316138
[66]	valid_0's auc: 0.931114	valid_0's binary_logloss: 0.28457	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316151
[67]	valid_0's auc: 0.931399	valid_0's binary_logloss: 0.284016	valid_1's auc: 0.908584	valid_1's binary_logloss: 0.316178
[68]	valid_0's auc: 0.931655	valid_0's binary_logloss: 0.283564	valid_1's auc: 0.908412	valid_1's binary_logloss: 0.316372
[69]	valid_0's auc: 0.931887	valid_0's binary_logloss: 0.283125	valid_1's auc: 0.908355	valid_1's binary_logloss: 0.316468
[70]	valid_0's auc: 0.93209	valid_0's binary_logloss: 0.282749	valid_1's auc: 0.908316	valid_1's binary_logloss: 0.31653
[71]	valid_0's auc: 0.932465	valid_0's binary_logloss: 0.282071	valid_1's auc: 0.90832	valid_1's binary_logloss: 0.316509
[72]	valid_0's auc: 0.932768	valid_0's binary_logloss: 0.28151	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316488
[73]	valid_0's auc: 0.933005	valid_0's binary_logloss: 0.281039	valid_1's auc: 0.908397	valid_1's binary_logloss: 0.316454
[74]	valid_0's auc: 0.933259	valid_0's binary_logloss: 0.280612	valid_1's auc: 0.908471	valid_1's binary_logloss: 0.316327
[75]	valid_0's auc: 0.933525	valid_0's binary_logloss: 0.280111	valid_1's auc: 0.908311	valid_1's binary_logloss: 0.31663
[76]	valid_0's auc: 0.933839	valid_0's binary_logloss: 0.279555	valid_1's auc: 0.908217	valid_1's binary_logloss: 0.316788
[77]	valid_0's auc: 0.934096	valid_0's binary_logloss: 0.279074	valid_1's auc: 0.908172	valid_1's binary_logloss: 0.316825
[78]	valid_0's auc: 0.934302	valid_0's binary_logloss: 0.278656	valid_1's auc: 0.908185	valid_1's binary_logloss: 0.316797
[79]	valid_0's auc: 0.934605	valid_0's binary_logloss: 0.278155	valid_1's auc: 0.908095	valid_1's binary_logloss: 0.316939
[80]	valid_0's auc: 0.934868	valid_0's binary_logloss: 0.2777	valid_1's auc: 0.908094	valid_1's binary_logloss: 0.31692
[81]	valid_0's auc: 0.935205	valid_0's binary_logloss: 0.277142	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.317311
[82]	valid_0's auc: 0.935573	valid_0's binary_logloss: 0.276519	valid_1's auc: 0.907832	valid_1's binary_logloss: 0.317418
[83]	valid_0's auc: 0.935848	valid_0's binary_logloss: 0.276	valid_1's auc: 0.907808	valid_1's binary_logloss: 0.317454
[84]	valid_0's auc: 0.936093	valid_0's binary_logloss: 0.275543	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317444
[85]	valid_0's auc: 0.936518	valid_0's binary_logloss: 0.274879	valid_1's auc: 0.907706	valid_1's binary_logloss: 0.317605
[86]	valid_0's auc: 0.936789	valid_0's binary_logloss: 0.274394	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.317734
[87]	valid_0's auc: 0.937064	valid_0's binary_logloss: 0.273916	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.317627
[88]	valid_0's auc: 0.937244	valid_0's binary_logloss: 0.273523	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.317594
[89]	valid_0's auc: 0.937531	valid_0's binary_logloss: 0.273051	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.317848
[90]	valid_0's auc: 0.937747	valid_0's binary_logloss: 0.27268	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.31802
[91]	valid_0's auc: 0.93796	valid_0's binary_logloss: 0.27231	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.318088
[92]	valid_0's auc: 0.938308	valid_0's binary_logloss: 0.27166	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.317964
[93]	valid_0's auc: 0.938491	valid_0's binary_logloss: 0.271333	valid_1's auc: 0.907391	valid_1's binary_logloss: 0.318083
[94]	valid_0's auc: 0.938708	valid_0's binary_logloss: 0.270911	valid_1's auc: 0.907417	valid_1's binary_logloss: 0.318069
[95]	valid_0's auc: 0.93896	valid_0's binary_logloss: 0.270452	valid_1's auc: 0.907262	valid_1's binary_logloss: 0.318298
[96]	valid_0's auc: 0.939215	valid_0's binary_logloss: 0.270028	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.31851
[97]	valid_0's auc: 0.939511	valid_0's binary_logloss: 0.269537	valid_1's auc: 0.907129	valid_1's binary_logloss: 0.318486
[98]	valid_0's auc: 0.939711	valid_0's binary_logloss: 0.269109	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.318631
[99]	valid_0's auc: 0.939877	valid_0's binary_logloss: 0.268782	valid_1's auc: 0.90712	valid_1's binary_logloss: 0.318655
[100]	valid_0's auc: 0.940203	valid_0's binary_logloss: 0.26826	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.318603
[101]	valid_0's auc: 0.940473	valid_0's binary_logloss: 0.267759	valid_1's auc: 0.907057	valid_1's binary_logloss: 0.318741
[102]	valid_0's auc: 0.94068	valid_0's binary_logloss: 0.26734	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.318793
[103]	valid_0's auc: 0.940889	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318898
[104]	valid_0's auc: 0.941221	valid_0's binary_logloss: 0.266407	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318846
[105]	valid_0's auc: 0.941404	valid_0's binary_logloss: 0.266017	valid_1's auc: 0.907056	valid_1's binary_logloss: 0.318935
[106]	valid_0's auc: 0.94172	valid_0's binary_logloss: 0.265442	valid_1's auc: 0.907087	valid_1's binary_logloss: 0.318935
[107]	valid_0's auc: 0.941968	valid_0's binary_logloss: 0.264992	valid_1's auc: 0.907021	valid_1's binary_logloss: 0.319017
[108]	valid_0's auc: 0.942233	valid_0's binary_logloss: 0.264478	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318989
[109]	valid_0's auc: 0.942493	valid_0's binary_logloss: 0.264019	valid_1's auc: 0.90694	valid_1's binary_logloss: 0.319175
[110]	valid_0's auc: 0.942704	valid_0's binary_logloss: 0.263649	valid_1's auc: 0.907	valid_1's binary_logloss: 0.319115
[111]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.263159	valid_1's auc: 0.90698	valid_1's binary_logloss: 0.319181
[112]	valid_0's auc: 0.943153	valid_0's binary_logloss: 0.26276	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.319242
[113]	valid_0's auc: 0.943292	valid_0's binary_logloss: 0.262487	valid_1's auc: 0.907006	valid_1's binary_logloss: 0.319192
[114]	valid_0's auc: 0.943514	valid_0's binary_logloss: 0.262081	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.319344
[115]	valid_0's auc: 0.943703	valid_0's binary_logloss: 0.26173	valid_1's auc: 0.906767	valid_1's binary_logloss: 0.319606
[116]	valid_0's auc: 0.943928	valid_0's binary_logloss: 0.261326	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.319582
[117]	valid_0's auc: 0.9443	valid_0's binary_logloss: 0.260724	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319615
[118]	valid_0's auc: 0.944467	valid_0's binary_logloss: 0.260414	valid_1's auc: 0.906726	valid_1's binary_logloss: 0.319779
[119]	valid_0's auc: 0.944721	valid_0's binary_logloss: 0.259961	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319723
[120]	valid_0's auc: 0.94495	valid_0's binary_logloss: 0.259572	valid_1's auc: 0.906774	valid_1's binary_logloss: 0.319723
[121]	valid_0's auc: 0.945156	valid_0's binary_logloss: 0.259202	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319684
[122]	valid_0's auc: 0.945388	valid_0's binary_logloss: 0.258753	valid_1's auc: 0.906637	valid_1's binary_logloss: 0.319998
[123]	valid_0's auc: 0.945604	valid_0's binary_logloss: 0.258362	valid_1's auc: 0.906691	valid_1's binary_logloss: 0.319913
[124]	valid_0's auc: 0.945776	valid_0's binary_logloss: 0.257989	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.319942
[125]	valid_0's auc: 0.945941	valid_0's binary_logloss: 0.257616	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.320049
[126]	valid_0's auc: 0.946164	valid_0's binary_logloss: 0.257224	valid_1's auc: 0.906722	valid_1's binary_logloss: 0.319953
[127]	valid_0's auc: 0.946305	valid_0's binary_logloss: 0.256913	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.320063
[128]	valid_0's auc: 0.946471	valid_0's binary_logloss: 0.256582	valid_1's auc: 0.90677	valid_1's binary_logloss: 0.319953
[129]	valid_0's auc: 0.946629	valid_0's binary_logloss: 0.256287	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319891
[130]	valid_0's auc: 0.946769	valid_0's binary_logloss: 0.255949	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.319876
[131]	valid_0's auc: 0.946967	valid_0's binary_logloss: 0.255553	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.31996
[132]	valid_0's auc: 0.94711	valid_0's binary_logloss: 0.255266	valid_1's auc: 0.906756	valid_1's binary_logloss: 0.320022
[133]	valid_0's auc: 0.94727	valid_0's binary_logloss: 0.254965	valid_1's auc: 0.906635	valid_1's binary_logloss: 0.320259
[134]	valid_0's auc: 0.947436	valid_0's binary_logloss: 0.254656	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320315
[135]	valid_0's auc: 0.947634	valid_0's binary_logloss: 0.254281	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.320372
[136]	valid_0's auc: 0.947862	valid_0's binary_logloss: 0.253863	valid_1's auc: 0.906526	valid_1's binary_logloss: 0.320517
[137]	valid_0's auc: 0.948008	valid_0's binary_logloss: 0.253584	valid_1's auc: 0.90645	valid_1's binary_logloss: 0.320689
[138]	valid_0's auc: 0.948111	valid_0's binary_logloss: 0.253372	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.320812
[139]	valid_0's auc: 0.948282	valid_0's binary_logloss: 0.253044	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.320767
[140]	valid_0's auc: 0.948441	valid_0's binary_logloss: 0.252704	valid_1's auc: 0.906341	valid_1's binary_logloss: 0.320941
[141]	valid_0's auc: 0.948609	valid_0's binary_logloss: 0.252346	valid_1's auc: 0.906316	valid_1's binary_logloss: 0.32098
Early stopping, best iteration is:
[41]	valid_0's auc: 0.922235	valid_0's binary_logloss: 0.301311	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.315801
[1]	valid_0's auc: 0.888084	valid_0's binary_logloss: 0.516884	valid_1's auc: 0.893464	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890797	valid_0's binary_logloss: 0.487718	valid_1's auc: 0.897592	valid_1's binary_logloss: 0.478465
[3]	valid_0's auc: 0.892513	valid_0's binary_logloss: 0.464334	valid_1's auc: 0.898665	valid_1's binary_logloss: 0.454805
[4]	valid_0's auc: 0.894815	valid_0's binary_logloss: 0.444821	valid_1's auc: 0.899433	valid_1's binary_logloss: 0.435394
[5]	valid_0's auc: 0.896021	valid_0's binary_logloss: 0.428702	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419476
[6]	valid_0's auc: 0.89928	valid_0's binary_logloss: 0.415058	valid_1's auc: 0.902649	valid_1's binary_logloss: 0.405991
[7]	valid_0's auc: 0.900439	valid_0's binary_logloss: 0.403201	valid_1's auc: 0.902605	valid_1's binary_logloss: 0.394544
[8]	valid_0's auc: 0.901538	valid_0's binary_logloss: 0.393166	valid_1's auc: 0.903058	valid_1's binary_logloss: 0.384843
[9]	valid_0's auc: 0.902204	valid_0's binary_logloss: 0.384401	valid_1's auc: 0.903156	valid_1's binary_logloss: 0.376624
[10]	valid_0's auc: 0.903221	valid_0's binary_logloss: 0.376758	valid_1's auc: 0.903175	valid_1's binary_logloss: 0.369696
[11]	valid_0's auc: 0.904073	valid_0's binary_logloss: 0.369858	valid_1's auc: 0.90337	valid_1's binary_logloss: 0.36353
[12]	valid_0's auc: 0.9048	valid_0's binary_logloss: 0.363903	valid_1's auc: 0.904	valid_1's binary_logloss: 0.357996
[13]	valid_0's auc: 0.905852	valid_0's binary_logloss: 0.358528	valid_1's auc: 0.904463	valid_1's binary_logloss: 0.353176
[14]	valid_0's auc: 0.906544	valid_0's binary_logloss: 0.353777	valid_1's auc: 0.904775	valid_1's binary_logloss: 0.348981
[15]	valid_0's auc: 0.907501	valid_0's binary_logloss: 0.349288	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.345392
[16]	valid_0's auc: 0.908224	valid_0's binary_logloss: 0.345361	valid_1's auc: 0.905819	valid_1's binary_logloss: 0.341971
[17]	valid_0's auc: 0.908902	valid_0's binary_logloss: 0.341809	valid_1's auc: 0.905831	valid_1's binary_logloss: 0.339271
[18]	valid_0's auc: 0.909407	valid_0's binary_logloss: 0.338728	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.336615
[19]	valid_0's auc: 0.910331	valid_0's binary_logloss: 0.33564	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.334456
[20]	valid_0's auc: 0.910901	valid_0's binary_logloss: 0.332967	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.332309
[21]	valid_0's auc: 0.911538	valid_0's binary_logloss: 0.330566	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.330669
[22]	valid_0's auc: 0.912064	valid_0's binary_logloss: 0.328361	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.329121
[23]	valid_0's auc: 0.912925	valid_0's binary_logloss: 0.326059	valid_1's auc: 0.907201	valid_1's binary_logloss: 0.327725
[24]	valid_0's auc: 0.913563	valid_0's binary_logloss: 0.323897	valid_1's auc: 0.907387	valid_1's binary_logloss: 0.326225
[25]	valid_0's auc: 0.914114	valid_0's binary_logloss: 0.321942	valid_1's auc: 0.907471	valid_1's binary_logloss: 0.325043
[26]	valid_0's auc: 0.914789	valid_0's binary_logloss: 0.320035	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.323938
[27]	valid_0's auc: 0.915302	valid_0's binary_logloss: 0.318381	valid_1's auc: 0.907778	valid_1's binary_logloss: 0.323077
[28]	valid_0's auc: 0.915886	valid_0's binary_logloss: 0.316789	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.322489
[29]	valid_0's auc: 0.916429	valid_0's binary_logloss: 0.315265	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.321873
[30]	valid_0's auc: 0.916928	valid_0's binary_logloss: 0.31387	valid_1's auc: 0.907806	valid_1's binary_logloss: 0.321352
[31]	valid_0's auc: 0.917511	valid_0's binary_logloss: 0.312381	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.320895
[32]	valid_0's auc: 0.918015	valid_0's binary_logloss: 0.311145	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.32053
[33]	valid_0's auc: 0.91845	valid_0's binary_logloss: 0.310021	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.320356
[34]	valid_0's auc: 0.918921	valid_0's binary_logloss: 0.308899	valid_1's auc: 0.907826	valid_1's binary_logloss: 0.319775
[35]	valid_0's auc: 0.919308	valid_0's binary_logloss: 0.307855	valid_1's auc: 0.907768	valid_1's binary_logloss: 0.319476
[36]	valid_0's auc: 0.919805	valid_0's binary_logloss: 0.306715	valid_1's auc: 0.907844	valid_1's binary_logloss: 0.319122
[37]	valid_0's auc: 0.920348	valid_0's binary_logloss: 0.305579	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.318737
[38]	valid_0's auc: 0.920807	valid_0's binary_logloss: 0.304555	valid_1's auc: 0.907838	valid_1's binary_logloss: 0.318784
[39]	valid_0's auc: 0.921262	valid_0's binary_logloss: 0.303578	valid_1's auc: 0.907678	valid_1's binary_logloss: 0.318757
[40]	valid_0's auc: 0.921707	valid_0's binary_logloss: 0.302588	valid_1's auc: 0.907596	valid_1's binary_logloss: 0.318667
[41]	valid_0's auc: 0.922114	valid_0's binary_logloss: 0.301688	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.318239
[42]	valid_0's auc: 0.922529	valid_0's binary_logloss: 0.300838	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.318064
[43]	valid_0's auc: 0.922985	valid_0's binary_logloss: 0.299924	valid_1's auc: 0.90801	valid_1's binary_logloss: 0.317775
[44]	valid_0's auc: 0.923383	valid_0's binary_logloss: 0.299092	valid_1's auc: 0.908013	valid_1's binary_logloss: 0.317723
[45]	valid_0's auc: 0.923914	valid_0's binary_logloss: 0.298119	valid_1's auc: 0.907991	valid_1's binary_logloss: 0.317657
[46]	valid_0's auc: 0.924386	valid_0's binary_logloss: 0.297212	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.317781
[47]	valid_0's auc: 0.924774	valid_0's binary_logloss: 0.296431	valid_1's auc: 0.907865	valid_1's binary_logloss: 0.317707
[48]	valid_0's auc: 0.925146	valid_0's binary_logloss: 0.295696	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.31754
[49]	valid_0's auc: 0.925516	valid_0's binary_logloss: 0.294958	valid_1's auc: 0.907873	valid_1's binary_logloss: 0.317542
[50]	valid_0's auc: 0.925986	valid_0's binary_logloss: 0.294127	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.317515
[51]	valid_0's auc: 0.926312	valid_0's binary_logloss: 0.293523	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317471
[52]	valid_0's auc: 0.926741	valid_0's binary_logloss: 0.292742	valid_1's auc: 0.907799	valid_1's binary_logloss: 0.31751
[53]	valid_0's auc: 0.927092	valid_0's binary_logloss: 0.292078	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.317638
[54]	valid_0's auc: 0.92744	valid_0's binary_logloss: 0.291451	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.317642
[55]	valid_0's auc: 0.927765	valid_0's binary_logloss: 0.290866	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.317705
[56]	valid_0's auc: 0.928254	valid_0's binary_logloss: 0.289972	valid_1's auc: 0.907724	valid_1's binary_logloss: 0.31762
[57]	valid_0's auc: 0.928572	valid_0's binary_logloss: 0.289325	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.317749
[58]	valid_0's auc: 0.928965	valid_0's binary_logloss: 0.288633	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.317919
[59]	valid_0's auc: 0.929368	valid_0's binary_logloss: 0.287956	valid_1's auc: 0.907475	valid_1's binary_logloss: 0.318008
[60]	valid_0's auc: 0.929704	valid_0's binary_logloss: 0.287329	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.317828
[61]	valid_0's auc: 0.930026	valid_0's binary_logloss: 0.286738	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.317995
[62]	valid_0's auc: 0.930409	valid_0's binary_logloss: 0.286062	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.317841
[63]	valid_0's auc: 0.930686	valid_0's binary_logloss: 0.285488	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.318049
[64]	valid_0's auc: 0.931059	valid_0's binary_logloss: 0.284877	valid_1's auc: 0.907311	valid_1's binary_logloss: 0.318123
[65]	valid_0's auc: 0.931373	valid_0's binary_logloss: 0.284345	valid_1's auc: 0.907205	valid_1's binary_logloss: 0.318273
[66]	valid_0's auc: 0.93178	valid_0's binary_logloss: 0.283652	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.318418
[67]	valid_0's auc: 0.932046	valid_0's binary_logloss: 0.283191	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.318417
[68]	valid_0's auc: 0.93229	valid_0's binary_logloss: 0.282725	valid_1's auc: 0.907069	valid_1's binary_logloss: 0.318517
[69]	valid_0's auc: 0.932661	valid_0's binary_logloss: 0.282121	valid_1's auc: 0.906982	valid_1's binary_logloss: 0.318625
[70]	valid_0's auc: 0.932897	valid_0's binary_logloss: 0.28165	valid_1's auc: 0.906921	valid_1's binary_logloss: 0.318681
[71]	valid_0's auc: 0.933215	valid_0's binary_logloss: 0.281043	valid_1's auc: 0.906813	valid_1's binary_logloss: 0.318939
[72]	valid_0's auc: 0.933442	valid_0's binary_logloss: 0.280642	valid_1's auc: 0.906759	valid_1's binary_logloss: 0.319031
[73]	valid_0's auc: 0.933735	valid_0's binary_logloss: 0.280128	valid_1's auc: 0.906549	valid_1's binary_logloss: 0.319396
[74]	valid_0's auc: 0.934121	valid_0's binary_logloss: 0.279416	valid_1's auc: 0.90652	valid_1's binary_logloss: 0.319441
[75]	valid_0's auc: 0.934286	valid_0's binary_logloss: 0.279035	valid_1's auc: 0.906406	valid_1's binary_logloss: 0.319626
[76]	valid_0's auc: 0.934571	valid_0's binary_logloss: 0.278551	valid_1's auc: 0.906384	valid_1's binary_logloss: 0.319644
[77]	valid_0's auc: 0.934872	valid_0's binary_logloss: 0.278005	valid_1's auc: 0.906309	valid_1's binary_logloss: 0.31982
[78]	valid_0's auc: 0.935121	valid_0's binary_logloss: 0.277536	valid_1's auc: 0.906198	valid_1's binary_logloss: 0.319929
[79]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.27698	valid_1's auc: 0.906197	valid_1's binary_logloss: 0.319938
[80]	valid_0's auc: 0.935736	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906125	valid_1's binary_logloss: 0.320044
[81]	valid_0's auc: 0.935994	valid_0's binary_logloss: 0.275992	valid_1's auc: 0.906202	valid_1's binary_logloss: 0.319931
[82]	valid_0's auc: 0.936332	valid_0's binary_logloss: 0.275423	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.32006
[83]	valid_0's auc: 0.93661	valid_0's binary_logloss: 0.274908	valid_1's auc: 0.906093	valid_1's binary_logloss: 0.320157
[84]	valid_0's auc: 0.936918	valid_0's binary_logloss: 0.274391	valid_1's auc: 0.906084	valid_1's binary_logloss: 0.32019
[85]	valid_0's auc: 0.937157	valid_0's binary_logloss: 0.273987	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.320301
[86]	valid_0's auc: 0.937427	valid_0's binary_logloss: 0.273487	valid_1's auc: 0.905973	valid_1's binary_logloss: 0.320477
[87]	valid_0's auc: 0.937686	valid_0's binary_logloss: 0.273034	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.320618
[88]	valid_0's auc: 0.937927	valid_0's binary_logloss: 0.272593	valid_1's auc: 0.905753	valid_1's binary_logloss: 0.320851
[89]	valid_0's auc: 0.938121	valid_0's binary_logloss: 0.272211	valid_1's auc: 0.9058	valid_1's binary_logloss: 0.32079
[90]	valid_0's auc: 0.938374	valid_0's binary_logloss: 0.271677	valid_1's auc: 0.905795	valid_1's binary_logloss: 0.320808
[91]	valid_0's auc: 0.938642	valid_0's binary_logloss: 0.271239	valid_1's auc: 0.905674	valid_1's binary_logloss: 0.320997
[92]	valid_0's auc: 0.938869	valid_0's binary_logloss: 0.270838	valid_1's auc: 0.905626	valid_1's binary_logloss: 0.321081
[93]	valid_0's auc: 0.939017	valid_0's binary_logloss: 0.27051	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.321254
[94]	valid_0's auc: 0.939224	valid_0's binary_logloss: 0.270118	valid_1's auc: 0.905512	valid_1's binary_logloss: 0.321339
[95]	valid_0's auc: 0.939487	valid_0's binary_logloss: 0.269626	valid_1's auc: 0.905456	valid_1's binary_logloss: 0.321446
[96]	valid_0's auc: 0.939772	valid_0's binary_logloss: 0.269136	valid_1's auc: 0.905287	valid_1's binary_logloss: 0.321739
[97]	valid_0's auc: 0.940057	valid_0's binary_logloss: 0.268626	valid_1's auc: 0.905276	valid_1's binary_logloss: 0.32172
[98]	valid_0's auc: 0.940303	valid_0's binary_logloss: 0.268187	valid_1's auc: 0.905272	valid_1's binary_logloss: 0.321755
[99]	valid_0's auc: 0.940646	valid_0's binary_logloss: 0.267627	valid_1's auc: 0.905326	valid_1's binary_logloss: 0.321717
[100]	valid_0's auc: 0.940866	valid_0's binary_logloss: 0.267178	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.321552
[101]	valid_0's auc: 0.94118	valid_0's binary_logloss: 0.266647	valid_1's auc: 0.905366	valid_1's binary_logloss: 0.321575
[102]	valid_0's auc: 0.941385	valid_0's binary_logloss: 0.266276	valid_1's auc: 0.905295	valid_1's binary_logloss: 0.321719
[103]	valid_0's auc: 0.941591	valid_0's binary_logloss: 0.265882	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.32166
[104]	valid_0's auc: 0.941799	valid_0's binary_logloss: 0.265525	valid_1's auc: 0.905273	valid_1's binary_logloss: 0.321774
[105]	valid_0's auc: 0.941984	valid_0's binary_logloss: 0.265135	valid_1's auc: 0.905316	valid_1's binary_logloss: 0.321763
[106]	valid_0's auc: 0.942268	valid_0's binary_logloss: 0.26461	valid_1's auc: 0.905197	valid_1's binary_logloss: 0.321978
[107]	valid_0's auc: 0.942423	valid_0's binary_logloss: 0.264314	valid_1's auc: 0.905196	valid_1's binary_logloss: 0.322006
[108]	valid_0's auc: 0.942738	valid_0's binary_logloss: 0.263759	valid_1's auc: 0.905116	valid_1's binary_logloss: 0.322149
[109]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.263324	valid_1's auc: 0.905093	valid_1's binary_logloss: 0.322222
[110]	valid_0's auc: 0.94321	valid_0's binary_logloss: 0.262951	valid_1's auc: 0.905121	valid_1's binary_logloss: 0.322178
[111]	valid_0's auc: 0.943496	valid_0's binary_logloss: 0.262434	valid_1's auc: 0.905101	valid_1's binary_logloss: 0.322251
[112]	valid_0's auc: 0.943833	valid_0's binary_logloss: 0.261863	valid_1's auc: 0.904996	valid_1's binary_logloss: 0.322391
[113]	valid_0's auc: 0.944024	valid_0's binary_logloss: 0.261477	valid_1's auc: 0.905072	valid_1's binary_logloss: 0.322374
[114]	valid_0's auc: 0.944213	valid_0's binary_logloss: 0.261103	valid_1's auc: 0.905104	valid_1's binary_logloss: 0.322346
[115]	valid_0's auc: 0.944441	valid_0's binary_logloss: 0.260692	valid_1's auc: 0.904965	valid_1's binary_logloss: 0.322578
[116]	valid_0's auc: 0.944635	valid_0's binary_logloss: 0.260368	valid_1's auc: 0.904897	valid_1's binary_logloss: 0.322684
[117]	valid_0's auc: 0.944822	valid_0's binary_logloss: 0.260024	valid_1's auc: 0.904693	valid_1's binary_logloss: 0.32304
[118]	valid_0's auc: 0.94511	valid_0's binary_logloss: 0.259545	valid_1's auc: 0.904656	valid_1's binary_logloss: 0.323144
[119]	valid_0's auc: 0.945296	valid_0's binary_logloss: 0.259149	valid_1's auc: 0.904637	valid_1's binary_logloss: 0.323225
[120]	valid_0's auc: 0.945504	valid_0's binary_logloss: 0.258721	valid_1's auc: 0.904586	valid_1's binary_logloss: 0.323283
[121]	valid_0's auc: 0.945664	valid_0's binary_logloss: 0.258406	valid_1's auc: 0.90457	valid_1's binary_logloss: 0.323327
[122]	valid_0's auc: 0.945844	valid_0's binary_logloss: 0.258001	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.323297
[123]	valid_0's auc: 0.946026	valid_0's binary_logloss: 0.257642	valid_1's auc: 0.90448	valid_1's binary_logloss: 0.323506
[124]	valid_0's auc: 0.946178	valid_0's binary_logloss: 0.257327	valid_1's auc: 0.904384	valid_1's binary_logloss: 0.323677
[125]	valid_0's auc: 0.946454	valid_0's binary_logloss: 0.256798	valid_1's auc: 0.904343	valid_1's binary_logloss: 0.32372
[126]	valid_0's auc: 0.946645	valid_0's binary_logloss: 0.256452	valid_1's auc: 0.904353	valid_1's binary_logloss: 0.323738
[127]	valid_0's auc: 0.946915	valid_0's binary_logloss: 0.25596	valid_1's auc: 0.904306	valid_1's binary_logloss: 0.323896
[128]	valid_0's auc: 0.947109	valid_0's binary_logloss: 0.255575	valid_1's auc: 0.904257	valid_1's binary_logloss: 0.324053
[129]	valid_0's auc: 0.947273	valid_0's binary_logloss: 0.255248	valid_1's auc: 0.90423	valid_1's binary_logloss: 0.324141
[130]	valid_0's auc: 0.947437	valid_0's binary_logloss: 0.25488	valid_1's auc: 0.90411	valid_1's binary_logloss: 0.324374
[131]	valid_0's auc: 0.947704	valid_0's binary_logloss: 0.254389	valid_1's auc: 0.904066	valid_1's binary_logloss: 0.324481
[132]	valid_0's auc: 0.947846	valid_0's binary_logloss: 0.254059	valid_1's auc: 0.904112	valid_1's binary_logloss: 0.324459
[133]	valid_0's auc: 0.947957	valid_0's binary_logloss: 0.253808	valid_1's auc: 0.904132	valid_1's binary_logloss: 0.324486
[134]	valid_0's auc: 0.948119	valid_0's binary_logloss: 0.253478	valid_1's auc: 0.904051	valid_1's binary_logloss: 0.324637
[135]	valid_0's auc: 0.948283	valid_0's binary_logloss: 0.253139	valid_1's auc: 0.904051	valid_1's binary_logloss: 0.324667
[136]	valid_0's auc: 0.948502	valid_0's binary_logloss: 0.252718	valid_1's auc: 0.903951	valid_1's binary_logloss: 0.324845
[137]	valid_0's auc: 0.948681	valid_0's binary_logloss: 0.252377	valid_1's auc: 0.904	valid_1's binary_logloss: 0.324791
Early stopping, best iteration is:
[37]	valid_0's auc: 0.920348	valid_0's binary_logloss: 0.305579	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.318737
[1]	valid_0's auc: 0.889368	valid_0's binary_logloss: 0.516586	valid_1's auc: 0.894755	valid_1's binary_logloss: 0.507927
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892369	valid_0's binary_logloss: 0.487665	valid_1's auc: 0.897729	valid_1's binary_logloss: 0.478425
[3]	valid_0's auc: 0.892766	valid_0's binary_logloss: 0.46459	valid_1's auc: 0.8987	valid_1's binary_logloss: 0.454891
[4]	valid_0's auc: 0.894658	valid_0's binary_logloss: 0.445432	valid_1's auc: 0.899309	valid_1's binary_logloss: 0.435927
[5]	valid_0's auc: 0.897216	valid_0's binary_logloss: 0.429343	valid_1's auc: 0.901673	valid_1's binary_logloss: 0.420055
[6]	valid_0's auc: 0.898836	valid_0's binary_logloss: 0.415681	valid_1's auc: 0.902175	valid_1's binary_logloss: 0.40664
[7]	valid_0's auc: 0.900089	valid_0's binary_logloss: 0.403962	valid_1's auc: 0.903133	valid_1's binary_logloss: 0.394925
[8]	valid_0's auc: 0.900532	valid_0's binary_logloss: 0.393959	valid_1's auc: 0.903189	valid_1's binary_logloss: 0.38526
[9]	valid_0's auc: 0.90162	valid_0's binary_logloss: 0.385233	valid_1's auc: 0.903527	valid_1's binary_logloss: 0.376973
[10]	valid_0's auc: 0.902597	valid_0's binary_logloss: 0.377488	valid_1's auc: 0.904084	valid_1's binary_logloss: 0.369513
[11]	valid_0's auc: 0.903448	valid_0's binary_logloss: 0.370593	valid_1's auc: 0.904405	valid_1's binary_logloss: 0.363339
[12]	valid_0's auc: 0.904159	valid_0's binary_logloss: 0.364575	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.357511
[13]	valid_0's auc: 0.905188	valid_0's binary_logloss: 0.359049	valid_1's auc: 0.90489	valid_1's binary_logloss: 0.352976
[14]	valid_0's auc: 0.906232	valid_0's binary_logloss: 0.354214	valid_1's auc: 0.905694	valid_1's binary_logloss: 0.348766
[15]	valid_0's auc: 0.907064	valid_0's binary_logloss: 0.349752	valid_1's auc: 0.906	valid_1's binary_logloss: 0.345008
[16]	valid_0's auc: 0.907672	valid_0's binary_logloss: 0.345873	valid_1's auc: 0.906296	valid_1's binary_logloss: 0.341642
[17]	valid_0's auc: 0.908271	valid_0's binary_logloss: 0.342309	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.338823
[18]	valid_0's auc: 0.908856	valid_0's binary_logloss: 0.339122	valid_1's auc: 0.906701	valid_1's binary_logloss: 0.336075
[19]	valid_0's auc: 0.909543	valid_0's binary_logloss: 0.336192	valid_1's auc: 0.906874	valid_1's binary_logloss: 0.333942
[20]	valid_0's auc: 0.910416	valid_0's binary_logloss: 0.333478	valid_1's auc: 0.906872	valid_1's binary_logloss: 0.332148
[21]	valid_0's auc: 0.91127	valid_0's binary_logloss: 0.330816	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.330312
[22]	valid_0's auc: 0.912058	valid_0's binary_logloss: 0.328411	valid_1's auc: 0.907372	valid_1's binary_logloss: 0.328658
[23]	valid_0's auc: 0.912907	valid_0's binary_logloss: 0.326138	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.327096
[24]	valid_0's auc: 0.913473	valid_0's binary_logloss: 0.324164	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.326288
[25]	valid_0's auc: 0.914108	valid_0's binary_logloss: 0.322166	valid_1's auc: 0.907385	valid_1's binary_logloss: 0.32546
[26]	valid_0's auc: 0.914696	valid_0's binary_logloss: 0.320381	valid_1's auc: 0.907403	valid_1's binary_logloss: 0.324472
[27]	valid_0's auc: 0.915158	valid_0's binary_logloss: 0.318795	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.32357
[28]	valid_0's auc: 0.91573	valid_0's binary_logloss: 0.317165	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.322983
[29]	valid_0's auc: 0.916189	valid_0's binary_logloss: 0.315738	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.322455
[30]	valid_0's auc: 0.916727	valid_0's binary_logloss: 0.314301	valid_1's auc: 0.907422	valid_1's binary_logloss: 0.321875
[31]	valid_0's auc: 0.917217	valid_0's binary_logloss: 0.312989	valid_1's auc: 0.907551	valid_1's binary_logloss: 0.32122
[32]	valid_0's auc: 0.917797	valid_0's binary_logloss: 0.311606	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.320726
[33]	valid_0's auc: 0.918274	valid_0's binary_logloss: 0.310392	valid_1's auc: 0.907869	valid_1's binary_logloss: 0.320007
[34]	valid_0's auc: 0.918693	valid_0's binary_logloss: 0.309224	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.319938
[35]	valid_0's auc: 0.919148	valid_0's binary_logloss: 0.308196	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.319657
[36]	valid_0's auc: 0.919629	valid_0's binary_logloss: 0.307029	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.319287
[37]	valid_0's auc: 0.920158	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.908025	valid_1's binary_logloss: 0.318715
[38]	valid_0's auc: 0.920674	valid_0's binary_logloss: 0.304723	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.318922
[39]	valid_0's auc: 0.921239	valid_0's binary_logloss: 0.303593	valid_1's auc: 0.907878	valid_1's binary_logloss: 0.318525
[40]	valid_0's auc: 0.921706	valid_0's binary_logloss: 0.302626	valid_1's auc: 0.907802	valid_1's binary_logloss: 0.318457
[41]	valid_0's auc: 0.922045	valid_0's binary_logloss: 0.301855	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.318334
[42]	valid_0's auc: 0.922468	valid_0's binary_logloss: 0.300998	valid_1's auc: 0.907744	valid_1's binary_logloss: 0.318211
[43]	valid_0's auc: 0.922945	valid_0's binary_logloss: 0.300015	valid_1's auc: 0.90774	valid_1's binary_logloss: 0.318093
[44]	valid_0's auc: 0.923477	valid_0's binary_logloss: 0.299056	valid_1's auc: 0.907786	valid_1's binary_logloss: 0.317972
[45]	valid_0's auc: 0.923964	valid_0's binary_logloss: 0.298128	valid_1's auc: 0.907558	valid_1's binary_logloss: 0.318191
[46]	valid_0's auc: 0.924329	valid_0's binary_logloss: 0.297415	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.318185
[47]	valid_0's auc: 0.924714	valid_0's binary_logloss: 0.296685	valid_1's auc: 0.907595	valid_1's binary_logloss: 0.318006
[48]	valid_0's auc: 0.925165	valid_0's binary_logloss: 0.295875	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.31824
[49]	valid_0's auc: 0.925591	valid_0's binary_logloss: 0.295065	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.318089
[50]	valid_0's auc: 0.926003	valid_0's binary_logloss: 0.294311	valid_1's auc: 0.90743	valid_1's binary_logloss: 0.318114
[51]	valid_0's auc: 0.926309	valid_0's binary_logloss: 0.293756	valid_1's auc: 0.907375	valid_1's binary_logloss: 0.318176
[52]	valid_0's auc: 0.926581	valid_0's binary_logloss: 0.293181	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.318236
[53]	valid_0's auc: 0.926944	valid_0's binary_logloss: 0.292552	valid_1's auc: 0.907206	valid_1's binary_logloss: 0.318333
[54]	valid_0's auc: 0.927379	valid_0's binary_logloss: 0.291721	valid_1's auc: 0.907175	valid_1's binary_logloss: 0.31834
[55]	valid_0's auc: 0.92778	valid_0's binary_logloss: 0.290938	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.318328
[56]	valid_0's auc: 0.928268	valid_0's binary_logloss: 0.290128	valid_1's auc: 0.907274	valid_1's binary_logloss: 0.318221
[57]	valid_0's auc: 0.928602	valid_0's binary_logloss: 0.289473	valid_1's auc: 0.90711	valid_1's binary_logloss: 0.318429
[58]	valid_0's auc: 0.928945	valid_0's binary_logloss: 0.288826	valid_1's auc: 0.907094	valid_1's binary_logloss: 0.318435
[59]	valid_0's auc: 0.929299	valid_0's binary_logloss: 0.288133	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.31856
[60]	valid_0's auc: 0.929594	valid_0's binary_logloss: 0.287577	valid_1's auc: 0.906921	valid_1's binary_logloss: 0.318777
[61]	valid_0's auc: 0.929936	valid_0's binary_logloss: 0.286981	valid_1's auc: 0.906934	valid_1's binary_logloss: 0.318758
[62]	valid_0's auc: 0.930341	valid_0's binary_logloss: 0.286294	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.318671
[63]	valid_0's auc: 0.930701	valid_0's binary_logloss: 0.28571	valid_1's auc: 0.906845	valid_1's binary_logloss: 0.318827
[64]	valid_0's auc: 0.931027	valid_0's binary_logloss: 0.285194	valid_1's auc: 0.907008	valid_1's binary_logloss: 0.318618
[65]	valid_0's auc: 0.93137	valid_0's binary_logloss: 0.284569	valid_1's auc: 0.906978	valid_1's binary_logloss: 0.318649
[66]	valid_0's auc: 0.93171	valid_0's binary_logloss: 0.28403	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.318746
[67]	valid_0's auc: 0.93215	valid_0's binary_logloss: 0.283252	valid_1's auc: 0.906974	valid_1's binary_logloss: 0.318687
[68]	valid_0's auc: 0.932576	valid_0's binary_logloss: 0.282564	valid_1's auc: 0.907068	valid_1's binary_logloss: 0.31854
[69]	valid_0's auc: 0.932778	valid_0's binary_logloss: 0.282152	valid_1's auc: 0.906998	valid_1's binary_logloss: 0.318608
[70]	valid_0's auc: 0.933085	valid_0's binary_logloss: 0.281627	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.318669
[71]	valid_0's auc: 0.933325	valid_0's binary_logloss: 0.281227	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318785
[72]	valid_0's auc: 0.933634	valid_0's binary_logloss: 0.280704	valid_1's auc: 0.906882	valid_1's binary_logloss: 0.318808
[73]	valid_0's auc: 0.933952	valid_0's binary_logloss: 0.280094	valid_1's auc: 0.906972	valid_1's binary_logloss: 0.318713
[74]	valid_0's auc: 0.934222	valid_0's binary_logloss: 0.279644	valid_1's auc: 0.906952	valid_1's binary_logloss: 0.318799
[75]	valid_0's auc: 0.934557	valid_0's binary_logloss: 0.279044	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.318774
[76]	valid_0's auc: 0.934883	valid_0's binary_logloss: 0.278441	valid_1's auc: 0.906946	valid_1's binary_logloss: 0.318828
[77]	valid_0's auc: 0.935142	valid_0's binary_logloss: 0.277971	valid_1's auc: 0.906915	valid_1's binary_logloss: 0.318898
[78]	valid_0's auc: 0.93547	valid_0's binary_logloss: 0.277388	valid_1's auc: 0.906852	valid_1's binary_logloss: 0.319009
[79]	valid_0's auc: 0.935717	valid_0's binary_logloss: 0.276937	valid_1's auc: 0.906777	valid_1's binary_logloss: 0.31913
[80]	valid_0's auc: 0.936009	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319077
[81]	valid_0's auc: 0.936198	valid_0's binary_logloss: 0.275991	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319142
[82]	valid_0's auc: 0.936431	valid_0's binary_logloss: 0.275586	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319203
[83]	valid_0's auc: 0.936679	valid_0's binary_logloss: 0.275138	valid_1's auc: 0.906844	valid_1's binary_logloss: 0.319048
[84]	valid_0's auc: 0.936859	valid_0's binary_logloss: 0.274783	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.319184
[85]	valid_0's auc: 0.937212	valid_0's binary_logloss: 0.274225	valid_1's auc: 0.906784	valid_1's binary_logloss: 0.319198
[86]	valid_0's auc: 0.937396	valid_0's binary_logloss: 0.273909	valid_1's auc: 0.906694	valid_1's binary_logloss: 0.319329
[87]	valid_0's auc: 0.937538	valid_0's binary_logloss: 0.273597	valid_1's auc: 0.906589	valid_1's binary_logloss: 0.319518
[88]	valid_0's auc: 0.937806	valid_0's binary_logloss: 0.273111	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.319743
[89]	valid_0's auc: 0.938039	valid_0's binary_logloss: 0.272705	valid_1's auc: 0.906481	valid_1's binary_logloss: 0.319789
[90]	valid_0's auc: 0.938327	valid_0's binary_logloss: 0.272167	valid_1's auc: 0.906613	valid_1's binary_logloss: 0.319544
[91]	valid_0's auc: 0.938599	valid_0's binary_logloss: 0.271706	valid_1's auc: 0.906555	valid_1's binary_logloss: 0.319683
[92]	valid_0's auc: 0.938844	valid_0's binary_logloss: 0.271234	valid_1's auc: 0.90654	valid_1's binary_logloss: 0.319728
[93]	valid_0's auc: 0.939121	valid_0's binary_logloss: 0.270696	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.319837
[94]	valid_0's auc: 0.939311	valid_0's binary_logloss: 0.270377	valid_1's auc: 0.906368	valid_1's binary_logloss: 0.320008
[95]	valid_0's auc: 0.939657	valid_0's binary_logloss: 0.26978	valid_1's auc: 0.906359	valid_1's binary_logloss: 0.320036
[96]	valid_0's auc: 0.939933	valid_0's binary_logloss: 0.269328	valid_1's auc: 0.906318	valid_1's binary_logloss: 0.320097
[97]	valid_0's auc: 0.940166	valid_0's binary_logloss: 0.268916	valid_1's auc: 0.906173	valid_1's binary_logloss: 0.320362
[98]	valid_0's auc: 0.940413	valid_0's binary_logloss: 0.268496	valid_1's auc: 0.906144	valid_1's binary_logloss: 0.32044
[99]	valid_0's auc: 0.940628	valid_0's binary_logloss: 0.268094	valid_1's auc: 0.906022	valid_1's binary_logloss: 0.320614
[100]	valid_0's auc: 0.94077	valid_0's binary_logloss: 0.267774	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.320727
[101]	valid_0's auc: 0.94096	valid_0's binary_logloss: 0.267447	valid_1's auc: 0.90588	valid_1's binary_logloss: 0.320857
[102]	valid_0's auc: 0.941258	valid_0's binary_logloss: 0.266905	valid_1's auc: 0.90597	valid_1's binary_logloss: 0.320784
[103]	valid_0's auc: 0.941404	valid_0's binary_logloss: 0.266627	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320962
[104]	valid_0's auc: 0.94156	valid_0's binary_logloss: 0.26628	valid_1's auc: 0.905887	valid_1's binary_logloss: 0.320925
[105]	valid_0's auc: 0.941895	valid_0's binary_logloss: 0.265711	valid_1's auc: 0.905826	valid_1's binary_logloss: 0.321047
[106]	valid_0's auc: 0.94212	valid_0's binary_logloss: 0.265292	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321147
[107]	valid_0's auc: 0.942351	valid_0's binary_logloss: 0.264829	valid_1's auc: 0.90572	valid_1's binary_logloss: 0.321204
[108]	valid_0's auc: 0.942527	valid_0's binary_logloss: 0.264476	valid_1's auc: 0.905697	valid_1's binary_logloss: 0.32131
[109]	valid_0's auc: 0.94265	valid_0's binary_logloss: 0.264188	valid_1's auc: 0.905669	valid_1's binary_logloss: 0.321424
[110]	valid_0's auc: 0.942938	valid_0's binary_logloss: 0.263728	valid_1's auc: 0.905559	valid_1's binary_logloss: 0.32161
[111]	valid_0's auc: 0.943184	valid_0's binary_logloss: 0.263289	valid_1's auc: 0.905523	valid_1's binary_logloss: 0.321687
[112]	valid_0's auc: 0.943352	valid_0's binary_logloss: 0.262989	valid_1's auc: 0.905508	valid_1's binary_logloss: 0.321697
[113]	valid_0's auc: 0.943656	valid_0's binary_logloss: 0.262433	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.321894
[114]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.26202	valid_1's auc: 0.905393	valid_1's binary_logloss: 0.321994
[115]	valid_0's auc: 0.944119	valid_0's binary_logloss: 0.261566	valid_1's auc: 0.905339	valid_1's binary_logloss: 0.322064
[116]	valid_0's auc: 0.944369	valid_0's binary_logloss: 0.261098	valid_1's auc: 0.90529	valid_1's binary_logloss: 0.322207
[117]	valid_0's auc: 0.944572	valid_0's binary_logloss: 0.260704	valid_1's auc: 0.905309	valid_1's binary_logloss: 0.322161
[118]	valid_0's auc: 0.944924	valid_0's binary_logloss: 0.260097	valid_1's auc: 0.905288	valid_1's binary_logloss: 0.322143
[119]	valid_0's auc: 0.945099	valid_0's binary_logloss: 0.259768	valid_1's auc: 0.90523	valid_1's binary_logloss: 0.322276
[120]	valid_0's auc: 0.945306	valid_0's binary_logloss: 0.259357	valid_1's auc: 0.905203	valid_1's binary_logloss: 0.322354
[121]	valid_0's auc: 0.945487	valid_0's binary_logloss: 0.25896	valid_1's auc: 0.905123	valid_1's binary_logloss: 0.32252
[122]	valid_0's auc: 0.945649	valid_0's binary_logloss: 0.258639	valid_1's auc: 0.905076	valid_1's binary_logloss: 0.322578
[123]	valid_0's auc: 0.945922	valid_0's binary_logloss: 0.258143	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.322731
[124]	valid_0's auc: 0.946047	valid_0's binary_logloss: 0.257895	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.32298
[125]	valid_0's auc: 0.946249	valid_0's binary_logloss: 0.25751	valid_1's auc: 0.904847	valid_1's binary_logloss: 0.323002
[126]	valid_0's auc: 0.946452	valid_0's binary_logloss: 0.257121	valid_1's auc: 0.904875	valid_1's binary_logloss: 0.323026
[127]	valid_0's auc: 0.94668	valid_0's binary_logloss: 0.256726	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.32304
[128]	valid_0's auc: 0.946935	valid_0's binary_logloss: 0.256281	valid_1's auc: 0.904816	valid_1's binary_logloss: 0.323196
[129]	valid_0's auc: 0.947147	valid_0's binary_logloss: 0.2559	valid_1's auc: 0.904844	valid_1's binary_logloss: 0.32313
[130]	valid_0's auc: 0.94747	valid_0's binary_logloss: 0.255357	valid_1's auc: 0.904834	valid_1's binary_logloss: 0.323239
[131]	valid_0's auc: 0.947605	valid_0's binary_logloss: 0.255058	valid_1's auc: 0.904737	valid_1's binary_logloss: 0.323445
[132]	valid_0's auc: 0.947859	valid_0's binary_logloss: 0.254552	valid_1's auc: 0.904659	valid_1's binary_logloss: 0.323639
[133]	valid_0's auc: 0.948036	valid_0's binary_logloss: 0.254216	valid_1's auc: 0.904707	valid_1's binary_logloss: 0.323537
[134]	valid_0's auc: 0.948191	valid_0's binary_logloss: 0.253896	valid_1's auc: 0.904633	valid_1's binary_logloss: 0.323696
[135]	valid_0's auc: 0.948351	valid_0's binary_logloss: 0.253571	valid_1's auc: 0.904561	valid_1's binary_logloss: 0.323838
[136]	valid_0's auc: 0.948467	valid_0's binary_logloss: 0.253313	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.323974
[137]	valid_0's auc: 0.948648	valid_0's binary_logloss: 0.252992	valid_1's auc: 0.904473	valid_1's binary_logloss: 0.324006
Early stopping, best iteration is:
[37]	valid_0's auc: 0.920158	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.908025	valid_1's binary_logloss: 0.318715
[1]	valid_0's auc: 0.889017	valid_0's binary_logloss: 0.51704	valid_1's auc: 0.893003	valid_1's binary_logloss: 0.508663
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893965	valid_0's binary_logloss: 0.48775	valid_1's auc: 0.898564	valid_1's binary_logloss: 0.47888
[3]	valid_0's auc: 0.895655	valid_0's binary_logloss: 0.464581	valid_1's auc: 0.900964	valid_1's binary_logloss: 0.455298
[4]	valid_0's auc: 0.897539	valid_0's binary_logloss: 0.445277	valid_1's auc: 0.902035	valid_1's binary_logloss: 0.435832
[5]	valid_0's auc: 0.898387	valid_0's binary_logloss: 0.429396	valid_1's auc: 0.902551	valid_1's binary_logloss: 0.419909
[6]	valid_0's auc: 0.899784	valid_0's binary_logloss: 0.415601	valid_1's auc: 0.903665	valid_1's binary_logloss: 0.405988
[7]	valid_0's auc: 0.900824	valid_0's binary_logloss: 0.403723	valid_1's auc: 0.904429	valid_1's binary_logloss: 0.394052
[8]	valid_0's auc: 0.902088	valid_0's binary_logloss: 0.39344	valid_1's auc: 0.904468	valid_1's binary_logloss: 0.384577
[9]	valid_0's auc: 0.902694	valid_0's binary_logloss: 0.384752	valid_1's auc: 0.904777	valid_1's binary_logloss: 0.376082
[10]	valid_0's auc: 0.903391	valid_0's binary_logloss: 0.377109	valid_1's auc: 0.905176	valid_1's binary_logloss: 0.368864
[11]	valid_0's auc: 0.904096	valid_0's binary_logloss: 0.370215	valid_1's auc: 0.9052	valid_1's binary_logloss: 0.362563
[12]	valid_0's auc: 0.904953	valid_0's binary_logloss: 0.36405	valid_1's auc: 0.90565	valid_1's binary_logloss: 0.356965
[13]	valid_0's auc: 0.905971	valid_0's binary_logloss: 0.358588	valid_1's auc: 0.906212	valid_1's binary_logloss: 0.351909
[14]	valid_0's auc: 0.90702	valid_0's binary_logloss: 0.35362	valid_1's auc: 0.906786	valid_1's binary_logloss: 0.347828
[15]	valid_0's auc: 0.907713	valid_0's binary_logloss: 0.349262	valid_1's auc: 0.906916	valid_1's binary_logloss: 0.344105
[16]	valid_0's auc: 0.908381	valid_0's binary_logloss: 0.345411	valid_1's auc: 0.907233	valid_1's binary_logloss: 0.34082
[17]	valid_0's auc: 0.908924	valid_0's binary_logloss: 0.34202	valid_1's auc: 0.907311	valid_1's binary_logloss: 0.338023
[18]	valid_0's auc: 0.909721	valid_0's binary_logloss: 0.338681	valid_1's auc: 0.907751	valid_1's binary_logloss: 0.335254
[19]	valid_0's auc: 0.91022	valid_0's binary_logloss: 0.335887	valid_1's auc: 0.907815	valid_1's binary_logloss: 0.333127
[20]	valid_0's auc: 0.910801	valid_0's binary_logloss: 0.333212	valid_1's auc: 0.907714	valid_1's binary_logloss: 0.33124
[21]	valid_0's auc: 0.911408	valid_0's binary_logloss: 0.330734	valid_1's auc: 0.907928	valid_1's binary_logloss: 0.329457
[22]	valid_0's auc: 0.911972	valid_0's binary_logloss: 0.328387	valid_1's auc: 0.90807	valid_1's binary_logloss: 0.327816
[23]	valid_0's auc: 0.912761	valid_0's binary_logloss: 0.326142	valid_1's auc: 0.908197	valid_1's binary_logloss: 0.326528
[24]	valid_0's auc: 0.913524	valid_0's binary_logloss: 0.323941	valid_1's auc: 0.908612	valid_1's binary_logloss: 0.324926
[25]	valid_0's auc: 0.914174	valid_0's binary_logloss: 0.321948	valid_1's auc: 0.908783	valid_1's binary_logloss: 0.323723
[26]	valid_0's auc: 0.914852	valid_0's binary_logloss: 0.319983	valid_1's auc: 0.908928	valid_1's binary_logloss: 0.322644
[27]	valid_0's auc: 0.915466	valid_0's binary_logloss: 0.318315	valid_1's auc: 0.909014	valid_1's binary_logloss: 0.321733
[28]	valid_0's auc: 0.916026	valid_0's binary_logloss: 0.316677	valid_1's auc: 0.909029	valid_1's binary_logloss: 0.320995
[29]	valid_0's auc: 0.916624	valid_0's binary_logloss: 0.315105	valid_1's auc: 0.909	valid_1's binary_logloss: 0.320399
[30]	valid_0's auc: 0.917074	valid_0's binary_logloss: 0.313791	valid_1's auc: 0.908976	valid_1's binary_logloss: 0.319869
[31]	valid_0's auc: 0.917669	valid_0's binary_logloss: 0.312373	valid_1's auc: 0.908985	valid_1's binary_logloss: 0.319336
[32]	valid_0's auc: 0.918185	valid_0's binary_logloss: 0.311106	valid_1's auc: 0.908975	valid_1's binary_logloss: 0.318913
[33]	valid_0's auc: 0.918688	valid_0's binary_logloss: 0.309854	valid_1's auc: 0.909075	valid_1's binary_logloss: 0.318445
[34]	valid_0's auc: 0.919132	valid_0's binary_logloss: 0.308681	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.318088
[35]	valid_0's auc: 0.919628	valid_0's binary_logloss: 0.307502	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317632
[36]	valid_0's auc: 0.920057	valid_0's binary_logloss: 0.306455	valid_1's auc: 0.909115	valid_1's binary_logloss: 0.317404
[37]	valid_0's auc: 0.920619	valid_0's binary_logloss: 0.305373	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.317138
[38]	valid_0's auc: 0.921063	valid_0's binary_logloss: 0.3044	valid_1's auc: 0.908963	valid_1's binary_logloss: 0.31714
[39]	valid_0's auc: 0.921527	valid_0's binary_logloss: 0.303407	valid_1's auc: 0.908999	valid_1's binary_logloss: 0.316944
[40]	valid_0's auc: 0.921993	valid_0's binary_logloss: 0.302462	valid_1's auc: 0.908929	valid_1's binary_logloss: 0.316911
[41]	valid_0's auc: 0.922464	valid_0's binary_logloss: 0.301427	valid_1's auc: 0.908767	valid_1's binary_logloss: 0.31694
[42]	valid_0's auc: 0.922911	valid_0's binary_logloss: 0.30047	valid_1's auc: 0.908794	valid_1's binary_logloss: 0.31667
[43]	valid_0's auc: 0.923327	valid_0's binary_logloss: 0.299654	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.316418
[44]	valid_0's auc: 0.923745	valid_0's binary_logloss: 0.298826	valid_1's auc: 0.908948	valid_1's binary_logloss: 0.31623
[45]	valid_0's auc: 0.924137	valid_0's binary_logloss: 0.298016	valid_1's auc: 0.90893	valid_1's binary_logloss: 0.316185
[46]	valid_0's auc: 0.924505	valid_0's binary_logloss: 0.29724	valid_1's auc: 0.90897	valid_1's binary_logloss: 0.316023
[47]	valid_0's auc: 0.924849	valid_0's binary_logloss: 0.296548	valid_1's auc: 0.908886	valid_1's binary_logloss: 0.316063
[48]	valid_0's auc: 0.925234	valid_0's binary_logloss: 0.295834	valid_1's auc: 0.908919	valid_1's binary_logloss: 0.315925
[49]	valid_0's auc: 0.92565	valid_0's binary_logloss: 0.29507	valid_1's auc: 0.90888	valid_1's binary_logloss: 0.3159
[50]	valid_0's auc: 0.926046	valid_0's binary_logloss: 0.294374	valid_1's auc: 0.908865	valid_1's binary_logloss: 0.31583
[51]	valid_0's auc: 0.926434	valid_0's binary_logloss: 0.293628	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.315792
[52]	valid_0's auc: 0.926786	valid_0's binary_logloss: 0.292948	valid_1's auc: 0.90876	valid_1's binary_logloss: 0.315922
[53]	valid_0's auc: 0.927211	valid_0's binary_logloss: 0.29213	valid_1's auc: 0.908748	valid_1's binary_logloss: 0.315878
[54]	valid_0's auc: 0.927665	valid_0's binary_logloss: 0.29132	valid_1's auc: 0.908625	valid_1's binary_logloss: 0.315966
[55]	valid_0's auc: 0.927959	valid_0's binary_logloss: 0.290725	valid_1's auc: 0.908632	valid_1's binary_logloss: 0.315958
[56]	valid_0's auc: 0.928243	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.908654	valid_1's binary_logloss: 0.315877
[57]	valid_0's auc: 0.928567	valid_0's binary_logloss: 0.28949	valid_1's auc: 0.908579	valid_1's binary_logloss: 0.315982
[58]	valid_0's auc: 0.928916	valid_0's binary_logloss: 0.2889	valid_1's auc: 0.908532	valid_1's binary_logloss: 0.316041
[59]	valid_0's auc: 0.929229	valid_0's binary_logloss: 0.28829	valid_1's auc: 0.90853	valid_1's binary_logloss: 0.316035
[60]	valid_0's auc: 0.92953	valid_0's binary_logloss: 0.287708	valid_1's auc: 0.908526	valid_1's binary_logloss: 0.315974
[61]	valid_0's auc: 0.92995	valid_0's binary_logloss: 0.287003	valid_1's auc: 0.908262	valid_1's binary_logloss: 0.316386
[62]	valid_0's auc: 0.930386	valid_0's binary_logloss: 0.286305	valid_1's auc: 0.908235	valid_1's binary_logloss: 0.316457
[63]	valid_0's auc: 0.930679	valid_0's binary_logloss: 0.285782	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.316658
[64]	valid_0's auc: 0.931084	valid_0's binary_logloss: 0.285147	valid_1's auc: 0.908186	valid_1's binary_logloss: 0.316635
[65]	valid_0's auc: 0.931427	valid_0's binary_logloss: 0.284507	valid_1's auc: 0.908243	valid_1's binary_logloss: 0.316525
[66]	valid_0's auc: 0.931846	valid_0's binary_logloss: 0.283753	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316724
[67]	valid_0's auc: 0.932211	valid_0's binary_logloss: 0.283163	valid_1's auc: 0.908215	valid_1's binary_logloss: 0.316634
[68]	valid_0's auc: 0.932451	valid_0's binary_logloss: 0.282688	valid_1's auc: 0.90814	valid_1's binary_logloss: 0.31672
[69]	valid_0's auc: 0.932807	valid_0's binary_logloss: 0.282106	valid_1's auc: 0.90792	valid_1's binary_logloss: 0.317004
[70]	valid_0's auc: 0.933086	valid_0's binary_logloss: 0.281647	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.317093
[71]	valid_0's auc: 0.933387	valid_0's binary_logloss: 0.281075	valid_1's auc: 0.907877	valid_1's binary_logloss: 0.317059
[72]	valid_0's auc: 0.933649	valid_0's binary_logloss: 0.28059	valid_1's auc: 0.907922	valid_1's binary_logloss: 0.317019
[73]	valid_0's auc: 0.933981	valid_0's binary_logloss: 0.280024	valid_1's auc: 0.908019	valid_1's binary_logloss: 0.316932
[74]	valid_0's auc: 0.93426	valid_0's binary_logloss: 0.279527	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.316902
[75]	valid_0's auc: 0.934497	valid_0's binary_logloss: 0.279065	valid_1's auc: 0.90808	valid_1's binary_logloss: 0.316832
[76]	valid_0's auc: 0.934717	valid_0's binary_logloss: 0.278678	valid_1's auc: 0.908004	valid_1's binary_logloss: 0.316904
[77]	valid_0's auc: 0.935024	valid_0's binary_logloss: 0.278147	valid_1's auc: 0.907907	valid_1's binary_logloss: 0.317068
[78]	valid_0's auc: 0.935454	valid_0's binary_logloss: 0.277438	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.317063
[79]	valid_0's auc: 0.935705	valid_0's binary_logloss: 0.276937	valid_1's auc: 0.907881	valid_1's binary_logloss: 0.317098
[80]	valid_0's auc: 0.936004	valid_0's binary_logloss: 0.276435	valid_1's auc: 0.907801	valid_1's binary_logloss: 0.317228
[81]	valid_0's auc: 0.936242	valid_0's binary_logloss: 0.276002	valid_1's auc: 0.907795	valid_1's binary_logloss: 0.317266
[82]	valid_0's auc: 0.936516	valid_0's binary_logloss: 0.27551	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.317244
[83]	valid_0's auc: 0.936823	valid_0's binary_logloss: 0.274999	valid_1's auc: 0.907898	valid_1's binary_logloss: 0.317089
[84]	valid_0's auc: 0.937077	valid_0's binary_logloss: 0.274532	valid_1's auc: 0.907907	valid_1's binary_logloss: 0.317078
[85]	valid_0's auc: 0.937354	valid_0's binary_logloss: 0.274045	valid_1's auc: 0.907749	valid_1's binary_logloss: 0.317288
[86]	valid_0's auc: 0.937625	valid_0's binary_logloss: 0.273585	valid_1's auc: 0.907613	valid_1's binary_logloss: 0.317505
[87]	valid_0's auc: 0.937925	valid_0's binary_logloss: 0.273025	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.317575
[88]	valid_0's auc: 0.938269	valid_0's binary_logloss: 0.272487	valid_1's auc: 0.907592	valid_1's binary_logloss: 0.317594
[89]	valid_0's auc: 0.938599	valid_0's binary_logloss: 0.271899	valid_1's auc: 0.907574	valid_1's binary_logloss: 0.317589
[90]	valid_0's auc: 0.938847	valid_0's binary_logloss: 0.271442	valid_1's auc: 0.907462	valid_1's binary_logloss: 0.317798
[91]	valid_0's auc: 0.939119	valid_0's binary_logloss: 0.270984	valid_1's auc: 0.9074	valid_1's binary_logloss: 0.317913
[92]	valid_0's auc: 0.939419	valid_0's binary_logloss: 0.270451	valid_1's auc: 0.907457	valid_1's binary_logloss: 0.317854
[93]	valid_0's auc: 0.939613	valid_0's binary_logloss: 0.270076	valid_1's auc: 0.907331	valid_1's binary_logloss: 0.318094
[94]	valid_0's auc: 0.939761	valid_0's binary_logloss: 0.269744	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.318092
[95]	valid_0's auc: 0.940023	valid_0's binary_logloss: 0.269299	valid_1's auc: 0.907369	valid_1's binary_logloss: 0.318038
[96]	valid_0's auc: 0.940215	valid_0's binary_logloss: 0.268928	valid_1's auc: 0.907351	valid_1's binary_logloss: 0.31808
[97]	valid_0's auc: 0.940479	valid_0's binary_logloss: 0.268467	valid_1's auc: 0.907305	valid_1's binary_logloss: 0.318128
[98]	valid_0's auc: 0.940824	valid_0's binary_logloss: 0.267894	valid_1's auc: 0.907295	valid_1's binary_logloss: 0.318114
[99]	valid_0's auc: 0.941002	valid_0's binary_logloss: 0.267463	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.3182
[100]	valid_0's auc: 0.94123	valid_0's binary_logloss: 0.267028	valid_1's auc: 0.907251	valid_1's binary_logloss: 0.318203
[101]	valid_0's auc: 0.941449	valid_0's binary_logloss: 0.266659	valid_1's auc: 0.907097	valid_1's binary_logloss: 0.318452
[102]	valid_0's auc: 0.941718	valid_0's binary_logloss: 0.266204	valid_1's auc: 0.906896	valid_1's binary_logloss: 0.318786
[103]	valid_0's auc: 0.941925	valid_0's binary_logloss: 0.265825	valid_1's auc: 0.906946	valid_1's binary_logloss: 0.318703
[104]	valid_0's auc: 0.942146	valid_0's binary_logloss: 0.265435	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.318721
[105]	valid_0's auc: 0.942325	valid_0's binary_logloss: 0.265093	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.31894
[106]	valid_0's auc: 0.942521	valid_0's binary_logloss: 0.26473	valid_1's auc: 0.906753	valid_1's binary_logloss: 0.319089
[107]	valid_0's auc: 0.942703	valid_0's binary_logloss: 0.264364	valid_1's auc: 0.906773	valid_1's binary_logloss: 0.319083
[108]	valid_0's auc: 0.942888	valid_0's binary_logloss: 0.264016	valid_1's auc: 0.906736	valid_1's binary_logloss: 0.319193
[109]	valid_0's auc: 0.94307	valid_0's binary_logloss: 0.263653	valid_1's auc: 0.906687	valid_1's binary_logloss: 0.319271
[110]	valid_0's auc: 0.943393	valid_0's binary_logloss: 0.263107	valid_1's auc: 0.906534	valid_1's binary_logloss: 0.319521
[111]	valid_0's auc: 0.943652	valid_0's binary_logloss: 0.262643	valid_1's auc: 0.906465	valid_1's binary_logloss: 0.319624
[112]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.262249	valid_1's auc: 0.906401	valid_1's binary_logloss: 0.319721
[113]	valid_0's auc: 0.944041	valid_0's binary_logloss: 0.261857	valid_1's auc: 0.906314	valid_1's binary_logloss: 0.319963
[114]	valid_0's auc: 0.944212	valid_0's binary_logloss: 0.261534	valid_1's auc: 0.906243	valid_1's binary_logloss: 0.320085
[115]	valid_0's auc: 0.944439	valid_0's binary_logloss: 0.261101	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.320253
[116]	valid_0's auc: 0.944635	valid_0's binary_logloss: 0.260696	valid_1's auc: 0.906071	valid_1's binary_logloss: 0.320428
[117]	valid_0's auc: 0.944897	valid_0's binary_logloss: 0.260166	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.320501
[118]	valid_0's auc: 0.94514	valid_0's binary_logloss: 0.259702	valid_1's auc: 0.905902	valid_1's binary_logloss: 0.320775
[119]	valid_0's auc: 0.945403	valid_0's binary_logloss: 0.259189	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320681
[120]	valid_0's auc: 0.94555	valid_0's binary_logloss: 0.258843	valid_1's auc: 0.905956	valid_1's binary_logloss: 0.320782
[121]	valid_0's auc: 0.945742	valid_0's binary_logloss: 0.258454	valid_1's auc: 0.906073	valid_1's binary_logloss: 0.320636
[122]	valid_0's auc: 0.945903	valid_0's binary_logloss: 0.25812	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320737
[123]	valid_0's auc: 0.946118	valid_0's binary_logloss: 0.257727	valid_1's auc: 0.905951	valid_1's binary_logloss: 0.320873
[124]	valid_0's auc: 0.946279	valid_0's binary_logloss: 0.257401	valid_1's auc: 0.905949	valid_1's binary_logloss: 0.320859
[125]	valid_0's auc: 0.9464	valid_0's binary_logloss: 0.257113	valid_1's auc: 0.905998	valid_1's binary_logloss: 0.320838
[126]	valid_0's auc: 0.946541	valid_0's binary_logloss: 0.256815	valid_1's auc: 0.90591	valid_1's binary_logloss: 0.32099
[127]	valid_0's auc: 0.946714	valid_0's binary_logloss: 0.256514	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.321113
[128]	valid_0's auc: 0.946933	valid_0's binary_logloss: 0.256127	valid_1's auc: 0.905836	valid_1's binary_logloss: 0.321208
[129]	valid_0's auc: 0.947157	valid_0's binary_logloss: 0.255684	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.321399
[130]	valid_0's auc: 0.947413	valid_0's binary_logloss: 0.255215	valid_1's auc: 0.905755	valid_1's binary_logloss: 0.32142
[131]	valid_0's auc: 0.947626	valid_0's binary_logloss: 0.254818	valid_1's auc: 0.905794	valid_1's binary_logloss: 0.321344
[132]	valid_0's auc: 0.947755	valid_0's binary_logloss: 0.254555	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321386
[133]	valid_0's auc: 0.947924	valid_0's binary_logloss: 0.25423	valid_1's auc: 0.905691	valid_1's binary_logloss: 0.321548
[134]	valid_0's auc: 0.948092	valid_0's binary_logloss: 0.253925	valid_1's auc: 0.90572	valid_1's binary_logloss: 0.321508
[135]	valid_0's auc: 0.948211	valid_0's binary_logloss: 0.25366	valid_1's auc: 0.905675	valid_1's binary_logloss: 0.321587
Early stopping, best iteration is:
[35]	valid_0's auc: 0.919628	valid_0's binary_logloss: 0.307502	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317632
[1]	valid_0's auc: 0.883716	valid_0's binary_logloss: 0.517437	valid_1's auc: 0.891829	valid_1's binary_logloss: 0.508331
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890073	valid_0's binary_logloss: 0.488559	valid_1's auc: 0.895643	valid_1's binary_logloss: 0.47903
[3]	valid_0's auc: 0.89469	valid_0's binary_logloss: 0.465046	valid_1's auc: 0.899849	valid_1's binary_logloss: 0.455412
[4]	valid_0's auc: 0.896069	valid_0's binary_logloss: 0.445806	valid_1's auc: 0.901287	valid_1's binary_logloss: 0.435833
[5]	valid_0's auc: 0.897389	valid_0's binary_logloss: 0.429622	valid_1's auc: 0.901269	valid_1's binary_logloss: 0.419878
[6]	valid_0's auc: 0.898537	valid_0's binary_logloss: 0.415829	valid_1's auc: 0.90164	valid_1's binary_logloss: 0.406518
[7]	valid_0's auc: 0.899913	valid_0's binary_logloss: 0.404082	valid_1's auc: 0.90253	valid_1's binary_logloss: 0.394728
[8]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.394009	valid_1's auc: 0.90316	valid_1's binary_logloss: 0.384967
[9]	valid_0's auc: 0.901575	valid_0's binary_logloss: 0.385168	valid_1's auc: 0.904068	valid_1's binary_logloss: 0.376241
[10]	valid_0's auc: 0.902151	valid_0's binary_logloss: 0.377494	valid_1's auc: 0.904329	valid_1's binary_logloss: 0.368945
[11]	valid_0's auc: 0.903157	valid_0's binary_logloss: 0.370649	valid_1's auc: 0.904521	valid_1's binary_logloss: 0.362422
[12]	valid_0's auc: 0.904146	valid_0's binary_logloss: 0.364509	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.357161
[13]	valid_0's auc: 0.905147	valid_0's binary_logloss: 0.358996	valid_1's auc: 0.905092	valid_1's binary_logloss: 0.352531
[14]	valid_0's auc: 0.905821	valid_0's binary_logloss: 0.354303	valid_1's auc: 0.905235	valid_1's binary_logloss: 0.348331
[15]	valid_0's auc: 0.906501	valid_0's binary_logloss: 0.350005	valid_1's auc: 0.9055	valid_1's binary_logloss: 0.344659
[16]	valid_0's auc: 0.907197	valid_0's binary_logloss: 0.346171	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.341413
[17]	valid_0's auc: 0.907706	valid_0's binary_logloss: 0.342767	valid_1's auc: 0.906119	valid_1's binary_logloss: 0.33838
[18]	valid_0's auc: 0.90833	valid_0's binary_logloss: 0.339529	valid_1's auc: 0.906432	valid_1's binary_logloss: 0.335707
[19]	valid_0's auc: 0.909141	valid_0's binary_logloss: 0.336667	valid_1's auc: 0.906907	valid_1's binary_logloss: 0.33344
[20]	valid_0's auc: 0.909876	valid_0's binary_logloss: 0.333932	valid_1's auc: 0.906948	valid_1's binary_logloss: 0.331682
[21]	valid_0's auc: 0.91072	valid_0's binary_logloss: 0.331312	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.329863
[22]	valid_0's auc: 0.911318	valid_0's binary_logloss: 0.329059	valid_1's auc: 0.90775	valid_1's binary_logloss: 0.327885
[23]	valid_0's auc: 0.912182	valid_0's binary_logloss: 0.326642	valid_1's auc: 0.907938	valid_1's binary_logloss: 0.326267
[24]	valid_0's auc: 0.912963	valid_0's binary_logloss: 0.324378	valid_1's auc: 0.908239	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.913644	valid_0's binary_logloss: 0.322409	valid_1's auc: 0.908413	valid_1's binary_logloss: 0.323279
[26]	valid_0's auc: 0.914223	valid_0's binary_logloss: 0.320614	valid_1's auc: 0.908625	valid_1's binary_logloss: 0.322223
[27]	valid_0's auc: 0.914803	valid_0's binary_logloss: 0.318976	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.321136
[28]	valid_0's auc: 0.915536	valid_0's binary_logloss: 0.317202	valid_1's auc: 0.909073	valid_1's binary_logloss: 0.320222
[29]	valid_0's auc: 0.916209	valid_0's binary_logloss: 0.31558	valid_1's auc: 0.909141	valid_1's binary_logloss: 0.319585
[30]	valid_0's auc: 0.916656	valid_0's binary_logloss: 0.314205	valid_1's auc: 0.909131	valid_1's binary_logloss: 0.318964
[31]	valid_0's auc: 0.917221	valid_0's binary_logloss: 0.312808	valid_1's auc: 0.909375	valid_1's binary_logloss: 0.318274
[32]	valid_0's auc: 0.917821	valid_0's binary_logloss: 0.311401	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.317757
[33]	valid_0's auc: 0.918299	valid_0's binary_logloss: 0.310204	valid_1's auc: 0.909571	valid_1's binary_logloss: 0.317191
[34]	valid_0's auc: 0.918779	valid_0's binary_logloss: 0.309067	valid_1's auc: 0.909576	valid_1's binary_logloss: 0.316784
[35]	valid_0's auc: 0.91933	valid_0's binary_logloss: 0.307859	valid_1's auc: 0.909686	valid_1's binary_logloss: 0.316332
[36]	valid_0's auc: 0.919711	valid_0's binary_logloss: 0.306854	valid_1's auc: 0.90985	valid_1's binary_logloss: 0.315794
[37]	valid_0's auc: 0.920148	valid_0's binary_logloss: 0.305776	valid_1's auc: 0.909915	valid_1's binary_logloss: 0.315482
[38]	valid_0's auc: 0.920644	valid_0's binary_logloss: 0.304716	valid_1's auc: 0.90996	valid_1's binary_logloss: 0.315194
[39]	valid_0's auc: 0.921279	valid_0's binary_logloss: 0.303523	valid_1's auc: 0.910021	valid_1's binary_logloss: 0.31493
[40]	valid_0's auc: 0.921695	valid_0's binary_logloss: 0.302625	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.314992
[41]	valid_0's auc: 0.922157	valid_0's binary_logloss: 0.301742	valid_1's auc: 0.909853	valid_1's binary_logloss: 0.314822
[42]	valid_0's auc: 0.922604	valid_0's binary_logloss: 0.300806	valid_1's auc: 0.909692	valid_1's binary_logloss: 0.314968
[43]	valid_0's auc: 0.923044	valid_0's binary_logloss: 0.299986	valid_1's auc: 0.909703	valid_1's binary_logloss: 0.314858
[44]	valid_0's auc: 0.923508	valid_0's binary_logloss: 0.29913	valid_1's auc: 0.909722	valid_1's binary_logloss: 0.314687
[45]	valid_0's auc: 0.923968	valid_0's binary_logloss: 0.298278	valid_1's auc: 0.909802	valid_1's binary_logloss: 0.314548
[46]	valid_0's auc: 0.924346	valid_0's binary_logloss: 0.297515	valid_1's auc: 0.909635	valid_1's binary_logloss: 0.314591
[47]	valid_0's auc: 0.924759	valid_0's binary_logloss: 0.296739	valid_1's auc: 0.909625	valid_1's binary_logloss: 0.314549
[48]	valid_0's auc: 0.92511	valid_0's binary_logloss: 0.296031	valid_1's auc: 0.909672	valid_1's binary_logloss: 0.314395
[49]	valid_0's auc: 0.925568	valid_0's binary_logloss: 0.295128	valid_1's auc: 0.909747	valid_1's binary_logloss: 0.314213
[50]	valid_0's auc: 0.925897	valid_0's binary_logloss: 0.294497	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314313
[51]	valid_0's auc: 0.926313	valid_0's binary_logloss: 0.293828	valid_1's auc: 0.909642	valid_1's binary_logloss: 0.314248
[52]	valid_0's auc: 0.926717	valid_0's binary_logloss: 0.293088	valid_1's auc: 0.909586	valid_1's binary_logloss: 0.314252
[53]	valid_0's auc: 0.927075	valid_0's binary_logloss: 0.292434	valid_1's auc: 0.909528	valid_1's binary_logloss: 0.314305
[54]	valid_0's auc: 0.927507	valid_0's binary_logloss: 0.291637	valid_1's auc: 0.909546	valid_1's binary_logloss: 0.314247
[55]	valid_0's auc: 0.927929	valid_0's binary_logloss: 0.290889	valid_1's auc: 0.909422	valid_1's binary_logloss: 0.314349
[56]	valid_0's auc: 0.928351	valid_0's binary_logloss: 0.290158	valid_1's auc: 0.909407	valid_1's binary_logloss: 0.314391
[57]	valid_0's auc: 0.928749	valid_0's binary_logloss: 0.289457	valid_1's auc: 0.909303	valid_1's binary_logloss: 0.314463
[58]	valid_0's auc: 0.929162	valid_0's binary_logloss: 0.28868	valid_1's auc: 0.909262	valid_1's binary_logloss: 0.314567
[59]	valid_0's auc: 0.929451	valid_0's binary_logloss: 0.288145	valid_1's auc: 0.909166	valid_1's binary_logloss: 0.314703
[60]	valid_0's auc: 0.929891	valid_0's binary_logloss: 0.287437	valid_1's auc: 0.909176	valid_1's binary_logloss: 0.314728
[61]	valid_0's auc: 0.93032	valid_0's binary_logloss: 0.286724	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.31478
[62]	valid_0's auc: 0.930593	valid_0's binary_logloss: 0.286258	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.31478
[63]	valid_0's auc: 0.930979	valid_0's binary_logloss: 0.285624	valid_1's auc: 0.908985	valid_1's binary_logloss: 0.314955
[64]	valid_0's auc: 0.93134	valid_0's binary_logloss: 0.284907	valid_1's auc: 0.908987	valid_1's binary_logloss: 0.31491
[65]	valid_0's auc: 0.931648	valid_0's binary_logloss: 0.284345	valid_1's auc: 0.908876	valid_1's binary_logloss: 0.315108
[66]	valid_0's auc: 0.9319	valid_0's binary_logloss: 0.283886	valid_1's auc: 0.908727	valid_1's binary_logloss: 0.315314
[67]	valid_0's auc: 0.932118	valid_0's binary_logloss: 0.283497	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315394
[68]	valid_0's auc: 0.932411	valid_0's binary_logloss: 0.282974	valid_1's auc: 0.908585	valid_1's binary_logloss: 0.315563
[69]	valid_0's auc: 0.932861	valid_0's binary_logloss: 0.282215	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.31572
[70]	valid_0's auc: 0.933228	valid_0's binary_logloss: 0.281536	valid_1's auc: 0.908479	valid_1's binary_logloss: 0.315735
[71]	valid_0's auc: 0.933522	valid_0's binary_logloss: 0.281033	valid_1's auc: 0.90843	valid_1's binary_logloss: 0.315787
[72]	valid_0's auc: 0.933741	valid_0's binary_logloss: 0.28055	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.315925
[73]	valid_0's auc: 0.934042	valid_0's binary_logloss: 0.280057	valid_1's auc: 0.908377	valid_1's binary_logloss: 0.315895
[74]	valid_0's auc: 0.934439	valid_0's binary_logloss: 0.279357	valid_1's auc: 0.908457	valid_1's binary_logloss: 0.315747
[75]	valid_0's auc: 0.934726	valid_0's binary_logloss: 0.278811	valid_1's auc: 0.90845	valid_1's binary_logloss: 0.315763
[76]	valid_0's auc: 0.935012	valid_0's binary_logloss: 0.278326	valid_1's auc: 0.908309	valid_1's binary_logloss: 0.315998
[77]	valid_0's auc: 0.935323	valid_0's binary_logloss: 0.277766	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.316255
[78]	valid_0's auc: 0.935515	valid_0's binary_logloss: 0.277332	valid_1's auc: 0.908093	valid_1's binary_logloss: 0.316266
[79]	valid_0's auc: 0.935859	valid_0's binary_logloss: 0.276762	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.316437
[80]	valid_0's auc: 0.93612	valid_0's binary_logloss: 0.276266	valid_1's auc: 0.907936	valid_1's binary_logloss: 0.31654
[81]	valid_0's auc: 0.936335	valid_0's binary_logloss: 0.275818	valid_1's auc: 0.907773	valid_1's binary_logloss: 0.316834
[82]	valid_0's auc: 0.936578	valid_0's binary_logloss: 0.275412	valid_1's auc: 0.907601	valid_1's binary_logloss: 0.317083
[83]	valid_0's auc: 0.936838	valid_0's binary_logloss: 0.274894	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.31711
[84]	valid_0's auc: 0.937126	valid_0's binary_logloss: 0.274355	valid_1's auc: 0.907741	valid_1's binary_logloss: 0.316892
[85]	valid_0's auc: 0.937387	valid_0's binary_logloss: 0.273881	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.316927
[86]	valid_0's auc: 0.937546	valid_0's binary_logloss: 0.273513	valid_1's auc: 0.907591	valid_1's binary_logloss: 0.317048
[87]	valid_0's auc: 0.937706	valid_0's binary_logloss: 0.273204	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.317093
[88]	valid_0's auc: 0.938026	valid_0's binary_logloss: 0.272696	valid_1's auc: 0.907376	valid_1's binary_logloss: 0.317353
[89]	valid_0's auc: 0.938304	valid_0's binary_logloss: 0.272184	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.317393
[90]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.271714	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.317594
[91]	valid_0's auc: 0.938902	valid_0's binary_logloss: 0.271134	valid_1's auc: 0.907232	valid_1's binary_logloss: 0.317636
[92]	valid_0's auc: 0.939151	valid_0's binary_logloss: 0.270674	valid_1's auc: 0.907232	valid_1's binary_logloss: 0.31764
[93]	valid_0's auc: 0.939491	valid_0's binary_logloss: 0.270076	valid_1's auc: 0.907273	valid_1's binary_logloss: 0.317499
[94]	valid_0's auc: 0.939719	valid_0's binary_logloss: 0.269674	valid_1's auc: 0.907154	valid_1's binary_logloss: 0.317748
[95]	valid_0's auc: 0.939992	valid_0's binary_logloss: 0.269238	valid_1's auc: 0.907169	valid_1's binary_logloss: 0.317764
[96]	valid_0's auc: 0.940181	valid_0's binary_logloss: 0.268792	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.317883
[97]	valid_0's auc: 0.940423	valid_0's binary_logloss: 0.268352	valid_1's auc: 0.907011	valid_1's binary_logloss: 0.318037
[98]	valid_0's auc: 0.940635	valid_0's binary_logloss: 0.267984	valid_1's auc: 0.906943	valid_1's binary_logloss: 0.318218
[99]	valid_0's auc: 0.940888	valid_0's binary_logloss: 0.267474	valid_1's auc: 0.906799	valid_1's binary_logloss: 0.318482
[100]	valid_0's auc: 0.941141	valid_0's binary_logloss: 0.267033	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.318632
[101]	valid_0's auc: 0.941373	valid_0's binary_logloss: 0.266543	valid_1's auc: 0.906715	valid_1's binary_logloss: 0.318703
[102]	valid_0's auc: 0.941567	valid_0's binary_logloss: 0.266138	valid_1's auc: 0.906674	valid_1's binary_logloss: 0.318819
[103]	valid_0's auc: 0.941898	valid_0's binary_logloss: 0.265578	valid_1's auc: 0.906632	valid_1's binary_logloss: 0.318852
[104]	valid_0's auc: 0.942122	valid_0's binary_logloss: 0.265155	valid_1's auc: 0.906626	valid_1's binary_logloss: 0.318882
[105]	valid_0's auc: 0.942433	valid_0's binary_logloss: 0.264627	valid_1's auc: 0.906589	valid_1's binary_logloss: 0.318949
[106]	valid_0's auc: 0.942633	valid_0's binary_logloss: 0.264241	valid_1's auc: 0.906558	valid_1's binary_logloss: 0.31901
[107]	valid_0's auc: 0.942846	valid_0's binary_logloss: 0.263807	valid_1's auc: 0.90645	valid_1's binary_logloss: 0.319319
[108]	valid_0's auc: 0.943	valid_0's binary_logloss: 0.263477	valid_1's auc: 0.906395	valid_1's binary_logloss: 0.31937
[109]	valid_0's auc: 0.943283	valid_0's binary_logloss: 0.26295	valid_1's auc: 0.906323	valid_1's binary_logloss: 0.319464
[110]	valid_0's auc: 0.943459	valid_0's binary_logloss: 0.26259	valid_1's auc: 0.906281	valid_1's binary_logloss: 0.319555
[111]	valid_0's auc: 0.943607	valid_0's binary_logloss: 0.262293	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.319712
[112]	valid_0's auc: 0.943738	valid_0's binary_logloss: 0.261985	valid_1's auc: 0.906186	valid_1's binary_logloss: 0.319751
[113]	valid_0's auc: 0.943912	valid_0's binary_logloss: 0.261662	valid_1's auc: 0.906145	valid_1's binary_logloss: 0.319803
[114]	valid_0's auc: 0.944255	valid_0's binary_logloss: 0.261059	valid_1's auc: 0.906052	valid_1's binary_logloss: 0.31996
[115]	valid_0's auc: 0.944417	valid_0's binary_logloss: 0.260722	valid_1's auc: 0.905902	valid_1's binary_logloss: 0.320284
[116]	valid_0's auc: 0.944659	valid_0's binary_logloss: 0.260273	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.320234
[117]	valid_0's auc: 0.944967	valid_0's binary_logloss: 0.259769	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.320148
[118]	valid_0's auc: 0.945235	valid_0's binary_logloss: 0.259296	valid_1's auc: 0.9059	valid_1's binary_logloss: 0.320273
[119]	valid_0's auc: 0.945469	valid_0's binary_logloss: 0.258902	valid_1's auc: 0.905856	valid_1's binary_logloss: 0.320406
[120]	valid_0's auc: 0.945672	valid_0's binary_logloss: 0.258545	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.320478
[121]	valid_0's auc: 0.945858	valid_0's binary_logloss: 0.25815	valid_1's auc: 0.905773	valid_1's binary_logloss: 0.320589
[122]	valid_0's auc: 0.946017	valid_0's binary_logloss: 0.257846	valid_1's auc: 0.905775	valid_1's binary_logloss: 0.320583
[123]	valid_0's auc: 0.946165	valid_0's binary_logloss: 0.257531	valid_1's auc: 0.905724	valid_1's binary_logloss: 0.320695
[124]	valid_0's auc: 0.946424	valid_0's binary_logloss: 0.257024	valid_1's auc: 0.905564	valid_1's binary_logloss: 0.321096
[125]	valid_0's auc: 0.946646	valid_0's binary_logloss: 0.256642	valid_1's auc: 0.905433	valid_1's binary_logloss: 0.321306
[126]	valid_0's auc: 0.946865	valid_0's binary_logloss: 0.256242	valid_1's auc: 0.905412	valid_1's binary_logloss: 0.321339
[127]	valid_0's auc: 0.946988	valid_0's binary_logloss: 0.255992	valid_1's auc: 0.905418	valid_1's binary_logloss: 0.321381
[128]	valid_0's auc: 0.947212	valid_0's binary_logloss: 0.255559	valid_1's auc: 0.905408	valid_1's binary_logloss: 0.321409
[129]	valid_0's auc: 0.947468	valid_0's binary_logloss: 0.255076	valid_1's auc: 0.905305	valid_1's binary_logloss: 0.321584
[130]	valid_0's auc: 0.947655	valid_0's binary_logloss: 0.254702	valid_1's auc: 0.905264	valid_1's binary_logloss: 0.321679
[131]	valid_0's auc: 0.947854	valid_0's binary_logloss: 0.254322	valid_1's auc: 0.905169	valid_1's binary_logloss: 0.321851
[132]	valid_0's auc: 0.948046	valid_0's binary_logloss: 0.253945	valid_1's auc: 0.905126	valid_1's binary_logloss: 0.321916
[133]	valid_0's auc: 0.948226	valid_0's binary_logloss: 0.253593	valid_1's auc: 0.905042	valid_1's binary_logloss: 0.322104
[134]	valid_0's auc: 0.948452	valid_0's binary_logloss: 0.253205	valid_1's auc: 0.905074	valid_1's binary_logloss: 0.322097
[135]	valid_0's auc: 0.948617	valid_0's binary_logloss: 0.252867	valid_1's auc: 0.905022	valid_1's binary_logloss: 0.322243
[136]	valid_0's auc: 0.948783	valid_0's binary_logloss: 0.252531	valid_1's auc: 0.904996	valid_1's binary_logloss: 0.322311
[137]	valid_0's auc: 0.948943	valid_0's binary_logloss: 0.252197	valid_1's auc: 0.904861	valid_1's binary_logloss: 0.322582
[138]	valid_0's auc: 0.949227	valid_0's binary_logloss: 0.251677	valid_1's auc: 0.90482	valid_1's binary_logloss: 0.322665
[139]	valid_0's auc: 0.949439	valid_0's binary_logloss: 0.251306	valid_1's auc: 0.904761	valid_1's binary_logloss: 0.322785
Early stopping, best iteration is:
[39]	valid_0's auc: 0.921279	valid_0's binary_logloss: 0.303523	valid_1's auc: 0.910021	valid_1's binary_logloss: 0.31493
[1]	valid_0's auc: 0.889031	valid_0's binary_logloss: 0.516579	valid_1's auc: 0.896723	valid_1's binary_logloss: 0.507458
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892164	valid_0's binary_logloss: 0.487355	valid_1's auc: 0.898379	valid_1's binary_logloss: 0.477426
[3]	valid_0's auc: 0.893991	valid_0's binary_logloss: 0.463908	valid_1's auc: 0.900966	valid_1's binary_logloss: 0.453477
[4]	valid_0's auc: 0.895536	valid_0's binary_logloss: 0.444506	valid_1's auc: 0.900916	valid_1's binary_logloss: 0.43446
[5]	valid_0's auc: 0.895846	valid_0's binary_logloss: 0.428496	valid_1's auc: 0.900658	valid_1's binary_logloss: 0.41849
[6]	valid_0's auc: 0.897167	valid_0's binary_logloss: 0.414703	valid_1's auc: 0.901702	valid_1's binary_logloss: 0.404942
[7]	valid_0's auc: 0.897784	valid_0's binary_logloss: 0.403095	valid_1's auc: 0.902279	valid_1's binary_logloss: 0.393273
[8]	valid_0's auc: 0.898713	valid_0's binary_logloss: 0.393054	valid_1's auc: 0.902347	valid_1's binary_logloss: 0.383885
[9]	valid_0's auc: 0.902294	valid_0's binary_logloss: 0.38416	valid_1's auc: 0.904294	valid_1's binary_logloss: 0.375629
[10]	valid_0's auc: 0.903355	valid_0's binary_logloss: 0.376336	valid_1's auc: 0.904676	valid_1's binary_logloss: 0.368481
[11]	valid_0's auc: 0.903988	valid_0's binary_logloss: 0.369543	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.362239
[12]	valid_0's auc: 0.904553	valid_0's binary_logloss: 0.363566	valid_1's auc: 0.904913	valid_1's binary_logloss: 0.356787
[13]	valid_0's auc: 0.905538	valid_0's binary_logloss: 0.35817	valid_1's auc: 0.905471	valid_1's binary_logloss: 0.351875
[14]	valid_0's auc: 0.906094	valid_0's binary_logloss: 0.353414	valid_1's auc: 0.90584	valid_1's binary_logloss: 0.347498
[15]	valid_0's auc: 0.906689	valid_0's binary_logloss: 0.349218	valid_1's auc: 0.905742	valid_1's binary_logloss: 0.344195
[16]	valid_0's auc: 0.907549	valid_0's binary_logloss: 0.345324	valid_1's auc: 0.905782	valid_1's binary_logloss: 0.341113
[17]	valid_0's auc: 0.908531	valid_0's binary_logloss: 0.341711	valid_1's auc: 0.906322	valid_1's binary_logloss: 0.338306
[18]	valid_0's auc: 0.909453	valid_0's binary_logloss: 0.338332	valid_1's auc: 0.906516	valid_1's binary_logloss: 0.335814
[19]	valid_0's auc: 0.910388	valid_0's binary_logloss: 0.33525	valid_1's auc: 0.906792	valid_1's binary_logloss: 0.333475
[20]	valid_0's auc: 0.911139	valid_0's binary_logloss: 0.332531	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.33174
[21]	valid_0's auc: 0.911701	valid_0's binary_logloss: 0.330035	valid_1's auc: 0.907003	valid_1's binary_logloss: 0.330016
[22]	valid_0's auc: 0.912346	valid_0's binary_logloss: 0.327668	valid_1's auc: 0.907381	valid_1's binary_logloss: 0.328148
[23]	valid_0's auc: 0.913149	valid_0's binary_logloss: 0.325309	valid_1's auc: 0.907966	valid_1's binary_logloss: 0.326408
[24]	valid_0's auc: 0.913783	valid_0's binary_logloss: 0.323223	valid_1's auc: 0.908068	valid_1's binary_logloss: 0.325125
[25]	valid_0's auc: 0.914402	valid_0's binary_logloss: 0.321208	valid_1's auc: 0.90856	valid_1's binary_logloss: 0.323593
[26]	valid_0's auc: 0.915043	valid_0's binary_logloss: 0.319422	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.322682
[27]	valid_0's auc: 0.915496	valid_0's binary_logloss: 0.317822	valid_1's auc: 0.90877	valid_1's binary_logloss: 0.321641
[28]	valid_0's auc: 0.916075	valid_0's binary_logloss: 0.316294	valid_1's auc: 0.90875	valid_1's binary_logloss: 0.321013
[29]	valid_0's auc: 0.916595	valid_0's binary_logloss: 0.314772	valid_1's auc: 0.908808	valid_1's binary_logloss: 0.320348
[30]	valid_0's auc: 0.917022	valid_0's binary_logloss: 0.313416	valid_1's auc: 0.908898	valid_1's binary_logloss: 0.319672
[31]	valid_0's auc: 0.917535	valid_0's binary_logloss: 0.31208	valid_1's auc: 0.909017	valid_1's binary_logloss: 0.319072
[32]	valid_0's auc: 0.918038	valid_0's binary_logloss: 0.310843	valid_1's auc: 0.908875	valid_1's binary_logloss: 0.318855
[33]	valid_0's auc: 0.918517	valid_0's binary_logloss: 0.3096	valid_1's auc: 0.908986	valid_1's binary_logloss: 0.318273
[34]	valid_0's auc: 0.919063	valid_0's binary_logloss: 0.308395	valid_1's auc: 0.908872	valid_1's binary_logloss: 0.318103
[35]	valid_0's auc: 0.91951	valid_0's binary_logloss: 0.307291	valid_1's auc: 0.908911	valid_1's binary_logloss: 0.317738
[36]	valid_0's auc: 0.919965	valid_0's binary_logloss: 0.306194	valid_1's auc: 0.909136	valid_1's binary_logloss: 0.317147
[37]	valid_0's auc: 0.920416	valid_0's binary_logloss: 0.30515	valid_1's auc: 0.909152	valid_1's binary_logloss: 0.316823
[38]	valid_0's auc: 0.920831	valid_0's binary_logloss: 0.304245	valid_1's auc: 0.909252	valid_1's binary_logloss: 0.316523
[39]	valid_0's auc: 0.921265	valid_0's binary_logloss: 0.303314	valid_1's auc: 0.909288	valid_1's binary_logloss: 0.316267
[40]	valid_0's auc: 0.921798	valid_0's binary_logloss: 0.30226	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.316199
[41]	valid_0's auc: 0.922235	valid_0's binary_logloss: 0.301311	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.315801
[42]	valid_0's auc: 0.922572	valid_0's binary_logloss: 0.300602	valid_1's auc: 0.909274	valid_1's binary_logloss: 0.3159
[43]	valid_0's auc: 0.922999	valid_0's binary_logloss: 0.299787	valid_1's auc: 0.909195	valid_1's binary_logloss: 0.315991
[44]	valid_0's auc: 0.923325	valid_0's binary_logloss: 0.299099	valid_1's auc: 0.909061	valid_1's binary_logloss: 0.316024
[45]	valid_0's auc: 0.92378	valid_0's binary_logloss: 0.298221	valid_1's auc: 0.909003	valid_1's binary_logloss: 0.315971
[46]	valid_0's auc: 0.924198	valid_0's binary_logloss: 0.297425	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.316146
[47]	valid_0's auc: 0.924591	valid_0's binary_logloss: 0.296645	valid_1's auc: 0.908847	valid_1's binary_logloss: 0.316098
[48]	valid_0's auc: 0.925021	valid_0's binary_logloss: 0.295803	valid_1's auc: 0.908896	valid_1's binary_logloss: 0.315979
[49]	valid_0's auc: 0.925344	valid_0's binary_logloss: 0.295139	valid_1's auc: 0.908958	valid_1's binary_logloss: 0.315833
[50]	valid_0's auc: 0.925711	valid_0's binary_logloss: 0.294445	valid_1's auc: 0.908883	valid_1's binary_logloss: 0.315863
[51]	valid_0's auc: 0.926134	valid_0's binary_logloss: 0.293662	valid_1's auc: 0.908882	valid_1's binary_logloss: 0.315842
[52]	valid_0's auc: 0.926471	valid_0's binary_logloss: 0.293008	valid_1's auc: 0.908751	valid_1's binary_logloss: 0.316001
[53]	valid_0's auc: 0.926798	valid_0's binary_logloss: 0.292391	valid_1's auc: 0.908831	valid_1's binary_logloss: 0.315821
[54]	valid_0's auc: 0.92719	valid_0's binary_logloss: 0.291686	valid_1's auc: 0.908765	valid_1's binary_logloss: 0.315895
[55]	valid_0's auc: 0.927649	valid_0's binary_logloss: 0.290885	valid_1's auc: 0.908759	valid_1's binary_logloss: 0.315868
[56]	valid_0's auc: 0.928015	valid_0's binary_logloss: 0.29023	valid_1's auc: 0.908856	valid_1's binary_logloss: 0.315779
[57]	valid_0's auc: 0.928312	valid_0's binary_logloss: 0.289624	valid_1's auc: 0.908909	valid_1's binary_logloss: 0.315678
[58]	valid_0's auc: 0.928693	valid_0's binary_logloss: 0.288987	valid_1's auc: 0.908728	valid_1's binary_logloss: 0.315955
[59]	valid_0's auc: 0.929068	valid_0's binary_logloss: 0.288364	valid_1's auc: 0.908633	valid_1's binary_logloss: 0.316082
[60]	valid_0's auc: 0.929442	valid_0's binary_logloss: 0.287648	valid_1's auc: 0.908658	valid_1's binary_logloss: 0.316001
[61]	valid_0's auc: 0.929719	valid_0's binary_logloss: 0.287091	valid_1's auc: 0.908664	valid_1's binary_logloss: 0.315935
[62]	valid_0's auc: 0.929943	valid_0's binary_logloss: 0.286678	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.316004
[63]	valid_0's auc: 0.930195	valid_0's binary_logloss: 0.286172	valid_1's auc: 0.908587	valid_1's binary_logloss: 0.316094
[64]	valid_0's auc: 0.930525	valid_0's binary_logloss: 0.285608	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.316014
[65]	valid_0's auc: 0.930875	valid_0's binary_logloss: 0.284978	valid_1's auc: 0.908549	valid_1's binary_logloss: 0.316138
[66]	valid_0's auc: 0.931114	valid_0's binary_logloss: 0.28457	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316151
[67]	valid_0's auc: 0.931399	valid_0's binary_logloss: 0.284016	valid_1's auc: 0.908584	valid_1's binary_logloss: 0.316178
[68]	valid_0's auc: 0.931655	valid_0's binary_logloss: 0.283564	valid_1's auc: 0.908412	valid_1's binary_logloss: 0.316372
[69]	valid_0's auc: 0.931887	valid_0's binary_logloss: 0.283125	valid_1's auc: 0.908355	valid_1's binary_logloss: 0.316468
[70]	valid_0's auc: 0.93209	valid_0's binary_logloss: 0.282749	valid_1's auc: 0.908316	valid_1's binary_logloss: 0.31653
[71]	valid_0's auc: 0.932465	valid_0's binary_logloss: 0.282071	valid_1's auc: 0.90832	valid_1's binary_logloss: 0.316509
[72]	valid_0's auc: 0.932768	valid_0's binary_logloss: 0.28151	valid_1's auc: 0.908351	valid_1's binary_logloss: 0.316488
[73]	valid_0's auc: 0.933005	valid_0's binary_logloss: 0.281039	valid_1's auc: 0.908397	valid_1's binary_logloss: 0.316454
[74]	valid_0's auc: 0.933259	valid_0's binary_logloss: 0.280612	valid_1's auc: 0.908471	valid_1's binary_logloss: 0.316327
[75]	valid_0's auc: 0.933525	valid_0's binary_logloss: 0.280111	valid_1's auc: 0.908311	valid_1's binary_logloss: 0.31663
[76]	valid_0's auc: 0.933839	valid_0's binary_logloss: 0.279555	valid_1's auc: 0.908217	valid_1's binary_logloss: 0.316788
[77]	valid_0's auc: 0.934096	valid_0's binary_logloss: 0.279074	valid_1's auc: 0.908172	valid_1's binary_logloss: 0.316825
[78]	valid_0's auc: 0.934302	valid_0's binary_logloss: 0.278656	valid_1's auc: 0.908185	valid_1's binary_logloss: 0.316797
[79]	valid_0's auc: 0.934605	valid_0's binary_logloss: 0.278155	valid_1's auc: 0.908095	valid_1's binary_logloss: 0.316939
[80]	valid_0's auc: 0.934868	valid_0's binary_logloss: 0.2777	valid_1's auc: 0.908094	valid_1's binary_logloss: 0.31692
[81]	valid_0's auc: 0.935205	valid_0's binary_logloss: 0.277142	valid_1's auc: 0.907901	valid_1's binary_logloss: 0.317311
[82]	valid_0's auc: 0.935573	valid_0's binary_logloss: 0.276519	valid_1's auc: 0.907832	valid_1's binary_logloss: 0.317418
[83]	valid_0's auc: 0.935848	valid_0's binary_logloss: 0.276	valid_1's auc: 0.907808	valid_1's binary_logloss: 0.317454
[84]	valid_0's auc: 0.936093	valid_0's binary_logloss: 0.275543	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317444
[85]	valid_0's auc: 0.936518	valid_0's binary_logloss: 0.274879	valid_1's auc: 0.907706	valid_1's binary_logloss: 0.317605
[86]	valid_0's auc: 0.936789	valid_0's binary_logloss: 0.274394	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.317734
[87]	valid_0's auc: 0.937064	valid_0's binary_logloss: 0.273916	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.317627
[88]	valid_0's auc: 0.937244	valid_0's binary_logloss: 0.273523	valid_1's auc: 0.907754	valid_1's binary_logloss: 0.317594
[89]	valid_0's auc: 0.937531	valid_0's binary_logloss: 0.273051	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.317848
[90]	valid_0's auc: 0.937747	valid_0's binary_logloss: 0.27268	valid_1's auc: 0.907483	valid_1's binary_logloss: 0.31802
[91]	valid_0's auc: 0.93796	valid_0's binary_logloss: 0.27231	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.318088
[92]	valid_0's auc: 0.938308	valid_0's binary_logloss: 0.27166	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.317964
[93]	valid_0's auc: 0.938491	valid_0's binary_logloss: 0.271333	valid_1's auc: 0.907391	valid_1's binary_logloss: 0.318083
[94]	valid_0's auc: 0.938708	valid_0's binary_logloss: 0.270911	valid_1's auc: 0.907417	valid_1's binary_logloss: 0.318069
[95]	valid_0's auc: 0.93896	valid_0's binary_logloss: 0.270452	valid_1's auc: 0.907262	valid_1's binary_logloss: 0.318298
[96]	valid_0's auc: 0.939215	valid_0's binary_logloss: 0.270028	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.31851
[97]	valid_0's auc: 0.939511	valid_0's binary_logloss: 0.269537	valid_1's auc: 0.907129	valid_1's binary_logloss: 0.318486
[98]	valid_0's auc: 0.939711	valid_0's binary_logloss: 0.269109	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.318631
[99]	valid_0's auc: 0.939877	valid_0's binary_logloss: 0.268782	valid_1's auc: 0.90712	valid_1's binary_logloss: 0.318655
[100]	valid_0's auc: 0.940203	valid_0's binary_logloss: 0.26826	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.318603
[101]	valid_0's auc: 0.940473	valid_0's binary_logloss: 0.267759	valid_1's auc: 0.907057	valid_1's binary_logloss: 0.318741
[102]	valid_0's auc: 0.94068	valid_0's binary_logloss: 0.26734	valid_1's auc: 0.907086	valid_1's binary_logloss: 0.318793
[103]	valid_0's auc: 0.940889	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318898
[104]	valid_0's auc: 0.941221	valid_0's binary_logloss: 0.266407	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318846
[105]	valid_0's auc: 0.941404	valid_0's binary_logloss: 0.266017	valid_1's auc: 0.907056	valid_1's binary_logloss: 0.318935
[106]	valid_0's auc: 0.94172	valid_0's binary_logloss: 0.265442	valid_1's auc: 0.907087	valid_1's binary_logloss: 0.318935
[107]	valid_0's auc: 0.941968	valid_0's binary_logloss: 0.264992	valid_1's auc: 0.907021	valid_1's binary_logloss: 0.319017
[108]	valid_0's auc: 0.942233	valid_0's binary_logloss: 0.264478	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318989
[109]	valid_0's auc: 0.942493	valid_0's binary_logloss: 0.264019	valid_1's auc: 0.90694	valid_1's binary_logloss: 0.319175
[110]	valid_0's auc: 0.942704	valid_0's binary_logloss: 0.263649	valid_1's auc: 0.907	valid_1's binary_logloss: 0.319115
[111]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.263159	valid_1's auc: 0.90698	valid_1's binary_logloss: 0.319181
[112]	valid_0's auc: 0.943153	valid_0's binary_logloss: 0.26276	valid_1's auc: 0.906966	valid_1's binary_logloss: 0.319242
[113]	valid_0's auc: 0.943292	valid_0's binary_logloss: 0.262487	valid_1's auc: 0.907006	valid_1's binary_logloss: 0.319192
[114]	valid_0's auc: 0.943514	valid_0's binary_logloss: 0.262081	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.319344
[115]	valid_0's auc: 0.943703	valid_0's binary_logloss: 0.26173	valid_1's auc: 0.906767	valid_1's binary_logloss: 0.319606
[116]	valid_0's auc: 0.943928	valid_0's binary_logloss: 0.261326	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.319582
[117]	valid_0's auc: 0.9443	valid_0's binary_logloss: 0.260724	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319615
[118]	valid_0's auc: 0.944467	valid_0's binary_logloss: 0.260414	valid_1's auc: 0.906726	valid_1's binary_logloss: 0.319779
[119]	valid_0's auc: 0.944721	valid_0's binary_logloss: 0.259961	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319723
[120]	valid_0's auc: 0.94495	valid_0's binary_logloss: 0.259572	valid_1's auc: 0.906774	valid_1's binary_logloss: 0.319723
[121]	valid_0's auc: 0.945156	valid_0's binary_logloss: 0.259202	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319684
[122]	valid_0's auc: 0.945388	valid_0's binary_logloss: 0.258753	valid_1's auc: 0.906637	valid_1's binary_logloss: 0.319998
[123]	valid_0's auc: 0.945604	valid_0's binary_logloss: 0.258362	valid_1's auc: 0.906691	valid_1's binary_logloss: 0.319913
[124]	valid_0's auc: 0.945776	valid_0's binary_logloss: 0.257989	valid_1's auc: 0.906667	valid_1's binary_logloss: 0.319942
[125]	valid_0's auc: 0.945941	valid_0's binary_logloss: 0.257616	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.320049
[126]	valid_0's auc: 0.946164	valid_0's binary_logloss: 0.257224	valid_1's auc: 0.906722	valid_1's binary_logloss: 0.319953
[127]	valid_0's auc: 0.946305	valid_0's binary_logloss: 0.256913	valid_1's auc: 0.906682	valid_1's binary_logloss: 0.320063
[128]	valid_0's auc: 0.946471	valid_0's binary_logloss: 0.256582	valid_1's auc: 0.90677	valid_1's binary_logloss: 0.319953
[129]	valid_0's auc: 0.946629	valid_0's binary_logloss: 0.256287	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.319891
[130]	valid_0's auc: 0.946769	valid_0's binary_logloss: 0.255949	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.319876
[131]	valid_0's auc: 0.946967	valid_0's binary_logloss: 0.255553	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.31996
[132]	valid_0's auc: 0.94711	valid_0's binary_logloss: 0.255266	valid_1's auc: 0.906756	valid_1's binary_logloss: 0.320022
[133]	valid_0's auc: 0.94727	valid_0's binary_logloss: 0.254965	valid_1's auc: 0.906635	valid_1's binary_logloss: 0.320259
[134]	valid_0's auc: 0.947436	valid_0's binary_logloss: 0.254656	valid_1's auc: 0.90662	valid_1's binary_logloss: 0.320315
[135]	valid_0's auc: 0.947634	valid_0's binary_logloss: 0.254281	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.320372
[136]	valid_0's auc: 0.947862	valid_0's binary_logloss: 0.253863	valid_1's auc: 0.906526	valid_1's binary_logloss: 0.320517
[137]	valid_0's auc: 0.948008	valid_0's binary_logloss: 0.253584	valid_1's auc: 0.90645	valid_1's binary_logloss: 0.320689
[138]	valid_0's auc: 0.948111	valid_0's binary_logloss: 0.253372	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.320812
[139]	valid_0's auc: 0.948282	valid_0's binary_logloss: 0.253044	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.320767
[140]	valid_0's auc: 0.948441	valid_0's binary_logloss: 0.252704	valid_1's auc: 0.906341	valid_1's binary_logloss: 0.320941
[141]	valid_0's auc: 0.948609	valid_0's binary_logloss: 0.252346	valid_1's auc: 0.906316	valid_1's binary_logloss: 0.32098
Early stopping, best iteration is:
[41]	valid_0's auc: 0.922235	valid_0's binary_logloss: 0.301311	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.315801
[1]	valid_0's auc: 0.888084	valid_0's binary_logloss: 0.516884	valid_1's auc: 0.893464	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.890797	valid_0's binary_logloss: 0.487718	valid_1's auc: 0.897592	valid_1's binary_logloss: 0.478465
[3]	valid_0's auc: 0.892513	valid_0's binary_logloss: 0.464334	valid_1's auc: 0.898665	valid_1's binary_logloss: 0.454805
[4]	valid_0's auc: 0.894815	valid_0's binary_logloss: 0.444821	valid_1's auc: 0.899433	valid_1's binary_logloss: 0.435394
[5]	valid_0's auc: 0.896021	valid_0's binary_logloss: 0.428702	valid_1's auc: 0.900021	valid_1's binary_logloss: 0.419476
[6]	valid_0's auc: 0.89928	valid_0's binary_logloss: 0.415058	valid_1's auc: 0.902649	valid_1's binary_logloss: 0.405991
[7]	valid_0's auc: 0.900439	valid_0's binary_logloss: 0.403201	valid_1's auc: 0.902605	valid_1's binary_logloss: 0.394544
[8]	valid_0's auc: 0.901538	valid_0's binary_logloss: 0.393166	valid_1's auc: 0.903058	valid_1's binary_logloss: 0.384843
[9]	valid_0's auc: 0.902204	valid_0's binary_logloss: 0.384401	valid_1's auc: 0.903156	valid_1's binary_logloss: 0.376624
[10]	valid_0's auc: 0.903221	valid_0's binary_logloss: 0.376758	valid_1's auc: 0.903175	valid_1's binary_logloss: 0.369696
[11]	valid_0's auc: 0.904073	valid_0's binary_logloss: 0.369858	valid_1's auc: 0.90337	valid_1's binary_logloss: 0.36353
[12]	valid_0's auc: 0.9048	valid_0's binary_logloss: 0.363903	valid_1's auc: 0.904	valid_1's binary_logloss: 0.357996
[13]	valid_0's auc: 0.905852	valid_0's binary_logloss: 0.358528	valid_1's auc: 0.904463	valid_1's binary_logloss: 0.353176
[14]	valid_0's auc: 0.906544	valid_0's binary_logloss: 0.353777	valid_1's auc: 0.904775	valid_1's binary_logloss: 0.348981
[15]	valid_0's auc: 0.907501	valid_0's binary_logloss: 0.349288	valid_1's auc: 0.905337	valid_1's binary_logloss: 0.345392
[16]	valid_0's auc: 0.908224	valid_0's binary_logloss: 0.345361	valid_1's auc: 0.905819	valid_1's binary_logloss: 0.341971
[17]	valid_0's auc: 0.908902	valid_0's binary_logloss: 0.341809	valid_1's auc: 0.905831	valid_1's binary_logloss: 0.339271
[18]	valid_0's auc: 0.909407	valid_0's binary_logloss: 0.338728	valid_1's auc: 0.906187	valid_1's binary_logloss: 0.336615
[19]	valid_0's auc: 0.910331	valid_0's binary_logloss: 0.33564	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.334456
[20]	valid_0's auc: 0.910901	valid_0's binary_logloss: 0.332967	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.332309
[21]	valid_0's auc: 0.911538	valid_0's binary_logloss: 0.330566	valid_1's auc: 0.906796	valid_1's binary_logloss: 0.330669
[22]	valid_0's auc: 0.912064	valid_0's binary_logloss: 0.328361	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.329121
[23]	valid_0's auc: 0.912925	valid_0's binary_logloss: 0.326059	valid_1's auc: 0.907201	valid_1's binary_logloss: 0.327725
[24]	valid_0's auc: 0.913563	valid_0's binary_logloss: 0.323897	valid_1's auc: 0.907387	valid_1's binary_logloss: 0.326225
[25]	valid_0's auc: 0.914114	valid_0's binary_logloss: 0.321942	valid_1's auc: 0.907471	valid_1's binary_logloss: 0.325043
[26]	valid_0's auc: 0.914789	valid_0's binary_logloss: 0.320035	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.323938
[27]	valid_0's auc: 0.915302	valid_0's binary_logloss: 0.318381	valid_1's auc: 0.907778	valid_1's binary_logloss: 0.323077
[28]	valid_0's auc: 0.915886	valid_0's binary_logloss: 0.316789	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.322489
[29]	valid_0's auc: 0.916429	valid_0's binary_logloss: 0.315265	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.321873
[30]	valid_0's auc: 0.916928	valid_0's binary_logloss: 0.31387	valid_1's auc: 0.907806	valid_1's binary_logloss: 0.321352
[31]	valid_0's auc: 0.917511	valid_0's binary_logloss: 0.312381	valid_1's auc: 0.907794	valid_1's binary_logloss: 0.320895
[32]	valid_0's auc: 0.918015	valid_0's binary_logloss: 0.311145	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.32053
[33]	valid_0's auc: 0.91845	valid_0's binary_logloss: 0.310021	valid_1's auc: 0.907609	valid_1's binary_logloss: 0.320356
[34]	valid_0's auc: 0.918921	valid_0's binary_logloss: 0.308899	valid_1's auc: 0.907826	valid_1's binary_logloss: 0.319775
[35]	valid_0's auc: 0.919308	valid_0's binary_logloss: 0.307855	valid_1's auc: 0.907768	valid_1's binary_logloss: 0.319476
[36]	valid_0's auc: 0.919805	valid_0's binary_logloss: 0.306715	valid_1's auc: 0.907844	valid_1's binary_logloss: 0.319122
[37]	valid_0's auc: 0.920348	valid_0's binary_logloss: 0.305579	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.318737
[38]	valid_0's auc: 0.920807	valid_0's binary_logloss: 0.304555	valid_1's auc: 0.907838	valid_1's binary_logloss: 0.318784
[39]	valid_0's auc: 0.921262	valid_0's binary_logloss: 0.303578	valid_1's auc: 0.907678	valid_1's binary_logloss: 0.318757
[40]	valid_0's auc: 0.921707	valid_0's binary_logloss: 0.302588	valid_1's auc: 0.907596	valid_1's binary_logloss: 0.318667
[41]	valid_0's auc: 0.922114	valid_0's binary_logloss: 0.301688	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.318239
[42]	valid_0's auc: 0.922529	valid_0's binary_logloss: 0.300838	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.318064
[43]	valid_0's auc: 0.922985	valid_0's binary_logloss: 0.299924	valid_1's auc: 0.90801	valid_1's binary_logloss: 0.317775
[44]	valid_0's auc: 0.923383	valid_0's binary_logloss: 0.299092	valid_1's auc: 0.908013	valid_1's binary_logloss: 0.317723
[45]	valid_0's auc: 0.923914	valid_0's binary_logloss: 0.298119	valid_1's auc: 0.907991	valid_1's binary_logloss: 0.317657
[46]	valid_0's auc: 0.924386	valid_0's binary_logloss: 0.297212	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.317781
[47]	valid_0's auc: 0.924774	valid_0's binary_logloss: 0.296431	valid_1's auc: 0.907865	valid_1's binary_logloss: 0.317707
[48]	valid_0's auc: 0.925146	valid_0's binary_logloss: 0.295696	valid_1's auc: 0.907926	valid_1's binary_logloss: 0.31754
[49]	valid_0's auc: 0.925516	valid_0's binary_logloss: 0.294958	valid_1's auc: 0.907873	valid_1's binary_logloss: 0.317542
[50]	valid_0's auc: 0.925986	valid_0's binary_logloss: 0.294127	valid_1's auc: 0.907885	valid_1's binary_logloss: 0.317515
[51]	valid_0's auc: 0.926312	valid_0's binary_logloss: 0.293523	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317471
[52]	valid_0's auc: 0.926741	valid_0's binary_logloss: 0.292742	valid_1's auc: 0.907799	valid_1's binary_logloss: 0.31751
[53]	valid_0's auc: 0.927092	valid_0's binary_logloss: 0.292078	valid_1's auc: 0.907732	valid_1's binary_logloss: 0.317638
[54]	valid_0's auc: 0.92744	valid_0's binary_logloss: 0.291451	valid_1's auc: 0.90771	valid_1's binary_logloss: 0.317642
[55]	valid_0's auc: 0.927765	valid_0's binary_logloss: 0.290866	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.317705
[56]	valid_0's auc: 0.928254	valid_0's binary_logloss: 0.289972	valid_1's auc: 0.907724	valid_1's binary_logloss: 0.31762
[57]	valid_0's auc: 0.928572	valid_0's binary_logloss: 0.289325	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.317749
[58]	valid_0's auc: 0.928965	valid_0's binary_logloss: 0.288633	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.317919
[59]	valid_0's auc: 0.929368	valid_0's binary_logloss: 0.287956	valid_1's auc: 0.907475	valid_1's binary_logloss: 0.318008
[60]	valid_0's auc: 0.929704	valid_0's binary_logloss: 0.287329	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.317828
[61]	valid_0's auc: 0.930026	valid_0's binary_logloss: 0.286738	valid_1's auc: 0.907415	valid_1's binary_logloss: 0.317995
[62]	valid_0's auc: 0.930409	valid_0's binary_logloss: 0.286062	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.317841
[63]	valid_0's auc: 0.930686	valid_0's binary_logloss: 0.285488	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.318049
[64]	valid_0's auc: 0.931059	valid_0's binary_logloss: 0.284877	valid_1's auc: 0.907311	valid_1's binary_logloss: 0.318123
[65]	valid_0's auc: 0.931373	valid_0's binary_logloss: 0.284345	valid_1's auc: 0.907205	valid_1's binary_logloss: 0.318273
[66]	valid_0's auc: 0.93178	valid_0's binary_logloss: 0.283652	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.318418
[67]	valid_0's auc: 0.932046	valid_0's binary_logloss: 0.283191	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.318417
[68]	valid_0's auc: 0.93229	valid_0's binary_logloss: 0.282725	valid_1's auc: 0.907069	valid_1's binary_logloss: 0.318517
[69]	valid_0's auc: 0.932661	valid_0's binary_logloss: 0.282121	valid_1's auc: 0.906982	valid_1's binary_logloss: 0.318625
[70]	valid_0's auc: 0.932897	valid_0's binary_logloss: 0.28165	valid_1's auc: 0.906921	valid_1's binary_logloss: 0.318681
[71]	valid_0's auc: 0.933215	valid_0's binary_logloss: 0.281043	valid_1's auc: 0.906813	valid_1's binary_logloss: 0.318939
[72]	valid_0's auc: 0.933442	valid_0's binary_logloss: 0.280642	valid_1's auc: 0.906759	valid_1's binary_logloss: 0.319031
[73]	valid_0's auc: 0.933735	valid_0's binary_logloss: 0.280128	valid_1's auc: 0.906549	valid_1's binary_logloss: 0.319396
[74]	valid_0's auc: 0.934121	valid_0's binary_logloss: 0.279416	valid_1's auc: 0.90652	valid_1's binary_logloss: 0.319441
[75]	valid_0's auc: 0.934286	valid_0's binary_logloss: 0.279035	valid_1's auc: 0.906406	valid_1's binary_logloss: 0.319626
[76]	valid_0's auc: 0.934571	valid_0's binary_logloss: 0.278551	valid_1's auc: 0.906384	valid_1's binary_logloss: 0.319644
[77]	valid_0's auc: 0.934872	valid_0's binary_logloss: 0.278005	valid_1's auc: 0.906309	valid_1's binary_logloss: 0.31982
[78]	valid_0's auc: 0.935121	valid_0's binary_logloss: 0.277536	valid_1's auc: 0.906198	valid_1's binary_logloss: 0.319929
[79]	valid_0's auc: 0.935425	valid_0's binary_logloss: 0.27698	valid_1's auc: 0.906197	valid_1's binary_logloss: 0.319938
[80]	valid_0's auc: 0.935736	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906125	valid_1's binary_logloss: 0.320044
[81]	valid_0's auc: 0.935994	valid_0's binary_logloss: 0.275992	valid_1's auc: 0.906202	valid_1's binary_logloss: 0.319931
[82]	valid_0's auc: 0.936332	valid_0's binary_logloss: 0.275423	valid_1's auc: 0.906158	valid_1's binary_logloss: 0.32006
[83]	valid_0's auc: 0.93661	valid_0's binary_logloss: 0.274908	valid_1's auc: 0.906093	valid_1's binary_logloss: 0.320157
[84]	valid_0's auc: 0.936918	valid_0's binary_logloss: 0.274391	valid_1's auc: 0.906084	valid_1's binary_logloss: 0.32019
[85]	valid_0's auc: 0.937157	valid_0's binary_logloss: 0.273987	valid_1's auc: 0.906027	valid_1's binary_logloss: 0.320301
[86]	valid_0's auc: 0.937427	valid_0's binary_logloss: 0.273487	valid_1's auc: 0.905973	valid_1's binary_logloss: 0.320477
[87]	valid_0's auc: 0.937686	valid_0's binary_logloss: 0.273034	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.320618
[88]	valid_0's auc: 0.937927	valid_0's binary_logloss: 0.272593	valid_1's auc: 0.905753	valid_1's binary_logloss: 0.320851
[89]	valid_0's auc: 0.938121	valid_0's binary_logloss: 0.272211	valid_1's auc: 0.9058	valid_1's binary_logloss: 0.32079
[90]	valid_0's auc: 0.938374	valid_0's binary_logloss: 0.271677	valid_1's auc: 0.905795	valid_1's binary_logloss: 0.320808
[91]	valid_0's auc: 0.938642	valid_0's binary_logloss: 0.271239	valid_1's auc: 0.905674	valid_1's binary_logloss: 0.320997
[92]	valid_0's auc: 0.938869	valid_0's binary_logloss: 0.270838	valid_1's auc: 0.905626	valid_1's binary_logloss: 0.321081
[93]	valid_0's auc: 0.939017	valid_0's binary_logloss: 0.27051	valid_1's auc: 0.90555	valid_1's binary_logloss: 0.321254
[94]	valid_0's auc: 0.939224	valid_0's binary_logloss: 0.270118	valid_1's auc: 0.905512	valid_1's binary_logloss: 0.321339
[95]	valid_0's auc: 0.939487	valid_0's binary_logloss: 0.269626	valid_1's auc: 0.905456	valid_1's binary_logloss: 0.321446
[96]	valid_0's auc: 0.939772	valid_0's binary_logloss: 0.269136	valid_1's auc: 0.905287	valid_1's binary_logloss: 0.321739
[97]	valid_0's auc: 0.940057	valid_0's binary_logloss: 0.268626	valid_1's auc: 0.905276	valid_1's binary_logloss: 0.32172
[98]	valid_0's auc: 0.940303	valid_0's binary_logloss: 0.268187	valid_1's auc: 0.905272	valid_1's binary_logloss: 0.321755
[99]	valid_0's auc: 0.940646	valid_0's binary_logloss: 0.267627	valid_1's auc: 0.905326	valid_1's binary_logloss: 0.321717
[100]	valid_0's auc: 0.940866	valid_0's binary_logloss: 0.267178	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.321552
[101]	valid_0's auc: 0.94118	valid_0's binary_logloss: 0.266647	valid_1's auc: 0.905366	valid_1's binary_logloss: 0.321575
[102]	valid_0's auc: 0.941385	valid_0's binary_logloss: 0.266276	valid_1's auc: 0.905295	valid_1's binary_logloss: 0.321719
[103]	valid_0's auc: 0.941591	valid_0's binary_logloss: 0.265882	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.32166
[104]	valid_0's auc: 0.941799	valid_0's binary_logloss: 0.265525	valid_1's auc: 0.905273	valid_1's binary_logloss: 0.321774
[105]	valid_0's auc: 0.941984	valid_0's binary_logloss: 0.265135	valid_1's auc: 0.905316	valid_1's binary_logloss: 0.321763
[106]	valid_0's auc: 0.942268	valid_0's binary_logloss: 0.26461	valid_1's auc: 0.905197	valid_1's binary_logloss: 0.321978
[107]	valid_0's auc: 0.942423	valid_0's binary_logloss: 0.264314	valid_1's auc: 0.905196	valid_1's binary_logloss: 0.322006
[108]	valid_0's auc: 0.942738	valid_0's binary_logloss: 0.263759	valid_1's auc: 0.905116	valid_1's binary_logloss: 0.322149
[109]	valid_0's auc: 0.942986	valid_0's binary_logloss: 0.263324	valid_1's auc: 0.905093	valid_1's binary_logloss: 0.322222
[110]	valid_0's auc: 0.94321	valid_0's binary_logloss: 0.262951	valid_1's auc: 0.905121	valid_1's binary_logloss: 0.322178
[111]	valid_0's auc: 0.943496	valid_0's binary_logloss: 0.262434	valid_1's auc: 0.905101	valid_1's binary_logloss: 0.322251
[112]	valid_0's auc: 0.943833	valid_0's binary_logloss: 0.261863	valid_1's auc: 0.904996	valid_1's binary_logloss: 0.322391
[113]	valid_0's auc: 0.944024	valid_0's binary_logloss: 0.261477	valid_1's auc: 0.905072	valid_1's binary_logloss: 0.322374
[114]	valid_0's auc: 0.944213	valid_0's binary_logloss: 0.261103	valid_1's auc: 0.905104	valid_1's binary_logloss: 0.322346
[115]	valid_0's auc: 0.944441	valid_0's binary_logloss: 0.260692	valid_1's auc: 0.904965	valid_1's binary_logloss: 0.322578
[116]	valid_0's auc: 0.944635	valid_0's binary_logloss: 0.260368	valid_1's auc: 0.904897	valid_1's binary_logloss: 0.322684
[117]	valid_0's auc: 0.944822	valid_0's binary_logloss: 0.260024	valid_1's auc: 0.904693	valid_1's binary_logloss: 0.32304
[118]	valid_0's auc: 0.94511	valid_0's binary_logloss: 0.259545	valid_1's auc: 0.904656	valid_1's binary_logloss: 0.323144
[119]	valid_0's auc: 0.945296	valid_0's binary_logloss: 0.259149	valid_1's auc: 0.904637	valid_1's binary_logloss: 0.323225
[120]	valid_0's auc: 0.945504	valid_0's binary_logloss: 0.258721	valid_1's auc: 0.904586	valid_1's binary_logloss: 0.323283
[121]	valid_0's auc: 0.945664	valid_0's binary_logloss: 0.258406	valid_1's auc: 0.90457	valid_1's binary_logloss: 0.323327
[122]	valid_0's auc: 0.945844	valid_0's binary_logloss: 0.258001	valid_1's auc: 0.904595	valid_1's binary_logloss: 0.323297
[123]	valid_0's auc: 0.946026	valid_0's binary_logloss: 0.257642	valid_1's auc: 0.90448	valid_1's binary_logloss: 0.323506
[124]	valid_0's auc: 0.946178	valid_0's binary_logloss: 0.257327	valid_1's auc: 0.904384	valid_1's binary_logloss: 0.323677
[125]	valid_0's auc: 0.946454	valid_0's binary_logloss: 0.256798	valid_1's auc: 0.904343	valid_1's binary_logloss: 0.32372
[126]	valid_0's auc: 0.946645	valid_0's binary_logloss: 0.256452	valid_1's auc: 0.904353	valid_1's binary_logloss: 0.323738
[127]	valid_0's auc: 0.946915	valid_0's binary_logloss: 0.25596	valid_1's auc: 0.904306	valid_1's binary_logloss: 0.323896
[128]	valid_0's auc: 0.947109	valid_0's binary_logloss: 0.255575	valid_1's auc: 0.904257	valid_1's binary_logloss: 0.324053
[129]	valid_0's auc: 0.947273	valid_0's binary_logloss: 0.255248	valid_1's auc: 0.90423	valid_1's binary_logloss: 0.324141
[130]	valid_0's auc: 0.947437	valid_0's binary_logloss: 0.25488	valid_1's auc: 0.90411	valid_1's binary_logloss: 0.324374
[131]	valid_0's auc: 0.947704	valid_0's binary_logloss: 0.254389	valid_1's auc: 0.904066	valid_1's binary_logloss: 0.324481
[132]	valid_0's auc: 0.947846	valid_0's binary_logloss: 0.254059	valid_1's auc: 0.904112	valid_1's binary_logloss: 0.324459
[133]	valid_0's auc: 0.947957	valid_0's binary_logloss: 0.253808	valid_1's auc: 0.904132	valid_1's binary_logloss: 0.324486
[134]	valid_0's auc: 0.948119	valid_0's binary_logloss: 0.253478	valid_1's auc: 0.904051	valid_1's binary_logloss: 0.324637
[135]	valid_0's auc: 0.948283	valid_0's binary_logloss: 0.253139	valid_1's auc: 0.904051	valid_1's binary_logloss: 0.324667
[136]	valid_0's auc: 0.948502	valid_0's binary_logloss: 0.252718	valid_1's auc: 0.903951	valid_1's binary_logloss: 0.324845
[137]	valid_0's auc: 0.948681	valid_0's binary_logloss: 0.252377	valid_1's auc: 0.904	valid_1's binary_logloss: 0.324791
Early stopping, best iteration is:
[37]	valid_0's auc: 0.920348	valid_0's binary_logloss: 0.305579	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.318737
[1]	valid_0's auc: 0.889368	valid_0's binary_logloss: 0.516586	valid_1's auc: 0.894755	valid_1's binary_logloss: 0.507927
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892369	valid_0's binary_logloss: 0.487665	valid_1's auc: 0.897729	valid_1's binary_logloss: 0.478425
[3]	valid_0's auc: 0.892766	valid_0's binary_logloss: 0.46459	valid_1's auc: 0.8987	valid_1's binary_logloss: 0.454891
[4]	valid_0's auc: 0.894658	valid_0's binary_logloss: 0.445432	valid_1's auc: 0.899309	valid_1's binary_logloss: 0.435927
[5]	valid_0's auc: 0.897216	valid_0's binary_logloss: 0.429343	valid_1's auc: 0.901673	valid_1's binary_logloss: 0.420055
[6]	valid_0's auc: 0.898836	valid_0's binary_logloss: 0.415681	valid_1's auc: 0.902175	valid_1's binary_logloss: 0.40664
[7]	valid_0's auc: 0.900089	valid_0's binary_logloss: 0.403962	valid_1's auc: 0.903133	valid_1's binary_logloss: 0.394925
[8]	valid_0's auc: 0.900532	valid_0's binary_logloss: 0.393959	valid_1's auc: 0.903189	valid_1's binary_logloss: 0.38526
[9]	valid_0's auc: 0.90162	valid_0's binary_logloss: 0.385233	valid_1's auc: 0.903527	valid_1's binary_logloss: 0.376973
[10]	valid_0's auc: 0.902597	valid_0's binary_logloss: 0.377488	valid_1's auc: 0.904084	valid_1's binary_logloss: 0.369513
[11]	valid_0's auc: 0.903448	valid_0's binary_logloss: 0.370593	valid_1's auc: 0.904405	valid_1's binary_logloss: 0.363339
[12]	valid_0's auc: 0.904159	valid_0's binary_logloss: 0.364575	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.357511
[13]	valid_0's auc: 0.905188	valid_0's binary_logloss: 0.359049	valid_1's auc: 0.90489	valid_1's binary_logloss: 0.352976
[14]	valid_0's auc: 0.906232	valid_0's binary_logloss: 0.354214	valid_1's auc: 0.905694	valid_1's binary_logloss: 0.348766
[15]	valid_0's auc: 0.907064	valid_0's binary_logloss: 0.349752	valid_1's auc: 0.906	valid_1's binary_logloss: 0.345008
[16]	valid_0's auc: 0.907672	valid_0's binary_logloss: 0.345873	valid_1's auc: 0.906296	valid_1's binary_logloss: 0.341642
[17]	valid_0's auc: 0.908271	valid_0's binary_logloss: 0.342309	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.338823
[18]	valid_0's auc: 0.908856	valid_0's binary_logloss: 0.339122	valid_1's auc: 0.906701	valid_1's binary_logloss: 0.336075
[19]	valid_0's auc: 0.909543	valid_0's binary_logloss: 0.336192	valid_1's auc: 0.906874	valid_1's binary_logloss: 0.333942
[20]	valid_0's auc: 0.910416	valid_0's binary_logloss: 0.333478	valid_1's auc: 0.906872	valid_1's binary_logloss: 0.332148
[21]	valid_0's auc: 0.91127	valid_0's binary_logloss: 0.330816	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.330312
[22]	valid_0's auc: 0.912058	valid_0's binary_logloss: 0.328411	valid_1's auc: 0.907372	valid_1's binary_logloss: 0.328658
[23]	valid_0's auc: 0.912907	valid_0's binary_logloss: 0.326138	valid_1's auc: 0.907641	valid_1's binary_logloss: 0.327096
[24]	valid_0's auc: 0.913473	valid_0's binary_logloss: 0.324164	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.326288
[25]	valid_0's auc: 0.914108	valid_0's binary_logloss: 0.322166	valid_1's auc: 0.907385	valid_1's binary_logloss: 0.32546
[26]	valid_0's auc: 0.914696	valid_0's binary_logloss: 0.320381	valid_1's auc: 0.907403	valid_1's binary_logloss: 0.324472
[27]	valid_0's auc: 0.915158	valid_0's binary_logloss: 0.318795	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.32357
[28]	valid_0's auc: 0.91573	valid_0's binary_logloss: 0.317165	valid_1's auc: 0.907544	valid_1's binary_logloss: 0.322983
[29]	valid_0's auc: 0.916189	valid_0's binary_logloss: 0.315738	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.322455
[30]	valid_0's auc: 0.916727	valid_0's binary_logloss: 0.314301	valid_1's auc: 0.907422	valid_1's binary_logloss: 0.321875
[31]	valid_0's auc: 0.917217	valid_0's binary_logloss: 0.312989	valid_1's auc: 0.907551	valid_1's binary_logloss: 0.32122
[32]	valid_0's auc: 0.917797	valid_0's binary_logloss: 0.311606	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.320726
[33]	valid_0's auc: 0.918274	valid_0's binary_logloss: 0.310392	valid_1's auc: 0.907869	valid_1's binary_logloss: 0.320007
[34]	valid_0's auc: 0.918693	valid_0's binary_logloss: 0.309224	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.319938
[35]	valid_0's auc: 0.919148	valid_0's binary_logloss: 0.308196	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.319657
[36]	valid_0's auc: 0.919629	valid_0's binary_logloss: 0.307029	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.319287
[37]	valid_0's auc: 0.920158	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.908025	valid_1's binary_logloss: 0.318715
[38]	valid_0's auc: 0.920674	valid_0's binary_logloss: 0.304723	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.318922
[39]	valid_0's auc: 0.921239	valid_0's binary_logloss: 0.303593	valid_1's auc: 0.907878	valid_1's binary_logloss: 0.318525
[40]	valid_0's auc: 0.921706	valid_0's binary_logloss: 0.302626	valid_1's auc: 0.907802	valid_1's binary_logloss: 0.318457
[41]	valid_0's auc: 0.922045	valid_0's binary_logloss: 0.301855	valid_1's auc: 0.907764	valid_1's binary_logloss: 0.318334
[42]	valid_0's auc: 0.922468	valid_0's binary_logloss: 0.300998	valid_1's auc: 0.907744	valid_1's binary_logloss: 0.318211
[43]	valid_0's auc: 0.922945	valid_0's binary_logloss: 0.300015	valid_1's auc: 0.90774	valid_1's binary_logloss: 0.318093
[44]	valid_0's auc: 0.923477	valid_0's binary_logloss: 0.299056	valid_1's auc: 0.907786	valid_1's binary_logloss: 0.317972
[45]	valid_0's auc: 0.923964	valid_0's binary_logloss: 0.298128	valid_1's auc: 0.907558	valid_1's binary_logloss: 0.318191
[46]	valid_0's auc: 0.924329	valid_0's binary_logloss: 0.297415	valid_1's auc: 0.907528	valid_1's binary_logloss: 0.318185
[47]	valid_0's auc: 0.924714	valid_0's binary_logloss: 0.296685	valid_1's auc: 0.907595	valid_1's binary_logloss: 0.318006
[48]	valid_0's auc: 0.925165	valid_0's binary_logloss: 0.295875	valid_1's auc: 0.907453	valid_1's binary_logloss: 0.31824
[49]	valid_0's auc: 0.925591	valid_0's binary_logloss: 0.295065	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.318089
[50]	valid_0's auc: 0.926003	valid_0's binary_logloss: 0.294311	valid_1's auc: 0.90743	valid_1's binary_logloss: 0.318114
[51]	valid_0's auc: 0.926309	valid_0's binary_logloss: 0.293756	valid_1's auc: 0.907375	valid_1's binary_logloss: 0.318176
[52]	valid_0's auc: 0.926581	valid_0's binary_logloss: 0.293181	valid_1's auc: 0.907285	valid_1's binary_logloss: 0.318236
[53]	valid_0's auc: 0.926944	valid_0's binary_logloss: 0.292552	valid_1's auc: 0.907206	valid_1's binary_logloss: 0.318333
[54]	valid_0's auc: 0.927379	valid_0's binary_logloss: 0.291721	valid_1's auc: 0.907175	valid_1's binary_logloss: 0.31834
[55]	valid_0's auc: 0.92778	valid_0's binary_logloss: 0.290938	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.318328
[56]	valid_0's auc: 0.928268	valid_0's binary_logloss: 0.290128	valid_1's auc: 0.907274	valid_1's binary_logloss: 0.318221
[57]	valid_0's auc: 0.928602	valid_0's binary_logloss: 0.289473	valid_1's auc: 0.90711	valid_1's binary_logloss: 0.318429
[58]	valid_0's auc: 0.928945	valid_0's binary_logloss: 0.288826	valid_1's auc: 0.907094	valid_1's binary_logloss: 0.318435
[59]	valid_0's auc: 0.929299	valid_0's binary_logloss: 0.288133	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.31856
[60]	valid_0's auc: 0.929594	valid_0's binary_logloss: 0.287577	valid_1's auc: 0.906921	valid_1's binary_logloss: 0.318777
[61]	valid_0's auc: 0.929936	valid_0's binary_logloss: 0.286981	valid_1's auc: 0.906934	valid_1's binary_logloss: 0.318758
[62]	valid_0's auc: 0.930341	valid_0's binary_logloss: 0.286294	valid_1's auc: 0.906959	valid_1's binary_logloss: 0.318671
[63]	valid_0's auc: 0.930701	valid_0's binary_logloss: 0.28571	valid_1's auc: 0.906845	valid_1's binary_logloss: 0.318827
[64]	valid_0's auc: 0.931027	valid_0's binary_logloss: 0.285194	valid_1's auc: 0.907008	valid_1's binary_logloss: 0.318618
[65]	valid_0's auc: 0.93137	valid_0's binary_logloss: 0.284569	valid_1's auc: 0.906978	valid_1's binary_logloss: 0.318649
[66]	valid_0's auc: 0.93171	valid_0's binary_logloss: 0.28403	valid_1's auc: 0.906917	valid_1's binary_logloss: 0.318746
[67]	valid_0's auc: 0.93215	valid_0's binary_logloss: 0.283252	valid_1's auc: 0.906974	valid_1's binary_logloss: 0.318687
[68]	valid_0's auc: 0.932576	valid_0's binary_logloss: 0.282564	valid_1's auc: 0.907068	valid_1's binary_logloss: 0.31854
[69]	valid_0's auc: 0.932778	valid_0's binary_logloss: 0.282152	valid_1's auc: 0.906998	valid_1's binary_logloss: 0.318608
[70]	valid_0's auc: 0.933085	valid_0's binary_logloss: 0.281627	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.318669
[71]	valid_0's auc: 0.933325	valid_0's binary_logloss: 0.281227	valid_1's auc: 0.906884	valid_1's binary_logloss: 0.318785
[72]	valid_0's auc: 0.933634	valid_0's binary_logloss: 0.280704	valid_1's auc: 0.906882	valid_1's binary_logloss: 0.318808
[73]	valid_0's auc: 0.933952	valid_0's binary_logloss: 0.280094	valid_1's auc: 0.906972	valid_1's binary_logloss: 0.318713
[74]	valid_0's auc: 0.934222	valid_0's binary_logloss: 0.279644	valid_1's auc: 0.906952	valid_1's binary_logloss: 0.318799
[75]	valid_0's auc: 0.934557	valid_0's binary_logloss: 0.279044	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.318774
[76]	valid_0's auc: 0.934883	valid_0's binary_logloss: 0.278441	valid_1's auc: 0.906946	valid_1's binary_logloss: 0.318828
[77]	valid_0's auc: 0.935142	valid_0's binary_logloss: 0.277971	valid_1's auc: 0.906915	valid_1's binary_logloss: 0.318898
[78]	valid_0's auc: 0.93547	valid_0's binary_logloss: 0.277388	valid_1's auc: 0.906852	valid_1's binary_logloss: 0.319009
[79]	valid_0's auc: 0.935717	valid_0's binary_logloss: 0.276937	valid_1's auc: 0.906777	valid_1's binary_logloss: 0.31913
[80]	valid_0's auc: 0.936009	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906808	valid_1's binary_logloss: 0.319077
[81]	valid_0's auc: 0.936198	valid_0's binary_logloss: 0.275991	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319142
[82]	valid_0's auc: 0.936431	valid_0's binary_logloss: 0.275586	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319203
[83]	valid_0's auc: 0.936679	valid_0's binary_logloss: 0.275138	valid_1's auc: 0.906844	valid_1's binary_logloss: 0.319048
[84]	valid_0's auc: 0.936859	valid_0's binary_logloss: 0.274783	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.319184
[85]	valid_0's auc: 0.937212	valid_0's binary_logloss: 0.274225	valid_1's auc: 0.906784	valid_1's binary_logloss: 0.319198
[86]	valid_0's auc: 0.937396	valid_0's binary_logloss: 0.273909	valid_1's auc: 0.906694	valid_1's binary_logloss: 0.319329
[87]	valid_0's auc: 0.937538	valid_0's binary_logloss: 0.273597	valid_1's auc: 0.906589	valid_1's binary_logloss: 0.319518
[88]	valid_0's auc: 0.937806	valid_0's binary_logloss: 0.273111	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.319743
[89]	valid_0's auc: 0.938039	valid_0's binary_logloss: 0.272705	valid_1's auc: 0.906481	valid_1's binary_logloss: 0.319789
[90]	valid_0's auc: 0.938327	valid_0's binary_logloss: 0.272167	valid_1's auc: 0.906613	valid_1's binary_logloss: 0.319544
[91]	valid_0's auc: 0.938599	valid_0's binary_logloss: 0.271706	valid_1's auc: 0.906555	valid_1's binary_logloss: 0.319683
[92]	valid_0's auc: 0.938844	valid_0's binary_logloss: 0.271234	valid_1's auc: 0.90654	valid_1's binary_logloss: 0.319728
[93]	valid_0's auc: 0.939121	valid_0's binary_logloss: 0.270696	valid_1's auc: 0.906492	valid_1's binary_logloss: 0.319837
[94]	valid_0's auc: 0.939311	valid_0's binary_logloss: 0.270377	valid_1's auc: 0.906368	valid_1's binary_logloss: 0.320008
[95]	valid_0's auc: 0.939657	valid_0's binary_logloss: 0.26978	valid_1's auc: 0.906359	valid_1's binary_logloss: 0.320036
[96]	valid_0's auc: 0.939933	valid_0's binary_logloss: 0.269328	valid_1's auc: 0.906318	valid_1's binary_logloss: 0.320097
[97]	valid_0's auc: 0.940166	valid_0's binary_logloss: 0.268916	valid_1's auc: 0.906173	valid_1's binary_logloss: 0.320362
[98]	valid_0's auc: 0.940413	valid_0's binary_logloss: 0.268496	valid_1's auc: 0.906144	valid_1's binary_logloss: 0.32044
[99]	valid_0's auc: 0.940628	valid_0's binary_logloss: 0.268094	valid_1's auc: 0.906022	valid_1's binary_logloss: 0.320614
[100]	valid_0's auc: 0.94077	valid_0's binary_logloss: 0.267774	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.320727
[101]	valid_0's auc: 0.94096	valid_0's binary_logloss: 0.267447	valid_1's auc: 0.90588	valid_1's binary_logloss: 0.320857
[102]	valid_0's auc: 0.941258	valid_0's binary_logloss: 0.266905	valid_1's auc: 0.90597	valid_1's binary_logloss: 0.320784
[103]	valid_0's auc: 0.941404	valid_0's binary_logloss: 0.266627	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320962
[104]	valid_0's auc: 0.94156	valid_0's binary_logloss: 0.26628	valid_1's auc: 0.905887	valid_1's binary_logloss: 0.320925
[105]	valid_0's auc: 0.941895	valid_0's binary_logloss: 0.265711	valid_1's auc: 0.905826	valid_1's binary_logloss: 0.321047
[106]	valid_0's auc: 0.94212	valid_0's binary_logloss: 0.265292	valid_1's auc: 0.905776	valid_1's binary_logloss: 0.321147
[107]	valid_0's auc: 0.942351	valid_0's binary_logloss: 0.264829	valid_1's auc: 0.90572	valid_1's binary_logloss: 0.321204
[108]	valid_0's auc: 0.942527	valid_0's binary_logloss: 0.264476	valid_1's auc: 0.905697	valid_1's binary_logloss: 0.32131
[109]	valid_0's auc: 0.94265	valid_0's binary_logloss: 0.264188	valid_1's auc: 0.905669	valid_1's binary_logloss: 0.321424
[110]	valid_0's auc: 0.942938	valid_0's binary_logloss: 0.263728	valid_1's auc: 0.905559	valid_1's binary_logloss: 0.32161
[111]	valid_0's auc: 0.943184	valid_0's binary_logloss: 0.263289	valid_1's auc: 0.905523	valid_1's binary_logloss: 0.321687
[112]	valid_0's auc: 0.943352	valid_0's binary_logloss: 0.262989	valid_1's auc: 0.905508	valid_1's binary_logloss: 0.321697
[113]	valid_0's auc: 0.943656	valid_0's binary_logloss: 0.262433	valid_1's auc: 0.905432	valid_1's binary_logloss: 0.321894
[114]	valid_0's auc: 0.943874	valid_0's binary_logloss: 0.26202	valid_1's auc: 0.905393	valid_1's binary_logloss: 0.321994
[115]	valid_0's auc: 0.944119	valid_0's binary_logloss: 0.261566	valid_1's auc: 0.905339	valid_1's binary_logloss: 0.322064
[116]	valid_0's auc: 0.944369	valid_0's binary_logloss: 0.261098	valid_1's auc: 0.90529	valid_1's binary_logloss: 0.322207
[117]	valid_0's auc: 0.944572	valid_0's binary_logloss: 0.260704	valid_1's auc: 0.905309	valid_1's binary_logloss: 0.322161
[118]	valid_0's auc: 0.944924	valid_0's binary_logloss: 0.260097	valid_1's auc: 0.905288	valid_1's binary_logloss: 0.322143
[119]	valid_0's auc: 0.945099	valid_0's binary_logloss: 0.259768	valid_1's auc: 0.90523	valid_1's binary_logloss: 0.322276
[120]	valid_0's auc: 0.945306	valid_0's binary_logloss: 0.259357	valid_1's auc: 0.905203	valid_1's binary_logloss: 0.322354
[121]	valid_0's auc: 0.945487	valid_0's binary_logloss: 0.25896	valid_1's auc: 0.905123	valid_1's binary_logloss: 0.32252
[122]	valid_0's auc: 0.945649	valid_0's binary_logloss: 0.258639	valid_1's auc: 0.905076	valid_1's binary_logloss: 0.322578
[123]	valid_0's auc: 0.945922	valid_0's binary_logloss: 0.258143	valid_1's auc: 0.904989	valid_1's binary_logloss: 0.322731
[124]	valid_0's auc: 0.946047	valid_0's binary_logloss: 0.257895	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.32298
[125]	valid_0's auc: 0.946249	valid_0's binary_logloss: 0.25751	valid_1's auc: 0.904847	valid_1's binary_logloss: 0.323002
[126]	valid_0's auc: 0.946452	valid_0's binary_logloss: 0.257121	valid_1's auc: 0.904875	valid_1's binary_logloss: 0.323026
[127]	valid_0's auc: 0.94668	valid_0's binary_logloss: 0.256726	valid_1's auc: 0.904895	valid_1's binary_logloss: 0.32304
[128]	valid_0's auc: 0.946935	valid_0's binary_logloss: 0.256281	valid_1's auc: 0.904816	valid_1's binary_logloss: 0.323196
[129]	valid_0's auc: 0.947147	valid_0's binary_logloss: 0.2559	valid_1's auc: 0.904844	valid_1's binary_logloss: 0.32313
[130]	valid_0's auc: 0.94747	valid_0's binary_logloss: 0.255357	valid_1's auc: 0.904834	valid_1's binary_logloss: 0.323239
[131]	valid_0's auc: 0.947605	valid_0's binary_logloss: 0.255058	valid_1's auc: 0.904737	valid_1's binary_logloss: 0.323445
[132]	valid_0's auc: 0.947859	valid_0's binary_logloss: 0.254552	valid_1's auc: 0.904659	valid_1's binary_logloss: 0.323639
[133]	valid_0's auc: 0.948036	valid_0's binary_logloss: 0.254216	valid_1's auc: 0.904707	valid_1's binary_logloss: 0.323537
[134]	valid_0's auc: 0.948191	valid_0's binary_logloss: 0.253896	valid_1's auc: 0.904633	valid_1's binary_logloss: 0.323696
[135]	valid_0's auc: 0.948351	valid_0's binary_logloss: 0.253571	valid_1's auc: 0.904561	valid_1's binary_logloss: 0.323838
[136]	valid_0's auc: 0.948467	valid_0's binary_logloss: 0.253313	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.323974
[137]	valid_0's auc: 0.948648	valid_0's binary_logloss: 0.252992	valid_1's auc: 0.904473	valid_1's binary_logloss: 0.324006
Early stopping, best iteration is:
[37]	valid_0's auc: 0.920158	valid_0's binary_logloss: 0.305835	valid_1's auc: 0.908025	valid_1's binary_logloss: 0.318715
[1]	valid_0's auc: 0.888568	valid_0's binary_logloss: 0.517232	valid_1's auc: 0.893169	valid_1's binary_logloss: 0.508727
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893525	valid_0's binary_logloss: 0.48805	valid_1's auc: 0.898612	valid_1's binary_logloss: 0.479079
[3]	valid_0's auc: 0.895098	valid_0's binary_logloss: 0.465044	valid_1's auc: 0.899666	valid_1's binary_logloss: 0.45542
[4]	valid_0's auc: 0.897204	valid_0's binary_logloss: 0.445626	valid_1's auc: 0.9009	valid_1's binary_logloss: 0.436065
[5]	valid_0's auc: 0.898082	valid_0's binary_logloss: 0.429582	valid_1's auc: 0.901179	valid_1's binary_logloss: 0.420084
[6]	valid_0's auc: 0.899115	valid_0's binary_logloss: 0.416064	valid_1's auc: 0.902064	valid_1's binary_logloss: 0.406467
[7]	valid_0's auc: 0.900214	valid_0's binary_logloss: 0.404266	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.394517
[8]	valid_0's auc: 0.901071	valid_0's binary_logloss: 0.394186	valid_1's auc: 0.904674	valid_1's binary_logloss: 0.384528
[9]	valid_0's auc: 0.902053	valid_0's binary_logloss: 0.3852	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.375991
[10]	valid_0's auc: 0.902655	valid_0's binary_logloss: 0.377691	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.368542
[11]	valid_0's auc: 0.903721	valid_0's binary_logloss: 0.370845	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.36216
[12]	valid_0's auc: 0.90431	valid_0's binary_logloss: 0.364817	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.356697
[13]	valid_0's auc: 0.904899	valid_0's binary_logloss: 0.359461	valid_1's auc: 0.906267	valid_1's binary_logloss: 0.351973
[14]	valid_0's auc: 0.905407	valid_0's binary_logloss: 0.354683	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.347605
[15]	valid_0's auc: 0.906465	valid_0's binary_logloss: 0.350386	valid_1's auc: 0.906783	valid_1's binary_logloss: 0.343947
[16]	valid_0's auc: 0.90723	valid_0's binary_logloss: 0.34651	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.340617
[17]	valid_0's auc: 0.908007	valid_0's binary_logloss: 0.342861	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.337651
[18]	valid_0's auc: 0.908692	valid_0's binary_logloss: 0.33958	valid_1's auc: 0.907925	valid_1's binary_logloss: 0.334813
[19]	valid_0's auc: 0.909248	valid_0's binary_logloss: 0.336732	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.33248
[20]	valid_0's auc: 0.909698	valid_0's binary_logloss: 0.334193	valid_1's auc: 0.90825	valid_1's binary_logloss: 0.330503
[21]	valid_0's auc: 0.91022	valid_0's binary_logloss: 0.331805	valid_1's auc: 0.908195	valid_1's binary_logloss: 0.328873
[22]	valid_0's auc: 0.910723	valid_0's binary_logloss: 0.329569	valid_1's auc: 0.908173	valid_1's binary_logloss: 0.327318
[23]	valid_0's auc: 0.911334	valid_0's binary_logloss: 0.327545	valid_1's auc: 0.908426	valid_1's binary_logloss: 0.325928
[24]	valid_0's auc: 0.91178	valid_0's binary_logloss: 0.325766	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.324527
[25]	valid_0's auc: 0.91235	valid_0's binary_logloss: 0.323882	valid_1's auc: 0.908703	valid_1's binary_logloss: 0.323296
[26]	valid_0's auc: 0.912875	valid_0's binary_logloss: 0.322191	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.322266
[27]	valid_0's auc: 0.913446	valid_0's binary_logloss: 0.320582	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.321188
[28]	valid_0's auc: 0.914021	valid_0's binary_logloss: 0.319007	valid_1's auc: 0.909064	valid_1's binary_logloss: 0.32064
[29]	valid_0's auc: 0.91453	valid_0's binary_logloss: 0.317563	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.319928
[30]	valid_0's auc: 0.914988	valid_0's binary_logloss: 0.316258	valid_1's auc: 0.909158	valid_1's binary_logloss: 0.319377
[31]	valid_0's auc: 0.915447	valid_0's binary_logloss: 0.315014	valid_1's auc: 0.909234	valid_1's binary_logloss: 0.318836
[32]	valid_0's auc: 0.916004	valid_0's binary_logloss: 0.313704	valid_1's auc: 0.909233	valid_1's binary_logloss: 0.31843
[33]	valid_0's auc: 0.916516	valid_0's binary_logloss: 0.312524	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.318038
[34]	valid_0's auc: 0.91702	valid_0's binary_logloss: 0.311323	valid_1's auc: 0.909333	valid_1's binary_logloss: 0.317683
[35]	valid_0's auc: 0.917566	valid_0's binary_logloss: 0.310179	valid_1's auc: 0.909391	valid_1's binary_logloss: 0.317375
[36]	valid_0's auc: 0.918038	valid_0's binary_logloss: 0.309089	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.316991
[37]	valid_0's auc: 0.918548	valid_0's binary_logloss: 0.307977	valid_1's auc: 0.909601	valid_1's binary_logloss: 0.316524
[38]	valid_0's auc: 0.918885	valid_0's binary_logloss: 0.307146	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.316283
[39]	valid_0's auc: 0.919367	valid_0's binary_logloss: 0.306119	valid_1's auc: 0.909652	valid_1's binary_logloss: 0.316007
[40]	valid_0's auc: 0.919749	valid_0's binary_logloss: 0.305228	valid_1's auc: 0.909725	valid_1's binary_logloss: 0.315747
[41]	valid_0's auc: 0.920216	valid_0's binary_logloss: 0.30429	valid_1's auc: 0.909649	valid_1's binary_logloss: 0.315732
[42]	valid_0's auc: 0.920589	valid_0's binary_logloss: 0.303533	valid_1's auc: 0.90952	valid_1's binary_logloss: 0.315782
[43]	valid_0's auc: 0.920984	valid_0's binary_logloss: 0.302712	valid_1's auc: 0.909372	valid_1's binary_logloss: 0.315902
[44]	valid_0's auc: 0.921338	valid_0's binary_logloss: 0.3019	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.315604
[45]	valid_0's auc: 0.921725	valid_0's binary_logloss: 0.301141	valid_1's auc: 0.909425	valid_1's binary_logloss: 0.315596
[46]	valid_0's auc: 0.922081	valid_0's binary_logloss: 0.300415	valid_1's auc: 0.90946	valid_1's binary_logloss: 0.315457
[47]	valid_0's auc: 0.922412	valid_0's binary_logloss: 0.299754	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.315529
[48]	valid_0's auc: 0.922782	valid_0's binary_logloss: 0.299103	valid_1's auc: 0.909121	valid_1's binary_logloss: 0.315671
[49]	valid_0's auc: 0.923196	valid_0's binary_logloss: 0.29834	valid_1's auc: 0.909155	valid_1's binary_logloss: 0.31552
[50]	valid_0's auc: 0.923549	valid_0's binary_logloss: 0.297628	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.315421
[51]	valid_0's auc: 0.923941	valid_0's binary_logloss: 0.296895	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.315448
[52]	valid_0's auc: 0.924314	valid_0's binary_logloss: 0.296236	valid_1's auc: 0.908949	valid_1's binary_logloss: 0.315646
[53]	valid_0's auc: 0.924737	valid_0's binary_logloss: 0.295473	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.315416
[54]	valid_0's auc: 0.925168	valid_0's binary_logloss: 0.294633	valid_1's auc: 0.908931	valid_1's binary_logloss: 0.315562
[55]	valid_0's auc: 0.925498	valid_0's binary_logloss: 0.294016	valid_1's auc: 0.908971	valid_1's binary_logloss: 0.315559
[56]	valid_0's auc: 0.925901	valid_0's binary_logloss: 0.293289	valid_1's auc: 0.908801	valid_1's binary_logloss: 0.315821
[57]	valid_0's auc: 0.92623	valid_0's binary_logloss: 0.292643	valid_1's auc: 0.908779	valid_1's binary_logloss: 0.315833
[58]	valid_0's auc: 0.926543	valid_0's binary_logloss: 0.29212	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315941
[59]	valid_0's auc: 0.926888	valid_0's binary_logloss: 0.291566	valid_1's auc: 0.908583	valid_1's binary_logloss: 0.31607
[60]	valid_0's auc: 0.927169	valid_0's binary_logloss: 0.291117	valid_1's auc: 0.908554	valid_1's binary_logloss: 0.316048
[61]	valid_0's auc: 0.927454	valid_0's binary_logloss: 0.290517	valid_1's auc: 0.908558	valid_1's binary_logloss: 0.316007
[62]	valid_0's auc: 0.927686	valid_0's binary_logloss: 0.290063	valid_1's auc: 0.90859	valid_1's binary_logloss: 0.31599
[63]	valid_0's auc: 0.928046	valid_0's binary_logloss: 0.289469	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.316305
[64]	valid_0's auc: 0.928376	valid_0's binary_logloss: 0.288875	valid_1's auc: 0.90836	valid_1's binary_logloss: 0.316349
[65]	valid_0's auc: 0.928633	valid_0's binary_logloss: 0.288338	valid_1's auc: 0.908259	valid_1's binary_logloss: 0.316569
[66]	valid_0's auc: 0.928954	valid_0's binary_logloss: 0.287815	valid_1's auc: 0.90832	valid_1's binary_logloss: 0.316501
[67]	valid_0's auc: 0.929233	valid_0's binary_logloss: 0.287287	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.31656
[68]	valid_0's auc: 0.929571	valid_0's binary_logloss: 0.28666	valid_1's auc: 0.908133	valid_1's binary_logloss: 0.316776
[69]	valid_0's auc: 0.929856	valid_0's binary_logloss: 0.286114	valid_1's auc: 0.908088	valid_1's binary_logloss: 0.316866
[70]	valid_0's auc: 0.930184	valid_0's binary_logloss: 0.285584	valid_1's auc: 0.90802	valid_1's binary_logloss: 0.316989
[71]	valid_0's auc: 0.930529	valid_0's binary_logloss: 0.285011	valid_1's auc: 0.908058	valid_1's binary_logloss: 0.316974
[72]	valid_0's auc: 0.930783	valid_0's binary_logloss: 0.284524	valid_1's auc: 0.90794	valid_1's binary_logloss: 0.317187
[73]	valid_0's auc: 0.931083	valid_0's binary_logloss: 0.284038	valid_1's auc: 0.907841	valid_1's binary_logloss: 0.317356
[74]	valid_0's auc: 0.931406	valid_0's binary_logloss: 0.283502	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.317357
[75]	valid_0's auc: 0.931698	valid_0's binary_logloss: 0.282958	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317616
[76]	valid_0's auc: 0.931924	valid_0's binary_logloss: 0.282539	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.317652
[77]	valid_0's auc: 0.932272	valid_0's binary_logloss: 0.281918	valid_1's auc: 0.907864	valid_1's binary_logloss: 0.317496
[78]	valid_0's auc: 0.932529	valid_0's binary_logloss: 0.281459	valid_1's auc: 0.907837	valid_1's binary_logloss: 0.317524
[79]	valid_0's auc: 0.932777	valid_0's binary_logloss: 0.280976	valid_1's auc: 0.907785	valid_1's binary_logloss: 0.317682
[80]	valid_0's auc: 0.933025	valid_0's binary_logloss: 0.280538	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.31785
[81]	valid_0's auc: 0.933401	valid_0's binary_logloss: 0.27989	valid_1's auc: 0.907718	valid_1's binary_logloss: 0.317857
[82]	valid_0's auc: 0.933653	valid_0's binary_logloss: 0.279474	valid_1's auc: 0.907695	valid_1's binary_logloss: 0.317885
[83]	valid_0's auc: 0.933921	valid_0's binary_logloss: 0.279015	valid_1's auc: 0.907548	valid_1's binary_logloss: 0.318127
[84]	valid_0's auc: 0.934172	valid_0's binary_logloss: 0.278523	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.318307
[85]	valid_0's auc: 0.934368	valid_0's binary_logloss: 0.278154	valid_1's auc: 0.907452	valid_1's binary_logloss: 0.318312
[86]	valid_0's auc: 0.934622	valid_0's binary_logloss: 0.27768	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.318351
[87]	valid_0's auc: 0.93483	valid_0's binary_logloss: 0.277274	valid_1's auc: 0.907422	valid_1's binary_logloss: 0.318387
[88]	valid_0's auc: 0.935025	valid_0's binary_logloss: 0.276861	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.318575
[89]	valid_0's auc: 0.935292	valid_0's binary_logloss: 0.276402	valid_1's auc: 0.907318	valid_1's binary_logloss: 0.31869
[90]	valid_0's auc: 0.935489	valid_0's binary_logloss: 0.276036	valid_1's auc: 0.90726	valid_1's binary_logloss: 0.318867
[91]	valid_0's auc: 0.935864	valid_0's binary_logloss: 0.275448	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318928
[92]	valid_0's auc: 0.93618	valid_0's binary_logloss: 0.274905	valid_1's auc: 0.90716	valid_1's binary_logloss: 0.319065
[93]	valid_0's auc: 0.936423	valid_0's binary_logloss: 0.274453	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.319289
[94]	valid_0's auc: 0.936622	valid_0's binary_logloss: 0.274081	valid_1's auc: 0.907072	valid_1's binary_logloss: 0.319305
[95]	valid_0's auc: 0.93684	valid_0's binary_logloss: 0.273698	valid_1's auc: 0.906984	valid_1's binary_logloss: 0.319519
[96]	valid_0's auc: 0.937158	valid_0's binary_logloss: 0.273182	valid_1's auc: 0.906961	valid_1's binary_logloss: 0.319533
[97]	valid_0's auc: 0.937508	valid_0's binary_logloss: 0.272642	valid_1's auc: 0.907048	valid_1's binary_logloss: 0.319444
[98]	valid_0's auc: 0.937766	valid_0's binary_logloss: 0.272201	valid_1's auc: 0.906996	valid_1's binary_logloss: 0.319517
[99]	valid_0's auc: 0.938093	valid_0's binary_logloss: 0.27166	valid_1's auc: 0.907079	valid_1's binary_logloss: 0.319328
[100]	valid_0's auc: 0.938316	valid_0's binary_logloss: 0.271276	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.319272
[101]	valid_0's auc: 0.938685	valid_0's binary_logloss: 0.270675	valid_1's auc: 0.907051	valid_1's binary_logloss: 0.319412
[102]	valid_0's auc: 0.938854	valid_0's binary_logloss: 0.270319	valid_1's auc: 0.906996	valid_1's binary_logloss: 0.319541
[103]	valid_0's auc: 0.939072	valid_0's binary_logloss: 0.269918	valid_1's auc: 0.907042	valid_1's binary_logloss: 0.319459
[104]	valid_0's auc: 0.939259	valid_0's binary_logloss: 0.269535	valid_1's auc: 0.907049	valid_1's binary_logloss: 0.319452
[105]	valid_0's auc: 0.9395	valid_0's binary_logloss: 0.269118	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.319529
[106]	valid_0's auc: 0.939727	valid_0's binary_logloss: 0.268749	valid_1's auc: 0.906955	valid_1's binary_logloss: 0.319585
[107]	valid_0's auc: 0.939951	valid_0's binary_logloss: 0.268335	valid_1's auc: 0.906967	valid_1's binary_logloss: 0.319561
[108]	valid_0's auc: 0.940218	valid_0's binary_logloss: 0.267897	valid_1's auc: 0.906929	valid_1's binary_logloss: 0.319586
[109]	valid_0's auc: 0.940443	valid_0's binary_logloss: 0.267477	valid_1's auc: 0.906794	valid_1's binary_logloss: 0.319827
[110]	valid_0's auc: 0.940665	valid_0's binary_logloss: 0.267096	valid_1's auc: 0.906686	valid_1's binary_logloss: 0.320009
[111]	valid_0's auc: 0.940924	valid_0's binary_logloss: 0.266638	valid_1's auc: 0.906588	valid_1's binary_logloss: 0.320188
[112]	valid_0's auc: 0.941144	valid_0's binary_logloss: 0.266195	valid_1's auc: 0.906551	valid_1's binary_logloss: 0.320262
[113]	valid_0's auc: 0.941297	valid_0's binary_logloss: 0.265856	valid_1's auc: 0.906429	valid_1's binary_logloss: 0.320505
[114]	valid_0's auc: 0.941472	valid_0's binary_logloss: 0.265543	valid_1's auc: 0.906324	valid_1's binary_logloss: 0.320688
[115]	valid_0's auc: 0.941633	valid_0's binary_logloss: 0.265209	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.320763
[116]	valid_0's auc: 0.941829	valid_0's binary_logloss: 0.264854	valid_1's auc: 0.90625	valid_1's binary_logloss: 0.320848
[117]	valid_0's auc: 0.942026	valid_0's binary_logloss: 0.264496	valid_1's auc: 0.906236	valid_1's binary_logloss: 0.320909
[118]	valid_0's auc: 0.942307	valid_0's binary_logloss: 0.263948	valid_1's auc: 0.906279	valid_1's binary_logloss: 0.320901
[119]	valid_0's auc: 0.94248	valid_0's binary_logloss: 0.263622	valid_1's auc: 0.90622	valid_1's binary_logloss: 0.320999
[120]	valid_0's auc: 0.942622	valid_0's binary_logloss: 0.263312	valid_1's auc: 0.906155	valid_1's binary_logloss: 0.321122
[121]	valid_0's auc: 0.942807	valid_0's binary_logloss: 0.262989	valid_1's auc: 0.906068	valid_1's binary_logloss: 0.321307
[122]	valid_0's auc: 0.943073	valid_0's binary_logloss: 0.262508	valid_1's auc: 0.905986	valid_1's binary_logloss: 0.321427
[123]	valid_0's auc: 0.943236	valid_0's binary_logloss: 0.262206	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.321715
[124]	valid_0's auc: 0.943388	valid_0's binary_logloss: 0.261939	valid_1's auc: 0.905734	valid_1's binary_logloss: 0.321929
[125]	valid_0's auc: 0.943552	valid_0's binary_logloss: 0.261623	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.321994
[126]	valid_0's auc: 0.943737	valid_0's binary_logloss: 0.261277	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.322007
[127]	valid_0's auc: 0.943997	valid_0's binary_logloss: 0.260789	valid_1's auc: 0.90577	valid_1's binary_logloss: 0.321959
[128]	valid_0's auc: 0.94416	valid_0's binary_logloss: 0.260495	valid_1's auc: 0.905721	valid_1's binary_logloss: 0.322057
[129]	valid_0's auc: 0.944396	valid_0's binary_logloss: 0.260085	valid_1's auc: 0.905682	valid_1's binary_logloss: 0.322132
[130]	valid_0's auc: 0.944561	valid_0's binary_logloss: 0.259764	valid_1's auc: 0.905672	valid_1's binary_logloss: 0.322187
[131]	valid_0's auc: 0.944717	valid_0's binary_logloss: 0.259469	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.32237
[132]	valid_0's auc: 0.94496	valid_0's binary_logloss: 0.259057	valid_1's auc: 0.905533	valid_1's binary_logloss: 0.32246
[133]	valid_0's auc: 0.945113	valid_0's binary_logloss: 0.258753	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.322625
[134]	valid_0's auc: 0.945346	valid_0's binary_logloss: 0.258341	valid_1's auc: 0.905439	valid_1's binary_logloss: 0.322656
[135]	valid_0's auc: 0.945527	valid_0's binary_logloss: 0.257972	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322833
[136]	valid_0's auc: 0.945729	valid_0's binary_logloss: 0.257624	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322849
[137]	valid_0's auc: 0.945899	valid_0's binary_logloss: 0.257286	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.323046
[138]	valid_0's auc: 0.946053	valid_0's binary_logloss: 0.257007	valid_1's auc: 0.905287	valid_1's binary_logloss: 0.3231
[139]	valid_0's auc: 0.946249	valid_0's binary_logloss: 0.256674	valid_1's auc: 0.905247	valid_1's binary_logloss: 0.323165
[140]	valid_0's auc: 0.94644	valid_0's binary_logloss: 0.256355	valid_1's auc: 0.905202	valid_1's binary_logloss: 0.323247
Early stopping, best iteration is:
[40]	valid_0's auc: 0.919749	valid_0's binary_logloss: 0.305228	valid_1's auc: 0.909725	valid_1's binary_logloss: 0.315747
[1]	valid_0's auc: 0.883999	valid_0's binary_logloss: 0.517495	valid_1's auc: 0.891234	valid_1's binary_logloss: 0.508616
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891027	valid_0's binary_logloss: 0.488825	valid_1's auc: 0.896641	valid_1's binary_logloss: 0.479157
[3]	valid_0's auc: 0.894951	valid_0's binary_logloss: 0.465291	valid_1's auc: 0.899671	valid_1's binary_logloss: 0.455294
[4]	valid_0's auc: 0.89606	valid_0's binary_logloss: 0.4462	valid_1's auc: 0.900601	valid_1's binary_logloss: 0.435941
[5]	valid_0's auc: 0.897345	valid_0's binary_logloss: 0.43003	valid_1's auc: 0.900711	valid_1's binary_logloss: 0.419873
[6]	valid_0's auc: 0.898499	valid_0's binary_logloss: 0.41635	valid_1's auc: 0.901767	valid_1's binary_logloss: 0.406108
[7]	valid_0's auc: 0.89983	valid_0's binary_logloss: 0.404494	valid_1's auc: 0.903447	valid_1's binary_logloss: 0.394511
[8]	valid_0's auc: 0.900425	valid_0's binary_logloss: 0.394452	valid_1's auc: 0.903731	valid_1's binary_logloss: 0.38466
[9]	valid_0's auc: 0.901201	valid_0's binary_logloss: 0.385617	valid_1's auc: 0.903911	valid_1's binary_logloss: 0.376198
[10]	valid_0's auc: 0.901776	valid_0's binary_logloss: 0.378074	valid_1's auc: 0.904371	valid_1's binary_logloss: 0.368708
[11]	valid_0's auc: 0.902544	valid_0's binary_logloss: 0.37121	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.362032
[12]	valid_0's auc: 0.90366	valid_0's binary_logloss: 0.364887	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.356476
[13]	valid_0's auc: 0.904305	valid_0's binary_logloss: 0.359711	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.351728
[14]	valid_0's auc: 0.905262	valid_0's binary_logloss: 0.354826	valid_1's auc: 0.906348	valid_1's binary_logloss: 0.347409
[15]	valid_0's auc: 0.90587	valid_0's binary_logloss: 0.350644	valid_1's auc: 0.906499	valid_1's binary_logloss: 0.343687
[16]	valid_0's auc: 0.90626	valid_0's binary_logloss: 0.347097	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.34054
[17]	valid_0's auc: 0.906847	valid_0's binary_logloss: 0.343667	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.337566
[18]	valid_0's auc: 0.907604	valid_0's binary_logloss: 0.340382	valid_1's auc: 0.907072	valid_1's binary_logloss: 0.334917
[19]	valid_0's auc: 0.908469	valid_0's binary_logloss: 0.337526	valid_1's auc: 0.907472	valid_1's binary_logloss: 0.332813
[20]	valid_0's auc: 0.909106	valid_0's binary_logloss: 0.334823	valid_1's auc: 0.908123	valid_1's binary_logloss: 0.330379
[21]	valid_0's auc: 0.90983	valid_0's binary_logloss: 0.332275	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.328609
[22]	valid_0's auc: 0.910423	valid_0's binary_logloss: 0.330039	valid_1's auc: 0.908273	valid_1's binary_logloss: 0.327082
[23]	valid_0's auc: 0.911024	valid_0's binary_logloss: 0.327868	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.325315
[24]	valid_0's auc: 0.911643	valid_0's binary_logloss: 0.325822	valid_1's auc: 0.908721	valid_1's binary_logloss: 0.323958
[25]	valid_0's auc: 0.912262	valid_0's binary_logloss: 0.323893	valid_1's auc: 0.908958	valid_1's binary_logloss: 0.322623
[26]	valid_0's auc: 0.912921	valid_0's binary_logloss: 0.3221	valid_1's auc: 0.909061	valid_1's binary_logloss: 0.321584
[27]	valid_0's auc: 0.913534	valid_0's binary_logloss: 0.320456	valid_1's auc: 0.90905	valid_1's binary_logloss: 0.320858
[28]	valid_0's auc: 0.914054	valid_0's binary_logloss: 0.318955	valid_1's auc: 0.909104	valid_1's binary_logloss: 0.320027
[29]	valid_0's auc: 0.914615	valid_0's binary_logloss: 0.317458	valid_1's auc: 0.909226	valid_1's binary_logloss: 0.319309
[30]	valid_0's auc: 0.915149	valid_0's binary_logloss: 0.31606	valid_1's auc: 0.909254	valid_1's binary_logloss: 0.318635
[31]	valid_0's auc: 0.915747	valid_0's binary_logloss: 0.314594	valid_1's auc: 0.909271	valid_1's binary_logloss: 0.318097
[32]	valid_0's auc: 0.916292	valid_0's binary_logloss: 0.313305	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.317534
[33]	valid_0's auc: 0.916726	valid_0's binary_logloss: 0.312095	valid_1's auc: 0.909305	valid_1's binary_logloss: 0.317174
[34]	valid_0's auc: 0.917118	valid_0's binary_logloss: 0.311005	valid_1's auc: 0.909362	valid_1's binary_logloss: 0.316755
[35]	valid_0's auc: 0.917654	valid_0's binary_logloss: 0.309841	valid_1's auc: 0.909523	valid_1's binary_logloss: 0.316201
[36]	valid_0's auc: 0.918039	valid_0's binary_logloss: 0.308913	valid_1's auc: 0.909495	valid_1's binary_logloss: 0.315974
[37]	valid_0's auc: 0.918497	valid_0's binary_logloss: 0.307924	valid_1's auc: 0.909609	valid_1's binary_logloss: 0.315616
[38]	valid_0's auc: 0.918861	valid_0's binary_logloss: 0.307015	valid_1's auc: 0.90966	valid_1's binary_logloss: 0.315252
[39]	valid_0's auc: 0.919305	valid_0's binary_logloss: 0.306077	valid_1's auc: 0.9097	valid_1's binary_logloss: 0.31504
[40]	valid_0's auc: 0.919842	valid_0's binary_logloss: 0.304975	valid_1's auc: 0.909724	valid_1's binary_logloss: 0.314742
[41]	valid_0's auc: 0.920194	valid_0's binary_logloss: 0.304166	valid_1's auc: 0.909677	valid_1's binary_logloss: 0.314676
[42]	valid_0's auc: 0.920645	valid_0's binary_logloss: 0.303277	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.31463
[43]	valid_0's auc: 0.921103	valid_0's binary_logloss: 0.302336	valid_1's auc: 0.909543	valid_1's binary_logloss: 0.31457
[44]	valid_0's auc: 0.921552	valid_0's binary_logloss: 0.30149	valid_1's auc: 0.909581	valid_1's binary_logloss: 0.314423
[45]	valid_0's auc: 0.921975	valid_0's binary_logloss: 0.3007	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314297
[46]	valid_0's auc: 0.922381	valid_0's binary_logloss: 0.299954	valid_1's auc: 0.909694	valid_1's binary_logloss: 0.314123
[47]	valid_0's auc: 0.922765	valid_0's binary_logloss: 0.299204	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.314006
[48]	valid_0's auc: 0.923109	valid_0's binary_logloss: 0.298492	valid_1's auc: 0.909707	valid_1's binary_logloss: 0.313963
[49]	valid_0's auc: 0.923454	valid_0's binary_logloss: 0.29784	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.314144
[50]	valid_0's auc: 0.92376	valid_0's binary_logloss: 0.297246	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.314209
[51]	valid_0's auc: 0.924082	valid_0's binary_logloss: 0.29663	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.314088
[52]	valid_0's auc: 0.924329	valid_0's binary_logloss: 0.296142	valid_1's auc: 0.909446	valid_1's binary_logloss: 0.314043
[53]	valid_0's auc: 0.924595	valid_0's binary_logloss: 0.295611	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.314055
[54]	valid_0's auc: 0.92491	valid_0's binary_logloss: 0.295061	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.314111
[55]	valid_0's auc: 0.925307	valid_0's binary_logloss: 0.294373	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314066
[56]	valid_0's auc: 0.925698	valid_0's binary_logloss: 0.293631	valid_1's auc: 0.90932	valid_1's binary_logloss: 0.314162
[57]	valid_0's auc: 0.925986	valid_0's binary_logloss: 0.293135	valid_1's auc: 0.909261	valid_1's binary_logloss: 0.314255
[58]	valid_0's auc: 0.926295	valid_0's binary_logloss: 0.292596	valid_1's auc: 0.909408	valid_1's binary_logloss: 0.314055
[59]	valid_0's auc: 0.926545	valid_0's binary_logloss: 0.292118	valid_1's auc: 0.909387	valid_1's binary_logloss: 0.314014
[60]	valid_0's auc: 0.926869	valid_0's binary_logloss: 0.291548	valid_1's auc: 0.909413	valid_1's binary_logloss: 0.313946
[61]	valid_0's auc: 0.927234	valid_0's binary_logloss: 0.290915	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.313924
[62]	valid_0's auc: 0.927591	valid_0's binary_logloss: 0.290293	valid_1's auc: 0.909518	valid_1's binary_logloss: 0.313753
[63]	valid_0's auc: 0.927831	valid_0's binary_logloss: 0.289853	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.313747
[64]	valid_0's auc: 0.928174	valid_0's binary_logloss: 0.289295	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.313782
[65]	valid_0's auc: 0.928503	valid_0's binary_logloss: 0.288717	valid_1's auc: 0.909415	valid_1's binary_logloss: 0.313939
[66]	valid_0's auc: 0.928851	valid_0's binary_logloss: 0.288131	valid_1's auc: 0.909229	valid_1's binary_logloss: 0.314234
[67]	valid_0's auc: 0.929135	valid_0's binary_logloss: 0.287573	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.314477
[68]	valid_0's auc: 0.929417	valid_0's binary_logloss: 0.287112	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.314477
[69]	valid_0's auc: 0.929673	valid_0's binary_logloss: 0.286648	valid_1's auc: 0.909105	valid_1's binary_logloss: 0.314483
[70]	valid_0's auc: 0.930026	valid_0's binary_logloss: 0.286086	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.314447
[71]	valid_0's auc: 0.930255	valid_0's binary_logloss: 0.28571	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.314559
[72]	valid_0's auc: 0.930527	valid_0's binary_logloss: 0.285169	valid_1's auc: 0.909039	valid_1's binary_logloss: 0.314641
[73]	valid_0's auc: 0.930882	valid_0's binary_logloss: 0.284592	valid_1's auc: 0.908972	valid_1's binary_logloss: 0.314707
[74]	valid_0's auc: 0.931139	valid_0's binary_logloss: 0.284128	valid_1's auc: 0.90892	valid_1's binary_logloss: 0.314808
[75]	valid_0's auc: 0.931483	valid_0's binary_logloss: 0.283549	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.31458
[76]	valid_0's auc: 0.93174	valid_0's binary_logloss: 0.283101	valid_1's auc: 0.909032	valid_1's binary_logloss: 0.31467
[77]	valid_0's auc: 0.931984	valid_0's binary_logloss: 0.282697	valid_1's auc: 0.908881	valid_1's binary_logloss: 0.314923
[78]	valid_0's auc: 0.932301	valid_0's binary_logloss: 0.282171	valid_1's auc: 0.908969	valid_1's binary_logloss: 0.31482
[79]	valid_0's auc: 0.932517	valid_0's binary_logloss: 0.281766	valid_1's auc: 0.909031	valid_1's binary_logloss: 0.314659
[80]	valid_0's auc: 0.932839	valid_0's binary_logloss: 0.28119	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.314988
[81]	valid_0's auc: 0.933145	valid_0's binary_logloss: 0.280682	valid_1's auc: 0.908778	valid_1's binary_logloss: 0.315094
[82]	valid_0's auc: 0.93335	valid_0's binary_logloss: 0.280305	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315242
[83]	valid_0's auc: 0.93357	valid_0's binary_logloss: 0.279883	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.315283
[84]	valid_0's auc: 0.933798	valid_0's binary_logloss: 0.279454	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.315352
[85]	valid_0's auc: 0.934027	valid_0's binary_logloss: 0.279023	valid_1's auc: 0.908448	valid_1's binary_logloss: 0.315584
[86]	valid_0's auc: 0.934253	valid_0's binary_logloss: 0.278627	valid_1's auc: 0.908499	valid_1's binary_logloss: 0.31554
[87]	valid_0's auc: 0.93445	valid_0's binary_logloss: 0.278291	valid_1's auc: 0.908427	valid_1's binary_logloss: 0.31566
[88]	valid_0's auc: 0.934636	valid_0's binary_logloss: 0.277902	valid_1's auc: 0.908313	valid_1's binary_logloss: 0.315875
[89]	valid_0's auc: 0.934867	valid_0's binary_logloss: 0.277492	valid_1's auc: 0.908145	valid_1's binary_logloss: 0.316125
[90]	valid_0's auc: 0.935013	valid_0's binary_logloss: 0.277229	valid_1's auc: 0.908102	valid_1's binary_logloss: 0.316176
[91]	valid_0's auc: 0.935185	valid_0's binary_logloss: 0.276894	valid_1's auc: 0.907975	valid_1's binary_logloss: 0.316406
[92]	valid_0's auc: 0.935491	valid_0's binary_logloss: 0.276378	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.316545
[93]	valid_0's auc: 0.935705	valid_0's binary_logloss: 0.276021	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.316647
[94]	valid_0's auc: 0.935893	valid_0's binary_logloss: 0.275673	valid_1's auc: 0.907684	valid_1's binary_logloss: 0.316884
[95]	valid_0's auc: 0.936121	valid_0's binary_logloss: 0.27527	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.316825
[96]	valid_0's auc: 0.936335	valid_0's binary_logloss: 0.274856	valid_1's auc: 0.907792	valid_1's binary_logloss: 0.316714
[97]	valid_0's auc: 0.936654	valid_0's binary_logloss: 0.274315	valid_1's auc: 0.907797	valid_1's binary_logloss: 0.316697
[98]	valid_0's auc: 0.93684	valid_0's binary_logloss: 0.274	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.316729
[99]	valid_0's auc: 0.937135	valid_0's binary_logloss: 0.273447	valid_1's auc: 0.907729	valid_1's binary_logloss: 0.316844
[100]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272838	valid_1's auc: 0.907638	valid_1's binary_logloss: 0.317007
[101]	valid_0's auc: 0.937768	valid_0's binary_logloss: 0.272395	valid_1's auc: 0.907606	valid_1's binary_logloss: 0.317068
[102]	valid_0's auc: 0.938083	valid_0's binary_logloss: 0.271866	valid_1's auc: 0.907462	valid_1's binary_logloss: 0.317305
[103]	valid_0's auc: 0.938339	valid_0's binary_logloss: 0.271383	valid_1's auc: 0.90754	valid_1's binary_logloss: 0.317201
[104]	valid_0's auc: 0.938592	valid_0's binary_logloss: 0.270937	valid_1's auc: 0.907428	valid_1's binary_logloss: 0.317424
[105]	valid_0's auc: 0.938803	valid_0's binary_logloss: 0.270598	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.31741
[106]	valid_0's auc: 0.939002	valid_0's binary_logloss: 0.270226	valid_1's auc: 0.907431	valid_1's binary_logloss: 0.317448
[107]	valid_0's auc: 0.9392	valid_0's binary_logloss: 0.269848	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.317597
[108]	valid_0's auc: 0.939455	valid_0's binary_logloss: 0.269355	valid_1's auc: 0.907366	valid_1's binary_logloss: 0.317527
[109]	valid_0's auc: 0.939727	valid_0's binary_logloss: 0.268848	valid_1's auc: 0.90739	valid_1's binary_logloss: 0.317498
[110]	valid_0's auc: 0.939978	valid_0's binary_logloss: 0.268406	valid_1's auc: 0.907261	valid_1's binary_logloss: 0.317713
[111]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267974	valid_1's auc: 0.907306	valid_1's binary_logloss: 0.317642
[112]	valid_0's auc: 0.940455	valid_0's binary_logloss: 0.267546	valid_1's auc: 0.90728	valid_1's binary_logloss: 0.317691
[113]	valid_0's auc: 0.940599	valid_0's binary_logloss: 0.267244	valid_1's auc: 0.907165	valid_1's binary_logloss: 0.317902
[114]	valid_0's auc: 0.940778	valid_0's binary_logloss: 0.266903	valid_1's auc: 0.907167	valid_1's binary_logloss: 0.317886
[115]	valid_0's auc: 0.940995	valid_0's binary_logloss: 0.266529	valid_1's auc: 0.907159	valid_1's binary_logloss: 0.317887
[116]	valid_0's auc: 0.941195	valid_0's binary_logloss: 0.266162	valid_1's auc: 0.907224	valid_1's binary_logloss: 0.317838
[117]	valid_0's auc: 0.941428	valid_0's binary_logloss: 0.265734	valid_1's auc: 0.907207	valid_1's binary_logloss: 0.317847
[118]	valid_0's auc: 0.941639	valid_0's binary_logloss: 0.265375	valid_1's auc: 0.90719	valid_1's binary_logloss: 0.317875
[119]	valid_0's auc: 0.941856	valid_0's binary_logloss: 0.265012	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.318061
[120]	valid_0's auc: 0.94203	valid_0's binary_logloss: 0.26467	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.318208
[121]	valid_0's auc: 0.942154	valid_0's binary_logloss: 0.264407	valid_1's auc: 0.907031	valid_1's binary_logloss: 0.318237
[122]	valid_0's auc: 0.942301	valid_0's binary_logloss: 0.264163	valid_1's auc: 0.907016	valid_1's binary_logloss: 0.318303
[123]	valid_0's auc: 0.942464	valid_0's binary_logloss: 0.263845	valid_1's auc: 0.907024	valid_1's binary_logloss: 0.318315
[124]	valid_0's auc: 0.942704	valid_0's binary_logloss: 0.26345	valid_1's auc: 0.906892	valid_1's binary_logloss: 0.318545
[125]	valid_0's auc: 0.942855	valid_0's binary_logloss: 0.263173	valid_1's auc: 0.906851	valid_1's binary_logloss: 0.318627
[126]	valid_0's auc: 0.942954	valid_0's binary_logloss: 0.2629	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.318715
[127]	valid_0's auc: 0.943132	valid_0's binary_logloss: 0.26257	valid_1's auc: 0.906675	valid_1's binary_logloss: 0.318956
[128]	valid_0's auc: 0.943364	valid_0's binary_logloss: 0.26214	valid_1's auc: 0.906659	valid_1's binary_logloss: 0.319022
[129]	valid_0's auc: 0.943558	valid_0's binary_logloss: 0.261799	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.318993
[130]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261512	valid_1's auc: 0.906638	valid_1's binary_logloss: 0.319073
[131]	valid_0's auc: 0.94385	valid_0's binary_logloss: 0.261227	valid_1's auc: 0.906581	valid_1's binary_logloss: 0.319177
[132]	valid_0's auc: 0.944038	valid_0's binary_logloss: 0.260879	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319139
[133]	valid_0's auc: 0.944247	valid_0's binary_logloss: 0.260479	valid_1's auc: 0.906664	valid_1's binary_logloss: 0.319098
[134]	valid_0's auc: 0.944413	valid_0's binary_logloss: 0.260171	valid_1's auc: 0.906651	valid_1's binary_logloss: 0.319109
[135]	valid_0's auc: 0.944612	valid_0's binary_logloss: 0.259818	valid_1's auc: 0.906598	valid_1's binary_logloss: 0.319221
[136]	valid_0's auc: 0.944771	valid_0's binary_logloss: 0.259503	valid_1's auc: 0.906615	valid_1's binary_logloss: 0.319196
[137]	valid_0's auc: 0.945036	valid_0's binary_logloss: 0.259047	valid_1's auc: 0.906452	valid_1's binary_logloss: 0.31953
[138]	valid_0's auc: 0.945208	valid_0's binary_logloss: 0.258705	valid_1's auc: 0.906338	valid_1's binary_logloss: 0.319799
[139]	valid_0's auc: 0.945331	valid_0's binary_logloss: 0.258455	valid_1's auc: 0.906316	valid_1's binary_logloss: 0.319893
[140]	valid_0's auc: 0.945483	valid_0's binary_logloss: 0.258144	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.319918
[141]	valid_0's auc: 0.945617	valid_0's binary_logloss: 0.257888	valid_1's auc: 0.906289	valid_1's binary_logloss: 0.319987
[142]	valid_0's auc: 0.945806	valid_0's binary_logloss: 0.257524	valid_1's auc: 0.906284	valid_1's binary_logloss: 0.320022
[143]	valid_0's auc: 0.945971	valid_0's binary_logloss: 0.257224	valid_1's auc: 0.906255	valid_1's binary_logloss: 0.320056
[144]	valid_0's auc: 0.946117	valid_0's binary_logloss: 0.256909	valid_1's auc: 0.906222	valid_1's binary_logloss: 0.320144
[145]	valid_0's auc: 0.946299	valid_0's binary_logloss: 0.256569	valid_1's auc: 0.906083	valid_1's binary_logloss: 0.320387
[146]	valid_0's auc: 0.946429	valid_0's binary_logloss: 0.256327	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320478
[147]	valid_0's auc: 0.946694	valid_0's binary_logloss: 0.255828	valid_1's auc: 0.905921	valid_1's binary_logloss: 0.320641
Early stopping, best iteration is:
[47]	valid_0's auc: 0.922765	valid_0's binary_logloss: 0.299204	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.314006
[1]	valid_0's auc: 0.88881	valid_0's binary_logloss: 0.516633	valid_1's auc: 0.897809	valid_1's binary_logloss: 0.50731
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8922	valid_0's binary_logloss: 0.487561	valid_1's auc: 0.899925	valid_1's binary_logloss: 0.477157
[3]	valid_0's auc: 0.892838	valid_0's binary_logloss: 0.464389	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.453152
[4]	valid_0's auc: 0.894608	valid_0's binary_logloss: 0.444961	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.434111
[5]	valid_0's auc: 0.895384	valid_0's binary_logloss: 0.428899	valid_1's auc: 0.901607	valid_1's binary_logloss: 0.41839
[6]	valid_0's auc: 0.895814	valid_0's binary_logloss: 0.415402	valid_1's auc: 0.901971	valid_1's binary_logloss: 0.404739
[7]	valid_0's auc: 0.897179	valid_0's binary_logloss: 0.403646	valid_1's auc: 0.902712	valid_1's binary_logloss: 0.393451
[8]	valid_0's auc: 0.90014	valid_0's binary_logloss: 0.393717	valid_1's auc: 0.904509	valid_1's binary_logloss: 0.383777
[9]	valid_0's auc: 0.901656	valid_0's binary_logloss: 0.384637	valid_1's auc: 0.905082	valid_1's binary_logloss: 0.375071
[10]	valid_0's auc: 0.902441	valid_0's binary_logloss: 0.376979	valid_1's auc: 0.905389	valid_1's binary_logloss: 0.36779
[11]	valid_0's auc: 0.903086	valid_0's binary_logloss: 0.37018	valid_1's auc: 0.905722	valid_1's binary_logloss: 0.361222
[12]	valid_0's auc: 0.903811	valid_0's binary_logloss: 0.364179	valid_1's auc: 0.905739	valid_1's binary_logloss: 0.355887
[13]	valid_0's auc: 0.904555	valid_0's binary_logloss: 0.359017	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.3513
[14]	valid_0's auc: 0.905441	valid_0's binary_logloss: 0.35414	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.347227
[15]	valid_0's auc: 0.906121	valid_0's binary_logloss: 0.349903	valid_1's auc: 0.90617	valid_1's binary_logloss: 0.343705
[16]	valid_0's auc: 0.906823	valid_0's binary_logloss: 0.346182	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.340575
[17]	valid_0's auc: 0.907623	valid_0's binary_logloss: 0.342618	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.337414
[18]	valid_0's auc: 0.908435	valid_0's binary_logloss: 0.339355	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.334802
[19]	valid_0's auc: 0.909244	valid_0's binary_logloss: 0.336401	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.33235
[20]	valid_0's auc: 0.91019	valid_0's binary_logloss: 0.333492	valid_1's auc: 0.907581	valid_1's binary_logloss: 0.330668
[21]	valid_0's auc: 0.910592	valid_0's binary_logloss: 0.331217	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.328752
[22]	valid_0's auc: 0.911201	valid_0's binary_logloss: 0.328996	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.32715
[23]	valid_0's auc: 0.911776	valid_0's binary_logloss: 0.326873	valid_1's auc: 0.908173	valid_1's binary_logloss: 0.325751
[24]	valid_0's auc: 0.912492	valid_0's binary_logloss: 0.324799	valid_1's auc: 0.908508	valid_1's binary_logloss: 0.32443
[25]	valid_0's auc: 0.913089	valid_0's binary_logloss: 0.32297	valid_1's auc: 0.908814	valid_1's binary_logloss: 0.322992
[26]	valid_0's auc: 0.9136	valid_0's binary_logloss: 0.321192	valid_1's auc: 0.908874	valid_1's binary_logloss: 0.32202
[27]	valid_0's auc: 0.914178	valid_0's binary_logloss: 0.319604	valid_1's auc: 0.908948	valid_1's binary_logloss: 0.321157
[28]	valid_0's auc: 0.914633	valid_0's binary_logloss: 0.318173	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.320516
[29]	valid_0's auc: 0.915064	valid_0's binary_logloss: 0.31679	valid_1's auc: 0.909119	valid_1's binary_logloss: 0.319599
[30]	valid_0's auc: 0.915605	valid_0's binary_logloss: 0.315332	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.31877
[31]	valid_0's auc: 0.916108	valid_0's binary_logloss: 0.313967	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.318171
[32]	valid_0's auc: 0.916571	valid_0's binary_logloss: 0.312762	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.31812
[33]	valid_0's auc: 0.917039	valid_0's binary_logloss: 0.311602	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.317603
[34]	valid_0's auc: 0.9174	valid_0's binary_logloss: 0.310537	valid_1's auc: 0.909544	valid_1's binary_logloss: 0.317031
[35]	valid_0's auc: 0.917876	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.316615
[36]	valid_0's auc: 0.918318	valid_0's binary_logloss: 0.308395	valid_1's auc: 0.909647	valid_1's binary_logloss: 0.316259
[37]	valid_0's auc: 0.918718	valid_0's binary_logloss: 0.307424	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.316147
[38]	valid_0's auc: 0.919117	valid_0's binary_logloss: 0.3065	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315994
[39]	valid_0's auc: 0.919602	valid_0's binary_logloss: 0.305479	valid_1's auc: 0.909566	valid_1's binary_logloss: 0.315843
[40]	valid_0's auc: 0.920052	valid_0's binary_logloss: 0.304544	valid_1's auc: 0.909565	valid_1's binary_logloss: 0.315715
[41]	valid_0's auc: 0.920506	valid_0's binary_logloss: 0.303599	valid_1's auc: 0.909729	valid_1's binary_logloss: 0.315279
[42]	valid_0's auc: 0.920955	valid_0's binary_logloss: 0.302692	valid_1's auc: 0.909832	valid_1's binary_logloss: 0.315004
[43]	valid_0's auc: 0.921301	valid_0's binary_logloss: 0.301897	valid_1's auc: 0.909823	valid_1's binary_logloss: 0.314899
[44]	valid_0's auc: 0.921781	valid_0's binary_logloss: 0.30102	valid_1's auc: 0.909762	valid_1's binary_logloss: 0.314946
[45]	valid_0's auc: 0.92213	valid_0's binary_logloss: 0.300287	valid_1's auc: 0.909701	valid_1's binary_logloss: 0.315008
[46]	valid_0's auc: 0.922414	valid_0's binary_logloss: 0.299693	valid_1's auc: 0.909544	valid_1's binary_logloss: 0.315146
[47]	valid_0's auc: 0.922809	valid_0's binary_logloss: 0.298955	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315117
[48]	valid_0's auc: 0.923123	valid_0's binary_logloss: 0.298268	valid_1's auc: 0.909456	valid_1's binary_logloss: 0.315204
[49]	valid_0's auc: 0.923529	valid_0's binary_logloss: 0.297517	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.315141
[50]	valid_0's auc: 0.923806	valid_0's binary_logloss: 0.296969	valid_1's auc: 0.909572	valid_1's binary_logloss: 0.314996
[51]	valid_0's auc: 0.924082	valid_0's binary_logloss: 0.296402	valid_1's auc: 0.909673	valid_1's binary_logloss: 0.314823
[52]	valid_0's auc: 0.924503	valid_0's binary_logloss: 0.29565	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314877
[53]	valid_0's auc: 0.924835	valid_0's binary_logloss: 0.29506	valid_1's auc: 0.909538	valid_1's binary_logloss: 0.314905
[54]	valid_0's auc: 0.925114	valid_0's binary_logloss: 0.294531	valid_1's auc: 0.909518	valid_1's binary_logloss: 0.314906
[55]	valid_0's auc: 0.925408	valid_0's binary_logloss: 0.293982	valid_1's auc: 0.909492	valid_1's binary_logloss: 0.314875
[56]	valid_0's auc: 0.925704	valid_0's binary_logloss: 0.293444	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.315111
[57]	valid_0's auc: 0.926134	valid_0's binary_logloss: 0.292702	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.3152
[58]	valid_0's auc: 0.926536	valid_0's binary_logloss: 0.292023	valid_1's auc: 0.90917	valid_1's binary_logloss: 0.315353
[59]	valid_0's auc: 0.92682	valid_0's binary_logloss: 0.291539	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.315467
[60]	valid_0's auc: 0.927054	valid_0's binary_logloss: 0.291037	valid_1's auc: 0.909065	valid_1's binary_logloss: 0.315472
[61]	valid_0's auc: 0.927309	valid_0's binary_logloss: 0.29058	valid_1's auc: 0.909094	valid_1's binary_logloss: 0.315418
[62]	valid_0's auc: 0.92773	valid_0's binary_logloss: 0.289873	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315547
[63]	valid_0's auc: 0.928014	valid_0's binary_logloss: 0.289346	valid_1's auc: 0.909041	valid_1's binary_logloss: 0.315524
[64]	valid_0's auc: 0.92834	valid_0's binary_logloss: 0.28878	valid_1's auc: 0.908946	valid_1's binary_logloss: 0.315607
[65]	valid_0's auc: 0.928682	valid_0's binary_logloss: 0.2882	valid_1's auc: 0.90892	valid_1's binary_logloss: 0.315649
[66]	valid_0's auc: 0.928922	valid_0's binary_logloss: 0.287759	valid_1's auc: 0.908894	valid_1's binary_logloss: 0.315691
[67]	valid_0's auc: 0.92919	valid_0's binary_logloss: 0.287273	valid_1's auc: 0.908915	valid_1's binary_logloss: 0.315627
[68]	valid_0's auc: 0.929473	valid_0's binary_logloss: 0.286709	valid_1's auc: 0.908951	valid_1's binary_logloss: 0.315556
[69]	valid_0's auc: 0.929712	valid_0's binary_logloss: 0.286288	valid_1's auc: 0.908921	valid_1's binary_logloss: 0.315629
[70]	valid_0's auc: 0.929941	valid_0's binary_logloss: 0.285817	valid_1's auc: 0.909	valid_1's binary_logloss: 0.315509
[71]	valid_0's auc: 0.930342	valid_0's binary_logloss: 0.285161	valid_1's auc: 0.908895	valid_1's binary_logloss: 0.315669
[72]	valid_0's auc: 0.930616	valid_0's binary_logloss: 0.284691	valid_1's auc: 0.908887	valid_1's binary_logloss: 0.315701
[73]	valid_0's auc: 0.930827	valid_0's binary_logloss: 0.284282	valid_1's auc: 0.908707	valid_1's binary_logloss: 0.31595
[74]	valid_0's auc: 0.931103	valid_0's binary_logloss: 0.283811	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.316117
[75]	valid_0's auc: 0.931462	valid_0's binary_logloss: 0.283179	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.316419
[76]	valid_0's auc: 0.931692	valid_0's binary_logloss: 0.282719	valid_1's auc: 0.908379	valid_1's binary_logloss: 0.316475
[77]	valid_0's auc: 0.931967	valid_0's binary_logloss: 0.282254	valid_1's auc: 0.908221	valid_1's binary_logloss: 0.316737
[78]	valid_0's auc: 0.932265	valid_0's binary_logloss: 0.281721	valid_1's auc: 0.908113	valid_1's binary_logloss: 0.316892
[79]	valid_0's auc: 0.932524	valid_0's binary_logloss: 0.28124	valid_1's auc: 0.9081	valid_1's binary_logloss: 0.316917
[80]	valid_0's auc: 0.932781	valid_0's binary_logloss: 0.280808	valid_1's auc: 0.908166	valid_1's binary_logloss: 0.316796
[81]	valid_0's auc: 0.933036	valid_0's binary_logloss: 0.280358	valid_1's auc: 0.908104	valid_1's binary_logloss: 0.316889
[82]	valid_0's auc: 0.933223	valid_0's binary_logloss: 0.279973	valid_1's auc: 0.908107	valid_1's binary_logloss: 0.316867
[83]	valid_0's auc: 0.933561	valid_0's binary_logloss: 0.279372	valid_1's auc: 0.908222	valid_1's binary_logloss: 0.316739
[84]	valid_0's auc: 0.933816	valid_0's binary_logloss: 0.278899	valid_1's auc: 0.908321	valid_1's binary_logloss: 0.3166
[85]	valid_0's auc: 0.934142	valid_0's binary_logloss: 0.278344	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.31665
[86]	valid_0's auc: 0.934471	valid_0's binary_logloss: 0.27782	valid_1's auc: 0.908203	valid_1's binary_logloss: 0.316755
[87]	valid_0's auc: 0.934733	valid_0's binary_logloss: 0.277346	valid_1's auc: 0.908141	valid_1's binary_logloss: 0.316871
[88]	valid_0's auc: 0.934983	valid_0's binary_logloss: 0.276943	valid_1's auc: 0.908135	valid_1's binary_logloss: 0.3169
[89]	valid_0's auc: 0.935247	valid_0's binary_logloss: 0.276471	valid_1's auc: 0.90804	valid_1's binary_logloss: 0.317069
[90]	valid_0's auc: 0.935511	valid_0's binary_logloss: 0.276014	valid_1's auc: 0.908094	valid_1's binary_logloss: 0.31701
[91]	valid_0's auc: 0.935772	valid_0's binary_logloss: 0.275588	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.317343
[92]	valid_0's auc: 0.935945	valid_0's binary_logloss: 0.275249	valid_1's auc: 0.90796	valid_1's binary_logloss: 0.317233
[93]	valid_0's auc: 0.936189	valid_0's binary_logloss: 0.274811	valid_1's auc: 0.907927	valid_1's binary_logloss: 0.317334
[94]	valid_0's auc: 0.936458	valid_0's binary_logloss: 0.274334	valid_1's auc: 0.907757	valid_1's binary_logloss: 0.317608
[95]	valid_0's auc: 0.936693	valid_0's binary_logloss: 0.273914	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317529
[96]	valid_0's auc: 0.936969	valid_0's binary_logloss: 0.273441	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317536
[97]	valid_0's auc: 0.937284	valid_0's binary_logloss: 0.272902	valid_1's auc: 0.907795	valid_1's binary_logloss: 0.317582
[98]	valid_0's auc: 0.9375	valid_0's binary_logloss: 0.272531	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.317457
[99]	valid_0's auc: 0.937685	valid_0's binary_logloss: 0.27218	valid_1's auc: 0.907937	valid_1's binary_logloss: 0.31741
[100]	valid_0's auc: 0.937882	valid_0's binary_logloss: 0.271823	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.317571
[101]	valid_0's auc: 0.938136	valid_0's binary_logloss: 0.271393	valid_1's auc: 0.907792	valid_1's binary_logloss: 0.317691
[102]	valid_0's auc: 0.938405	valid_0's binary_logloss: 0.2709	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.317649
[103]	valid_0's auc: 0.938527	valid_0's binary_logloss: 0.270661	valid_1's auc: 0.907828	valid_1's binary_logloss: 0.317663
[104]	valid_0's auc: 0.938881	valid_0's binary_logloss: 0.270075	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.31769
[105]	valid_0's auc: 0.939169	valid_0's binary_logloss: 0.269567	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317883
[106]	valid_0's auc: 0.939411	valid_0's binary_logloss: 0.269135	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.318056
[107]	valid_0's auc: 0.93957	valid_0's binary_logloss: 0.26885	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.318144
[108]	valid_0's auc: 0.939791	valid_0's binary_logloss: 0.268429	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.318241
[109]	valid_0's auc: 0.939985	valid_0's binary_logloss: 0.268097	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318289
[110]	valid_0's auc: 0.940246	valid_0's binary_logloss: 0.267644	valid_1's auc: 0.907512	valid_1's binary_logloss: 0.318286
[111]	valid_0's auc: 0.940427	valid_0's binary_logloss: 0.267298	valid_1's auc: 0.907518	valid_1's binary_logloss: 0.318282
[112]	valid_0's auc: 0.940611	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.907444	valid_1's binary_logloss: 0.318432
[113]	valid_0's auc: 0.940817	valid_0's binary_logloss: 0.266597	valid_1's auc: 0.907376	valid_1's binary_logloss: 0.318552
[114]	valid_0's auc: 0.941022	valid_0's binary_logloss: 0.26619	valid_1's auc: 0.907316	valid_1's binary_logloss: 0.318675
[115]	valid_0's auc: 0.941189	valid_0's binary_logloss: 0.265891	valid_1's auc: 0.907221	valid_1's binary_logloss: 0.318873
[116]	valid_0's auc: 0.941416	valid_0's binary_logloss: 0.265491	valid_1's auc: 0.907157	valid_1's binary_logloss: 0.318999
[117]	valid_0's auc: 0.941581	valid_0's binary_logloss: 0.265203	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.319127
[118]	valid_0's auc: 0.941764	valid_0's binary_logloss: 0.264857	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.319351
[119]	valid_0's auc: 0.941961	valid_0's binary_logloss: 0.264515	valid_1's auc: 0.906973	valid_1's binary_logloss: 0.31941
[120]	valid_0's auc: 0.942167	valid_0's binary_logloss: 0.264112	valid_1's auc: 0.906999	valid_1's binary_logloss: 0.319384
[121]	valid_0's auc: 0.942449	valid_0's binary_logloss: 0.263633	valid_1's auc: 0.906844	valid_1's binary_logloss: 0.31974
[122]	valid_0's auc: 0.942589	valid_0's binary_logloss: 0.263307	valid_1's auc: 0.906764	valid_1's binary_logloss: 0.319956
[123]	valid_0's auc: 0.942759	valid_0's binary_logloss: 0.263017	valid_1's auc: 0.906711	valid_1's binary_logloss: 0.319992
[124]	valid_0's auc: 0.942957	valid_0's binary_logloss: 0.26267	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.3199
[125]	valid_0's auc: 0.943108	valid_0's binary_logloss: 0.262386	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319971
[126]	valid_0's auc: 0.94336	valid_0's binary_logloss: 0.261907	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.320052
[127]	valid_0's auc: 0.943581	valid_0's binary_logloss: 0.261486	valid_1's auc: 0.906791	valid_1's binary_logloss: 0.319981
[128]	valid_0's auc: 0.9437	valid_0's binary_logloss: 0.261242	valid_1's auc: 0.906715	valid_1's binary_logloss: 0.320109
[129]	valid_0's auc: 0.943848	valid_0's binary_logloss: 0.260956	valid_1's auc: 0.906648	valid_1's binary_logloss: 0.320251
[130]	valid_0's auc: 0.944112	valid_0's binary_logloss: 0.260507	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.320192
[131]	valid_0's auc: 0.944264	valid_0's binary_logloss: 0.260233	valid_1's auc: 0.906735	valid_1's binary_logloss: 0.320171
[132]	valid_0's auc: 0.944414	valid_0's binary_logloss: 0.259948	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.320298
[133]	valid_0's auc: 0.944524	valid_0's binary_logloss: 0.25974	valid_1's auc: 0.906678	valid_1's binary_logloss: 0.320256
[134]	valid_0's auc: 0.944779	valid_0's binary_logloss: 0.259299	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.320184
[135]	valid_0's auc: 0.944928	valid_0's binary_logloss: 0.259016	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.32021
[136]	valid_0's auc: 0.945016	valid_0's binary_logloss: 0.258823	valid_1's auc: 0.906707	valid_1's binary_logloss: 0.320319
[137]	valid_0's auc: 0.945186	valid_0's binary_logloss: 0.258479	valid_1's auc: 0.906629	valid_1's binary_logloss: 0.32051
[138]	valid_0's auc: 0.945293	valid_0's binary_logloss: 0.258258	valid_1's auc: 0.906617	valid_1's binary_logloss: 0.320569
[139]	valid_0's auc: 0.945537	valid_0's binary_logloss: 0.257809	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.320558
[140]	valid_0's auc: 0.945752	valid_0's binary_logloss: 0.257418	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.320913
[141]	valid_0's auc: 0.945873	valid_0's binary_logloss: 0.257134	valid_1's auc: 0.906449	valid_1's binary_logloss: 0.320996
[142]	valid_0's auc: 0.945985	valid_0's binary_logloss: 0.256925	valid_1's auc: 0.906314	valid_1's binary_logloss: 0.321262
Early stopping, best iteration is:
[42]	valid_0's auc: 0.920955	valid_0's binary_logloss: 0.302692	valid_1's auc: 0.909832	valid_1's binary_logloss: 0.315004
[1]	valid_0's auc: 0.887249	valid_0's binary_logloss: 0.517046	valid_1's auc: 0.892969	valid_1's binary_logloss: 0.508431
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889524	valid_0's binary_logloss: 0.488088	valid_1's auc: 0.89592	valid_1's binary_logloss: 0.478873
[3]	valid_0's auc: 0.891571	valid_0's binary_logloss: 0.464744	valid_1's auc: 0.896177	valid_1's binary_logloss: 0.455472
[4]	valid_0's auc: 0.893868	valid_0's binary_logloss: 0.445249	valid_1's auc: 0.897585	valid_1's binary_logloss: 0.43623
[5]	valid_0's auc: 0.897186	valid_0's binary_logloss: 0.429114	valid_1's auc: 0.900745	valid_1's binary_logloss: 0.419804
[6]	valid_0's auc: 0.898078	valid_0's binary_logloss: 0.415466	valid_1's auc: 0.901242	valid_1's binary_logloss: 0.406401
[7]	valid_0's auc: 0.899398	valid_0's binary_logloss: 0.403794	valid_1's auc: 0.90246	valid_1's binary_logloss: 0.394732
[8]	valid_0's auc: 0.900616	valid_0's binary_logloss: 0.393732	valid_1's auc: 0.902926	valid_1's binary_logloss: 0.385104
[9]	valid_0's auc: 0.901282	valid_0's binary_logloss: 0.384962	valid_1's auc: 0.903761	valid_1's binary_logloss: 0.376423
[10]	valid_0's auc: 0.902116	valid_0's binary_logloss: 0.377268	valid_1's auc: 0.903857	valid_1's binary_logloss: 0.369348
[11]	valid_0's auc: 0.902911	valid_0's binary_logloss: 0.370559	valid_1's auc: 0.90371	valid_1's binary_logloss: 0.36337
[12]	valid_0's auc: 0.903892	valid_0's binary_logloss: 0.364523	valid_1's auc: 0.904465	valid_1's binary_logloss: 0.357744
[13]	valid_0's auc: 0.904864	valid_0's binary_logloss: 0.359224	valid_1's auc: 0.904853	valid_1's binary_logloss: 0.352978
[14]	valid_0's auc: 0.905535	valid_0's binary_logloss: 0.354517	valid_1's auc: 0.905195	valid_1's binary_logloss: 0.348745
[15]	valid_0's auc: 0.906247	valid_0's binary_logloss: 0.350292	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.345032
[16]	valid_0's auc: 0.906797	valid_0's binary_logloss: 0.346472	valid_1's auc: 0.905953	valid_1's binary_logloss: 0.341776
[17]	valid_0's auc: 0.907358	valid_0's binary_logloss: 0.343123	valid_1's auc: 0.906447	valid_1's binary_logloss: 0.338822
[18]	valid_0's auc: 0.908033	valid_0's binary_logloss: 0.339924	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336244
[19]	valid_0's auc: 0.90894	valid_0's binary_logloss: 0.336948	valid_1's auc: 0.906907	valid_1's binary_logloss: 0.334159
[20]	valid_0's auc: 0.909391	valid_0's binary_logloss: 0.334429	valid_1's auc: 0.907131	valid_1's binary_logloss: 0.33207
[21]	valid_0's auc: 0.910056	valid_0's binary_logloss: 0.332011	valid_1's auc: 0.90702	valid_1's binary_logloss: 0.330628
[22]	valid_0's auc: 0.910577	valid_0's binary_logloss: 0.329834	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.328778
[23]	valid_0's auc: 0.911226	valid_0's binary_logloss: 0.32774	valid_1's auc: 0.90738	valid_1's binary_logloss: 0.32746
[24]	valid_0's auc: 0.911924	valid_0's binary_logloss: 0.325717	valid_1's auc: 0.907391	valid_1's binary_logloss: 0.326361
[25]	valid_0's auc: 0.912617	valid_0's binary_logloss: 0.323749	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.325176
[26]	valid_0's auc: 0.913165	valid_0's binary_logloss: 0.322012	valid_1's auc: 0.907708	valid_1's binary_logloss: 0.324169
[27]	valid_0's auc: 0.913655	valid_0's binary_logloss: 0.320373	valid_1's auc: 0.907891	valid_1's binary_logloss: 0.323092
[28]	valid_0's auc: 0.914286	valid_0's binary_logloss: 0.318824	valid_1's auc: 0.907861	valid_1's binary_logloss: 0.322584
[29]	valid_0's auc: 0.914847	valid_0's binary_logloss: 0.317292	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.321611
[30]	valid_0's auc: 0.915298	valid_0's binary_logloss: 0.315967	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.321195
[31]	valid_0's auc: 0.915775	valid_0's binary_logloss: 0.314611	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.320673
[32]	valid_0's auc: 0.91635	valid_0's binary_logloss: 0.313328	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.320335
[33]	valid_0's auc: 0.916807	valid_0's binary_logloss: 0.312169	valid_1's auc: 0.908099	valid_1's binary_logloss: 0.319871
[34]	valid_0's auc: 0.917257	valid_0's binary_logloss: 0.311013	valid_1's auc: 0.908253	valid_1's binary_logloss: 0.319253
[35]	valid_0's auc: 0.917787	valid_0's binary_logloss: 0.309842	valid_1's auc: 0.908178	valid_1's binary_logloss: 0.31912
[36]	valid_0's auc: 0.918288	valid_0's binary_logloss: 0.308697	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.318934
[37]	valid_0's auc: 0.918804	valid_0's binary_logloss: 0.307571	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.318877
[38]	valid_0's auc: 0.919173	valid_0's binary_logloss: 0.3067	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.318701
[39]	valid_0's auc: 0.919557	valid_0's binary_logloss: 0.305783	valid_1's auc: 0.907894	valid_1's binary_logloss: 0.318635
[40]	valid_0's auc: 0.919943	valid_0's binary_logloss: 0.304916	valid_1's auc: 0.907979	valid_1's binary_logloss: 0.318348
[41]	valid_0's auc: 0.92037	valid_0's binary_logloss: 0.304024	valid_1's auc: 0.907966	valid_1's binary_logloss: 0.318249
[42]	valid_0's auc: 0.920893	valid_0's binary_logloss: 0.302996	valid_1's auc: 0.908023	valid_1's binary_logloss: 0.318068
[43]	valid_0's auc: 0.92124	valid_0's binary_logloss: 0.302253	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.318081
[44]	valid_0's auc: 0.921609	valid_0's binary_logloss: 0.301468	valid_1's auc: 0.908001	valid_1's binary_logloss: 0.317883
[45]	valid_0's auc: 0.922075	valid_0's binary_logloss: 0.30058	valid_1's auc: 0.907876	valid_1's binary_logloss: 0.318003
[46]	valid_0's auc: 0.922551	valid_0's binary_logloss: 0.29974	valid_1's auc: 0.907752	valid_1's binary_logloss: 0.318115
[47]	valid_0's auc: 0.922922	valid_0's binary_logloss: 0.298977	valid_1's auc: 0.907693	valid_1's binary_logloss: 0.318092
[48]	valid_0's auc: 0.923285	valid_0's binary_logloss: 0.29826	valid_1's auc: 0.907499	valid_1's binary_logloss: 0.318308
[49]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.297577	valid_1's auc: 0.90755	valid_1's binary_logloss: 0.318111
[50]	valid_0's auc: 0.923986	valid_0's binary_logloss: 0.296898	valid_1's auc: 0.907649	valid_1's binary_logloss: 0.31796
[51]	valid_0's auc: 0.924293	valid_0's binary_logloss: 0.296269	valid_1's auc: 0.907599	valid_1's binary_logloss: 0.318015
[52]	valid_0's auc: 0.924596	valid_0's binary_logloss: 0.295708	valid_1's auc: 0.907622	valid_1's binary_logloss: 0.317926
[53]	valid_0's auc: 0.924934	valid_0's binary_logloss: 0.295119	valid_1's auc: 0.907669	valid_1's binary_logloss: 0.317825
[54]	valid_0's auc: 0.925235	valid_0's binary_logloss: 0.29458	valid_1's auc: 0.907473	valid_1's binary_logloss: 0.31809
[55]	valid_0's auc: 0.92551	valid_0's binary_logloss: 0.29404	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.318061
[56]	valid_0's auc: 0.925816	valid_0's binary_logloss: 0.293478	valid_1's auc: 0.907316	valid_1's binary_logloss: 0.318303
[57]	valid_0's auc: 0.926154	valid_0's binary_logloss: 0.292838	valid_1's auc: 0.907253	valid_1's binary_logloss: 0.318391
[58]	valid_0's auc: 0.926504	valid_0's binary_logloss: 0.292189	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318414
[59]	valid_0's auc: 0.926985	valid_0's binary_logloss: 0.291366	valid_1's auc: 0.907139	valid_1's binary_logloss: 0.318608
[60]	valid_0's auc: 0.927304	valid_0's binary_logloss: 0.290795	valid_1's auc: 0.907005	valid_1's binary_logloss: 0.318809
[61]	valid_0's auc: 0.927553	valid_0's binary_logloss: 0.290337	valid_1's auc: 0.906991	valid_1's binary_logloss: 0.318832
[62]	valid_0's auc: 0.927852	valid_0's binary_logloss: 0.289838	valid_1's auc: 0.906952	valid_1's binary_logloss: 0.318876
[63]	valid_0's auc: 0.928145	valid_0's binary_logloss: 0.289317	valid_1's auc: 0.907064	valid_1's binary_logloss: 0.3187
[64]	valid_0's auc: 0.928418	valid_0's binary_logloss: 0.288819	valid_1's auc: 0.907125	valid_1's binary_logloss: 0.318568
[65]	valid_0's auc: 0.9287	valid_0's binary_logloss: 0.288286	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.318489
[66]	valid_0's auc: 0.928994	valid_0's binary_logloss: 0.287769	valid_1's auc: 0.907155	valid_1's binary_logloss: 0.318518
[67]	valid_0's auc: 0.9293	valid_0's binary_logloss: 0.287216	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318722
[68]	valid_0's auc: 0.929655	valid_0's binary_logloss: 0.286583	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.319015
[69]	valid_0's auc: 0.929913	valid_0's binary_logloss: 0.286077	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.319125
[70]	valid_0's auc: 0.930233	valid_0's binary_logloss: 0.285539	valid_1's auc: 0.906807	valid_1's binary_logloss: 0.319226
[71]	valid_0's auc: 0.930568	valid_0's binary_logloss: 0.284961	valid_1's auc: 0.906803	valid_1's binary_logloss: 0.319246
[72]	valid_0's auc: 0.930792	valid_0's binary_logloss: 0.284562	valid_1's auc: 0.906777	valid_1's binary_logloss: 0.319288
[73]	valid_0's auc: 0.931085	valid_0's binary_logloss: 0.284042	valid_1's auc: 0.906801	valid_1's binary_logloss: 0.319209
[74]	valid_0's auc: 0.931332	valid_0's binary_logloss: 0.283569	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.319299
[75]	valid_0's auc: 0.931579	valid_0's binary_logloss: 0.283123	valid_1's auc: 0.906647	valid_1's binary_logloss: 0.319509
[76]	valid_0's auc: 0.931918	valid_0's binary_logloss: 0.282493	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.319702
[77]	valid_0's auc: 0.932194	valid_0's binary_logloss: 0.282015	valid_1's auc: 0.906574	valid_1's binary_logloss: 0.31965
[78]	valid_0's auc: 0.932473	valid_0's binary_logloss: 0.28153	valid_1's auc: 0.906418	valid_1's binary_logloss: 0.319889
[79]	valid_0's auc: 0.932754	valid_0's binary_logloss: 0.281033	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.31994
[80]	valid_0's auc: 0.9331	valid_0's binary_logloss: 0.28045	valid_1's auc: 0.906488	valid_1's binary_logloss: 0.319837
[81]	valid_0's auc: 0.933319	valid_0's binary_logloss: 0.280032	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.320006
[82]	valid_0's auc: 0.933574	valid_0's binary_logloss: 0.279565	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.319974
[83]	valid_0's auc: 0.933815	valid_0's binary_logloss: 0.279124	valid_1's auc: 0.90638	valid_1's binary_logloss: 0.319972
[84]	valid_0's auc: 0.934054	valid_0's binary_logloss: 0.278694	valid_1's auc: 0.9064	valid_1's binary_logloss: 0.319972
[85]	valid_0's auc: 0.934305	valid_0's binary_logloss: 0.278245	valid_1's auc: 0.906362	valid_1's binary_logloss: 0.32008
[86]	valid_0's auc: 0.934492	valid_0's binary_logloss: 0.277864	valid_1's auc: 0.906283	valid_1's binary_logloss: 0.320265
[87]	valid_0's auc: 0.934723	valid_0's binary_logloss: 0.277446	valid_1's auc: 0.906271	valid_1's binary_logloss: 0.320322
[88]	valid_0's auc: 0.934947	valid_0's binary_logloss: 0.277032	valid_1's auc: 0.906283	valid_1's binary_logloss: 0.320297
[89]	valid_0's auc: 0.935136	valid_0's binary_logloss: 0.276663	valid_1's auc: 0.906198	valid_1's binary_logloss: 0.32049
[90]	valid_0's auc: 0.935346	valid_0's binary_logloss: 0.276287	valid_1's auc: 0.906217	valid_1's binary_logloss: 0.320508
[91]	valid_0's auc: 0.935619	valid_0's binary_logloss: 0.275802	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.320356
[92]	valid_0's auc: 0.935846	valid_0's binary_logloss: 0.275424	valid_1's auc: 0.906227	valid_1's binary_logloss: 0.320453
[93]	valid_0's auc: 0.936065	valid_0's binary_logloss: 0.275032	valid_1's auc: 0.906321	valid_1's binary_logloss: 0.320316
[94]	valid_0's auc: 0.936252	valid_0's binary_logloss: 0.274672	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320518
[95]	valid_0's auc: 0.936445	valid_0's binary_logloss: 0.274334	valid_1's auc: 0.906183	valid_1's binary_logloss: 0.320564
[96]	valid_0's auc: 0.936672	valid_0's binary_logloss: 0.273923	valid_1's auc: 0.906154	valid_1's binary_logloss: 0.320596
[97]	valid_0's auc: 0.936901	valid_0's binary_logloss: 0.273528	valid_1's auc: 0.906089	valid_1's binary_logloss: 0.320762
[98]	valid_0's auc: 0.93708	valid_0's binary_logloss: 0.273201	valid_1's auc: 0.90606	valid_1's binary_logloss: 0.320816
[99]	valid_0's auc: 0.937283	valid_0's binary_logloss: 0.272835	valid_1's auc: 0.906067	valid_1's binary_logloss: 0.320856
[100]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272444	valid_1's auc: 0.906046	valid_1's binary_logloss: 0.320926
[101]	valid_0's auc: 0.937721	valid_0's binary_logloss: 0.272066	valid_1's auc: 0.906036	valid_1's binary_logloss: 0.320947
[102]	valid_0's auc: 0.937963	valid_0's binary_logloss: 0.271618	valid_1's auc: 0.906021	valid_1's binary_logloss: 0.320954
[103]	valid_0's auc: 0.938129	valid_0's binary_logloss: 0.271329	valid_1's auc: 0.906037	valid_1's binary_logloss: 0.321011
[104]	valid_0's auc: 0.938367	valid_0's binary_logloss: 0.270871	valid_1's auc: 0.905985	valid_1's binary_logloss: 0.32118
[105]	valid_0's auc: 0.938537	valid_0's binary_logloss: 0.270548	valid_1's auc: 0.905892	valid_1's binary_logloss: 0.321396
[106]	valid_0's auc: 0.938726	valid_0's binary_logloss: 0.27019	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.32139
[107]	valid_0's auc: 0.938923	valid_0's binary_logloss: 0.269842	valid_1's auc: 0.905919	valid_1's binary_logloss: 0.321356
[108]	valid_0's auc: 0.939075	valid_0's binary_logloss: 0.269579	valid_1's auc: 0.905891	valid_1's binary_logloss: 0.321416
[109]	valid_0's auc: 0.939344	valid_0's binary_logloss: 0.269115	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.321438
[110]	valid_0's auc: 0.939572	valid_0's binary_logloss: 0.268724	valid_1's auc: 0.905857	valid_1's binary_logloss: 0.321602
[111]	valid_0's auc: 0.93982	valid_0's binary_logloss: 0.268267	valid_1's auc: 0.905818	valid_1's binary_logloss: 0.32167
[112]	valid_0's auc: 0.940029	valid_0's binary_logloss: 0.267894	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.321826
[113]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267508	valid_1's auc: 0.905638	valid_1's binary_logloss: 0.321991
[114]	valid_0's auc: 0.940462	valid_0's binary_logloss: 0.267049	valid_1's auc: 0.905593	valid_1's binary_logloss: 0.322087
[115]	valid_0's auc: 0.940639	valid_0's binary_logloss: 0.266716	valid_1's auc: 0.90557	valid_1's binary_logloss: 0.32215
[116]	valid_0's auc: 0.94083	valid_0's binary_logloss: 0.266406	valid_1's auc: 0.905444	valid_1's binary_logloss: 0.322341
[117]	valid_0's auc: 0.941021	valid_0's binary_logloss: 0.266029	valid_1's auc: 0.905374	valid_1's binary_logloss: 0.322546
[118]	valid_0's auc: 0.941259	valid_0's binary_logloss: 0.265625	valid_1's auc: 0.905347	valid_1's binary_logloss: 0.322609
[119]	valid_0's auc: 0.941491	valid_0's binary_logloss: 0.265255	valid_1's auc: 0.905292	valid_1's binary_logloss: 0.322695
[120]	valid_0's auc: 0.941711	valid_0's binary_logloss: 0.264853	valid_1's auc: 0.90531	valid_1's binary_logloss: 0.322673
[121]	valid_0's auc: 0.941847	valid_0's binary_logloss: 0.264551	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.322663
[122]	valid_0's auc: 0.942006	valid_0's binary_logloss: 0.264255	valid_1's auc: 0.905345	valid_1's binary_logloss: 0.322787
[123]	valid_0's auc: 0.942171	valid_0's binary_logloss: 0.263909	valid_1's auc: 0.905214	valid_1's binary_logloss: 0.323012
[124]	valid_0's auc: 0.942392	valid_0's binary_logloss: 0.263522	valid_1's auc: 0.905208	valid_1's binary_logloss: 0.323058
[125]	valid_0's auc: 0.942556	valid_0's binary_logloss: 0.263229	valid_1's auc: 0.905137	valid_1's binary_logloss: 0.323252
[126]	valid_0's auc: 0.9427	valid_0's binary_logloss: 0.262933	valid_1's auc: 0.905096	valid_1's binary_logloss: 0.323417
[127]	valid_0's auc: 0.94286	valid_0's binary_logloss: 0.262591	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.323675
[128]	valid_0's auc: 0.943043	valid_0's binary_logloss: 0.262256	valid_1's auc: 0.904917	valid_1's binary_logloss: 0.323789
[129]	valid_0's auc: 0.943206	valid_0's binary_logloss: 0.261946	valid_1's auc: 0.90497	valid_1's binary_logloss: 0.323759
[130]	valid_0's auc: 0.943418	valid_0's binary_logloss: 0.261588	valid_1's auc: 0.90479	valid_1's binary_logloss: 0.324096
[131]	valid_0's auc: 0.943584	valid_0's binary_logloss: 0.261263	valid_1's auc: 0.90464	valid_1's binary_logloss: 0.324415
[132]	valid_0's auc: 0.943738	valid_0's binary_logloss: 0.260986	valid_1's auc: 0.904691	valid_1's binary_logloss: 0.324351
[133]	valid_0's auc: 0.943902	valid_0's binary_logloss: 0.260669	valid_1's auc: 0.904688	valid_1's binary_logloss: 0.32437
[134]	valid_0's auc: 0.944035	valid_0's binary_logloss: 0.260408	valid_1's auc: 0.904672	valid_1's binary_logloss: 0.324445
Early stopping, best iteration is:
[34]	valid_0's auc: 0.917257	valid_0's binary_logloss: 0.311013	valid_1's auc: 0.908253	valid_1's binary_logloss: 0.319253
[1]	valid_0's auc: 0.888786	valid_0's binary_logloss: 0.516801	valid_1's auc: 0.894376	valid_1's binary_logloss: 0.508215
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892051	valid_0's binary_logloss: 0.487909	valid_1's auc: 0.897516	valid_1's binary_logloss: 0.478613
[3]	valid_0's auc: 0.892499	valid_0's binary_logloss: 0.464939	valid_1's auc: 0.897999	valid_1's binary_logloss: 0.455284
[4]	valid_0's auc: 0.893544	valid_0's binary_logloss: 0.445997	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.43625
[5]	valid_0's auc: 0.897183	valid_0's binary_logloss: 0.429801	valid_1's auc: 0.901802	valid_1's binary_logloss: 0.419978
[6]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.416121	valid_1's auc: 0.902211	valid_1's binary_logloss: 0.406386
[7]	valid_0's auc: 0.899236	valid_0's binary_logloss: 0.40443	valid_1's auc: 0.902787	valid_1's binary_logloss: 0.394757
[8]	valid_0's auc: 0.899639	valid_0's binary_logloss: 0.394315	valid_1's auc: 0.90375	valid_1's binary_logloss: 0.384547
[9]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.38557	valid_1's auc: 0.904192	valid_1's binary_logloss: 0.376078
[10]	valid_0's auc: 0.901746	valid_0's binary_logloss: 0.377945	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.368806
[11]	valid_0's auc: 0.90252	valid_0's binary_logloss: 0.371205	valid_1's auc: 0.904908	valid_1's binary_logloss: 0.362532
[12]	valid_0's auc: 0.903208	valid_0's binary_logloss: 0.365265	valid_1's auc: 0.905106	valid_1's binary_logloss: 0.35705
[13]	valid_0's auc: 0.904384	valid_0's binary_logloss: 0.359865	valid_1's auc: 0.90581	valid_1's binary_logloss: 0.352017
[14]	valid_0's auc: 0.905128	valid_0's binary_logloss: 0.355111	valid_1's auc: 0.905975	valid_1's binary_logloss: 0.347824
[15]	valid_0's auc: 0.905705	valid_0's binary_logloss: 0.350793	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.343996
[16]	valid_0's auc: 0.906417	valid_0's binary_logloss: 0.34692	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.340538
[17]	valid_0's auc: 0.906991	valid_0's binary_logloss: 0.343486	valid_1's auc: 0.907413	valid_1's binary_logloss: 0.337566
[18]	valid_0's auc: 0.907685	valid_0's binary_logloss: 0.3403	valid_1's auc: 0.907541	valid_1's binary_logloss: 0.335193
[19]	valid_0's auc: 0.908697	valid_0's binary_logloss: 0.33718	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.332963
[20]	valid_0's auc: 0.909236	valid_0's binary_logloss: 0.334664	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.331169
[21]	valid_0's auc: 0.909946	valid_0's binary_logloss: 0.332149	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.329395
[22]	valid_0's auc: 0.91055	valid_0's binary_logloss: 0.329865	valid_1's auc: 0.907693	valid_1's binary_logloss: 0.327991
[23]	valid_0's auc: 0.911096	valid_0's binary_logloss: 0.327761	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.326502
[24]	valid_0's auc: 0.911622	valid_0's binary_logloss: 0.325895	valid_1's auc: 0.907813	valid_1's binary_logloss: 0.325328
[25]	valid_0's auc: 0.912289	valid_0's binary_logloss: 0.324032	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.324371
[26]	valid_0's auc: 0.912815	valid_0's binary_logloss: 0.32235	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.323317
[27]	valid_0's auc: 0.91329	valid_0's binary_logloss: 0.320853	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.322224
[28]	valid_0's auc: 0.913917	valid_0's binary_logloss: 0.319217	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.321302
[29]	valid_0's auc: 0.914402	valid_0's binary_logloss: 0.317782	valid_1's auc: 0.908546	valid_1's binary_logloss: 0.320602
[30]	valid_0's auc: 0.915019	valid_0's binary_logloss: 0.316293	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.319785
[31]	valid_0's auc: 0.915387	valid_0's binary_logloss: 0.315067	valid_1's auc: 0.909007	valid_1's binary_logloss: 0.319032
[32]	valid_0's auc: 0.91583	valid_0's binary_logloss: 0.31384	valid_1's auc: 0.909138	valid_1's binary_logloss: 0.318339
[33]	valid_0's auc: 0.916354	valid_0's binary_logloss: 0.312538	valid_1's auc: 0.909011	valid_1's binary_logloss: 0.318132
[34]	valid_0's auc: 0.916802	valid_0's binary_logloss: 0.311432	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.317532
[35]	valid_0's auc: 0.917239	valid_0's binary_logloss: 0.310354	valid_1's auc: 0.909012	valid_1's binary_logloss: 0.31753
[36]	valid_0's auc: 0.917734	valid_0's binary_logloss: 0.309295	valid_1's auc: 0.908956	valid_1's binary_logloss: 0.317387
[37]	valid_0's auc: 0.918224	valid_0's binary_logloss: 0.308235	valid_1's auc: 0.908942	valid_1's binary_logloss: 0.317161
[38]	valid_0's auc: 0.918653	valid_0's binary_logloss: 0.307231	valid_1's auc: 0.908973	valid_1's binary_logloss: 0.316889
[39]	valid_0's auc: 0.919059	valid_0's binary_logloss: 0.306309	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.316821
[40]	valid_0's auc: 0.919502	valid_0's binary_logloss: 0.305317	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.316604
[41]	valid_0's auc: 0.919946	valid_0's binary_logloss: 0.30441	valid_1's auc: 0.908979	valid_1's binary_logloss: 0.316364
[42]	valid_0's auc: 0.920401	valid_0's binary_logloss: 0.303521	valid_1's auc: 0.908988	valid_1's binary_logloss: 0.316205
[43]	valid_0's auc: 0.920804	valid_0's binary_logloss: 0.302725	valid_1's auc: 0.908967	valid_1's binary_logloss: 0.316131
[44]	valid_0's auc: 0.921189	valid_0's binary_logloss: 0.301906	valid_1's auc: 0.908826	valid_1's binary_logloss: 0.316251
[45]	valid_0's auc: 0.921589	valid_0's binary_logloss: 0.30112	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.316257
[46]	valid_0's auc: 0.922026	valid_0's binary_logloss: 0.300273	valid_1's auc: 0.908626	valid_1's binary_logloss: 0.316418
[47]	valid_0's auc: 0.92249	valid_0's binary_logloss: 0.299381	valid_1's auc: 0.908726	valid_1's binary_logloss: 0.316232
[48]	valid_0's auc: 0.922875	valid_0's binary_logloss: 0.298649	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.316235
[49]	valid_0's auc: 0.923227	valid_0's binary_logloss: 0.297966	valid_1's auc: 0.908616	valid_1's binary_logloss: 0.316207
[50]	valid_0's auc: 0.923544	valid_0's binary_logloss: 0.297361	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.316117
[51]	valid_0's auc: 0.923934	valid_0's binary_logloss: 0.296621	valid_1's auc: 0.908631	valid_1's binary_logloss: 0.316127
[52]	valid_0's auc: 0.924327	valid_0's binary_logloss: 0.295876	valid_1's auc: 0.908623	valid_1's binary_logloss: 0.316091
[53]	valid_0's auc: 0.924725	valid_0's binary_logloss: 0.295209	valid_1's auc: 0.908666	valid_1's binary_logloss: 0.316003
[54]	valid_0's auc: 0.925046	valid_0's binary_logloss: 0.294597	valid_1's auc: 0.908572	valid_1's binary_logloss: 0.316123
[55]	valid_0's auc: 0.925369	valid_0's binary_logloss: 0.293972	valid_1's auc: 0.908567	valid_1's binary_logloss: 0.316114
[56]	valid_0's auc: 0.925579	valid_0's binary_logloss: 0.293536	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.316026
[57]	valid_0's auc: 0.925931	valid_0's binary_logloss: 0.292928	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.316013
[58]	valid_0's auc: 0.926224	valid_0's binary_logloss: 0.292399	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.316039
[59]	valid_0's auc: 0.926538	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.908602	valid_1's binary_logloss: 0.31605
[60]	valid_0's auc: 0.926954	valid_0's binary_logloss: 0.291086	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.31629
[61]	valid_0's auc: 0.92723	valid_0's binary_logloss: 0.290576	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.31632
[62]	valid_0's auc: 0.927503	valid_0's binary_logloss: 0.290072	valid_1's auc: 0.908419	valid_1's binary_logloss: 0.316357
[63]	valid_0's auc: 0.927803	valid_0's binary_logloss: 0.289538	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.316468
[64]	valid_0's auc: 0.928077	valid_0's binary_logloss: 0.288985	valid_1's auc: 0.908296	valid_1's binary_logloss: 0.316546
[65]	valid_0's auc: 0.928388	valid_0's binary_logloss: 0.288457	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.316546
[66]	valid_0's auc: 0.928733	valid_0's binary_logloss: 0.287876	valid_1's auc: 0.908202	valid_1's binary_logloss: 0.316669
[67]	valid_0's auc: 0.929049	valid_0's binary_logloss: 0.287345	valid_1's auc: 0.908191	valid_1's binary_logloss: 0.316665
[68]	valid_0's auc: 0.929419	valid_0's binary_logloss: 0.286763	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.316757
[69]	valid_0's auc: 0.929715	valid_0's binary_logloss: 0.286234	valid_1's auc: 0.908156	valid_1's binary_logloss: 0.316807
[70]	valid_0's auc: 0.929892	valid_0's binary_logloss: 0.285859	valid_1's auc: 0.908141	valid_1's binary_logloss: 0.316831
[71]	valid_0's auc: 0.930167	valid_0's binary_logloss: 0.285375	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316851
[72]	valid_0's auc: 0.930415	valid_0's binary_logloss: 0.284952	valid_1's auc: 0.908137	valid_1's binary_logloss: 0.31689
[73]	valid_0's auc: 0.930696	valid_0's binary_logloss: 0.284465	valid_1's auc: 0.908214	valid_1's binary_logloss: 0.316772
[74]	valid_0's auc: 0.930906	valid_0's binary_logloss: 0.284044	valid_1's auc: 0.908148	valid_1's binary_logloss: 0.316901
[75]	valid_0's auc: 0.93114	valid_0's binary_logloss: 0.283662	valid_1's auc: 0.908138	valid_1's binary_logloss: 0.31691
[76]	valid_0's auc: 0.931411	valid_0's binary_logloss: 0.283182	valid_1's auc: 0.908085	valid_1's binary_logloss: 0.31702
[77]	valid_0's auc: 0.931698	valid_0's binary_logloss: 0.282703	valid_1's auc: 0.907998	valid_1's binary_logloss: 0.317124
[78]	valid_0's auc: 0.931918	valid_0's binary_logloss: 0.282304	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317312
[79]	valid_0's auc: 0.932224	valid_0's binary_logloss: 0.28178	valid_1's auc: 0.907724	valid_1's binary_logloss: 0.317566
[80]	valid_0's auc: 0.932421	valid_0's binary_logloss: 0.281403	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317591
[81]	valid_0's auc: 0.932605	valid_0's binary_logloss: 0.281048	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.317643
[82]	valid_0's auc: 0.932886	valid_0's binary_logloss: 0.280521	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.31769
[83]	valid_0's auc: 0.933196	valid_0's binary_logloss: 0.279997	valid_1's auc: 0.907671	valid_1's binary_logloss: 0.317635
[84]	valid_0's auc: 0.933477	valid_0's binary_logloss: 0.279501	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317667
[85]	valid_0's auc: 0.933728	valid_0's binary_logloss: 0.279039	valid_1's auc: 0.907616	valid_1's binary_logloss: 0.317781
[86]	valid_0's auc: 0.933976	valid_0's binary_logloss: 0.278647	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318148
[87]	valid_0's auc: 0.934289	valid_0's binary_logloss: 0.278067	valid_1's auc: 0.907425	valid_1's binary_logloss: 0.318076
[88]	valid_0's auc: 0.934453	valid_0's binary_logloss: 0.277729	valid_1's auc: 0.907298	valid_1's binary_logloss: 0.318265
[89]	valid_0's auc: 0.934682	valid_0's binary_logloss: 0.277329	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318361
[90]	valid_0's auc: 0.935014	valid_0's binary_logloss: 0.276763	valid_1's auc: 0.907298	valid_1's binary_logloss: 0.318282
[91]	valid_0's auc: 0.935164	valid_0's binary_logloss: 0.276458	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318411
[92]	valid_0's auc: 0.935467	valid_0's binary_logloss: 0.27594	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.31837
[93]	valid_0's auc: 0.935697	valid_0's binary_logloss: 0.275542	valid_1's auc: 0.907156	valid_1's binary_logloss: 0.318532
[94]	valid_0's auc: 0.935915	valid_0's binary_logloss: 0.275126	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.318485
[95]	valid_0's auc: 0.936162	valid_0's binary_logloss: 0.274699	valid_1's auc: 0.907071	valid_1's binary_logloss: 0.318683
[96]	valid_0's auc: 0.936292	valid_0's binary_logloss: 0.274455	valid_1's auc: 0.90693	valid_1's binary_logloss: 0.318937
[97]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.274062	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.319142
[98]	valid_0's auc: 0.936673	valid_0's binary_logloss: 0.273734	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.318993
[99]	valid_0's auc: 0.936868	valid_0's binary_logloss: 0.273326	valid_1's auc: 0.907019	valid_1's binary_logloss: 0.318859
[100]	valid_0's auc: 0.937118	valid_0's binary_logloss: 0.272887	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.318774
[101]	valid_0's auc: 0.937303	valid_0's binary_logloss: 0.272559	valid_1's auc: 0.907039	valid_1's binary_logloss: 0.318837
[102]	valid_0's auc: 0.937483	valid_0's binary_logloss: 0.272225	valid_1's auc: 0.907035	valid_1's binary_logloss: 0.318844
[103]	valid_0's auc: 0.937661	valid_0's binary_logloss: 0.271877	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318849
[104]	valid_0's auc: 0.937867	valid_0's binary_logloss: 0.271476	valid_1's auc: 0.907009	valid_1's binary_logloss: 0.318842
[105]	valid_0's auc: 0.938085	valid_0's binary_logloss: 0.271081	valid_1's auc: 0.906924	valid_1's binary_logloss: 0.318947
[106]	valid_0's auc: 0.938354	valid_0's binary_logloss: 0.270601	valid_1's auc: 0.906937	valid_1's binary_logloss: 0.31897
[107]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.270235	valid_1's auc: 0.906825	valid_1's binary_logloss: 0.319159
[108]	valid_0's auc: 0.938785	valid_0's binary_logloss: 0.269838	valid_1's auc: 0.906862	valid_1's binary_logloss: 0.319182
[109]	valid_0's auc: 0.938934	valid_0's binary_logloss: 0.269559	valid_1's auc: 0.906779	valid_1's binary_logloss: 0.319397
[110]	valid_0's auc: 0.939096	valid_0's binary_logloss: 0.269258	valid_1's auc: 0.90673	valid_1's binary_logloss: 0.31956
[111]	valid_0's auc: 0.939269	valid_0's binary_logloss: 0.268906	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.319407
[112]	valid_0's auc: 0.939449	valid_0's binary_logloss: 0.268568	valid_1's auc: 0.906731	valid_1's binary_logloss: 0.319576
[113]	valid_0's auc: 0.939771	valid_0's binary_logloss: 0.268029	valid_1's auc: 0.906711	valid_1's binary_logloss: 0.319599
[114]	valid_0's auc: 0.94006	valid_0's binary_logloss: 0.267503	valid_1's auc: 0.906693	valid_1's binary_logloss: 0.319699
[115]	valid_0's auc: 0.940224	valid_0's binary_logloss: 0.2672	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.319714
[116]	valid_0's auc: 0.940445	valid_0's binary_logloss: 0.266824	valid_1's auc: 0.906677	valid_1's binary_logloss: 0.319732
[117]	valid_0's auc: 0.940636	valid_0's binary_logloss: 0.266474	valid_1's auc: 0.906535	valid_1's binary_logloss: 0.320009
[118]	valid_0's auc: 0.940794	valid_0's binary_logloss: 0.266196	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.320227
[119]	valid_0's auc: 0.941021	valid_0's binary_logloss: 0.265793	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320407
[120]	valid_0's auc: 0.941227	valid_0's binary_logloss: 0.265412	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.320474
[121]	valid_0's auc: 0.941351	valid_0's binary_logloss: 0.26517	valid_1's auc: 0.906213	valid_1's binary_logloss: 0.320714
[122]	valid_0's auc: 0.941582	valid_0's binary_logloss: 0.264732	valid_1's auc: 0.906262	valid_1's binary_logloss: 0.320721
[123]	valid_0's auc: 0.941828	valid_0's binary_logloss: 0.264314	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.320669
[124]	valid_0's auc: 0.942058	valid_0's binary_logloss: 0.263911	valid_1's auc: 0.906263	valid_1's binary_logloss: 0.320703
[125]	valid_0's auc: 0.942219	valid_0's binary_logloss: 0.263604	valid_1's auc: 0.906292	valid_1's binary_logloss: 0.320732
[126]	valid_0's auc: 0.942336	valid_0's binary_logloss: 0.263362	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.320889
[127]	valid_0's auc: 0.942531	valid_0's binary_logloss: 0.263001	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320982
[128]	valid_0's auc: 0.942742	valid_0's binary_logloss: 0.262636	valid_1's auc: 0.906155	valid_1's binary_logloss: 0.321039
[129]	valid_0's auc: 0.942937	valid_0's binary_logloss: 0.262268	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321311
[130]	valid_0's auc: 0.943155	valid_0's binary_logloss: 0.261898	valid_1's auc: 0.90588	valid_1's binary_logloss: 0.321501
[131]	valid_0's auc: 0.943378	valid_0's binary_logloss: 0.261518	valid_1's auc: 0.905774	valid_1's binary_logloss: 0.32168
[132]	valid_0's auc: 0.943537	valid_0's binary_logloss: 0.261213	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.32176
[133]	valid_0's auc: 0.943667	valid_0's binary_logloss: 0.260918	valid_1's auc: 0.905698	valid_1's binary_logloss: 0.321856
[134]	valid_0's auc: 0.943811	valid_0's binary_logloss: 0.260644	valid_1's auc: 0.90573	valid_1's binary_logloss: 0.321815
Early stopping, best iteration is:
[34]	valid_0's auc: 0.916802	valid_0's binary_logloss: 0.311432	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.317532
[1]	valid_0's auc: 0.888568	valid_0's binary_logloss: 0.517232	valid_1's auc: 0.893169	valid_1's binary_logloss: 0.508727
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.893525	valid_0's binary_logloss: 0.48805	valid_1's auc: 0.898612	valid_1's binary_logloss: 0.479079
[3]	valid_0's auc: 0.895098	valid_0's binary_logloss: 0.465044	valid_1's auc: 0.899666	valid_1's binary_logloss: 0.45542
[4]	valid_0's auc: 0.897204	valid_0's binary_logloss: 0.445626	valid_1's auc: 0.9009	valid_1's binary_logloss: 0.436065
[5]	valid_0's auc: 0.898082	valid_0's binary_logloss: 0.429582	valid_1's auc: 0.901179	valid_1's binary_logloss: 0.420084
[6]	valid_0's auc: 0.899115	valid_0's binary_logloss: 0.416064	valid_1's auc: 0.902064	valid_1's binary_logloss: 0.406467
[7]	valid_0's auc: 0.900214	valid_0's binary_logloss: 0.404266	valid_1's auc: 0.90418	valid_1's binary_logloss: 0.394517
[8]	valid_0's auc: 0.901071	valid_0's binary_logloss: 0.394186	valid_1's auc: 0.904674	valid_1's binary_logloss: 0.384528
[9]	valid_0's auc: 0.902053	valid_0's binary_logloss: 0.3852	valid_1's auc: 0.904911	valid_1's binary_logloss: 0.375991
[10]	valid_0's auc: 0.902655	valid_0's binary_logloss: 0.377691	valid_1's auc: 0.905876	valid_1's binary_logloss: 0.368542
[11]	valid_0's auc: 0.903721	valid_0's binary_logloss: 0.370845	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.36216
[12]	valid_0's auc: 0.90431	valid_0's binary_logloss: 0.364817	valid_1's auc: 0.906361	valid_1's binary_logloss: 0.356697
[13]	valid_0's auc: 0.904899	valid_0's binary_logloss: 0.359461	valid_1's auc: 0.906267	valid_1's binary_logloss: 0.351973
[14]	valid_0's auc: 0.905407	valid_0's binary_logloss: 0.354683	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.347605
[15]	valid_0's auc: 0.906465	valid_0's binary_logloss: 0.350386	valid_1's auc: 0.906783	valid_1's binary_logloss: 0.343947
[16]	valid_0's auc: 0.90723	valid_0's binary_logloss: 0.34651	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.340617
[17]	valid_0's auc: 0.908007	valid_0's binary_logloss: 0.342861	valid_1's auc: 0.907347	valid_1's binary_logloss: 0.337651
[18]	valid_0's auc: 0.908692	valid_0's binary_logloss: 0.33958	valid_1's auc: 0.907925	valid_1's binary_logloss: 0.334813
[19]	valid_0's auc: 0.909248	valid_0's binary_logloss: 0.336732	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.33248
[20]	valid_0's auc: 0.909698	valid_0's binary_logloss: 0.334193	valid_1's auc: 0.90825	valid_1's binary_logloss: 0.330503
[21]	valid_0's auc: 0.91022	valid_0's binary_logloss: 0.331805	valid_1's auc: 0.908195	valid_1's binary_logloss: 0.328873
[22]	valid_0's auc: 0.910723	valid_0's binary_logloss: 0.329569	valid_1's auc: 0.908173	valid_1's binary_logloss: 0.327318
[23]	valid_0's auc: 0.911334	valid_0's binary_logloss: 0.327545	valid_1's auc: 0.908426	valid_1's binary_logloss: 0.325928
[24]	valid_0's auc: 0.91178	valid_0's binary_logloss: 0.325766	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.324527
[25]	valid_0's auc: 0.91235	valid_0's binary_logloss: 0.323882	valid_1's auc: 0.908703	valid_1's binary_logloss: 0.323296
[26]	valid_0's auc: 0.912875	valid_0's binary_logloss: 0.322191	valid_1's auc: 0.908859	valid_1's binary_logloss: 0.322266
[27]	valid_0's auc: 0.913446	valid_0's binary_logloss: 0.320582	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.321188
[28]	valid_0's auc: 0.914021	valid_0's binary_logloss: 0.319007	valid_1's auc: 0.909064	valid_1's binary_logloss: 0.32064
[29]	valid_0's auc: 0.91453	valid_0's binary_logloss: 0.317563	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.319928
[30]	valid_0's auc: 0.914988	valid_0's binary_logloss: 0.316258	valid_1's auc: 0.909158	valid_1's binary_logloss: 0.319377
[31]	valid_0's auc: 0.915447	valid_0's binary_logloss: 0.315014	valid_1's auc: 0.909234	valid_1's binary_logloss: 0.318836
[32]	valid_0's auc: 0.916004	valid_0's binary_logloss: 0.313704	valid_1's auc: 0.909233	valid_1's binary_logloss: 0.31843
[33]	valid_0's auc: 0.916516	valid_0's binary_logloss: 0.312524	valid_1's auc: 0.909308	valid_1's binary_logloss: 0.318038
[34]	valid_0's auc: 0.91702	valid_0's binary_logloss: 0.311323	valid_1's auc: 0.909333	valid_1's binary_logloss: 0.317683
[35]	valid_0's auc: 0.917566	valid_0's binary_logloss: 0.310179	valid_1's auc: 0.909391	valid_1's binary_logloss: 0.317375
[36]	valid_0's auc: 0.918038	valid_0's binary_logloss: 0.309089	valid_1's auc: 0.90942	valid_1's binary_logloss: 0.316991
[37]	valid_0's auc: 0.918548	valid_0's binary_logloss: 0.307977	valid_1's auc: 0.909601	valid_1's binary_logloss: 0.316524
[38]	valid_0's auc: 0.918885	valid_0's binary_logloss: 0.307146	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.316283
[39]	valid_0's auc: 0.919367	valid_0's binary_logloss: 0.306119	valid_1's auc: 0.909652	valid_1's binary_logloss: 0.316007
[40]	valid_0's auc: 0.919749	valid_0's binary_logloss: 0.305228	valid_1's auc: 0.909725	valid_1's binary_logloss: 0.315747
[41]	valid_0's auc: 0.920216	valid_0's binary_logloss: 0.30429	valid_1's auc: 0.909649	valid_1's binary_logloss: 0.315732
[42]	valid_0's auc: 0.920589	valid_0's binary_logloss: 0.303533	valid_1's auc: 0.90952	valid_1's binary_logloss: 0.315782
[43]	valid_0's auc: 0.920984	valid_0's binary_logloss: 0.302712	valid_1's auc: 0.909372	valid_1's binary_logloss: 0.315902
[44]	valid_0's auc: 0.921338	valid_0's binary_logloss: 0.3019	valid_1's auc: 0.909483	valid_1's binary_logloss: 0.315604
[45]	valid_0's auc: 0.921725	valid_0's binary_logloss: 0.301141	valid_1's auc: 0.909425	valid_1's binary_logloss: 0.315596
[46]	valid_0's auc: 0.922081	valid_0's binary_logloss: 0.300415	valid_1's auc: 0.90946	valid_1's binary_logloss: 0.315457
[47]	valid_0's auc: 0.922412	valid_0's binary_logloss: 0.299754	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.315529
[48]	valid_0's auc: 0.922782	valid_0's binary_logloss: 0.299103	valid_1's auc: 0.909121	valid_1's binary_logloss: 0.315671
[49]	valid_0's auc: 0.923196	valid_0's binary_logloss: 0.29834	valid_1's auc: 0.909155	valid_1's binary_logloss: 0.31552
[50]	valid_0's auc: 0.923549	valid_0's binary_logloss: 0.297628	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.315421
[51]	valid_0's auc: 0.923941	valid_0's binary_logloss: 0.296895	valid_1's auc: 0.90913	valid_1's binary_logloss: 0.315448
[52]	valid_0's auc: 0.924314	valid_0's binary_logloss: 0.296236	valid_1's auc: 0.908949	valid_1's binary_logloss: 0.315646
[53]	valid_0's auc: 0.924737	valid_0's binary_logloss: 0.295473	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.315416
[54]	valid_0's auc: 0.925168	valid_0's binary_logloss: 0.294633	valid_1's auc: 0.908931	valid_1's binary_logloss: 0.315562
[55]	valid_0's auc: 0.925498	valid_0's binary_logloss: 0.294016	valid_1's auc: 0.908971	valid_1's binary_logloss: 0.315559
[56]	valid_0's auc: 0.925901	valid_0's binary_logloss: 0.293289	valid_1's auc: 0.908801	valid_1's binary_logloss: 0.315821
[57]	valid_0's auc: 0.92623	valid_0's binary_logloss: 0.292643	valid_1's auc: 0.908779	valid_1's binary_logloss: 0.315833
[58]	valid_0's auc: 0.926543	valid_0's binary_logloss: 0.29212	valid_1's auc: 0.90868	valid_1's binary_logloss: 0.315941
[59]	valid_0's auc: 0.926888	valid_0's binary_logloss: 0.291566	valid_1's auc: 0.908583	valid_1's binary_logloss: 0.31607
[60]	valid_0's auc: 0.927169	valid_0's binary_logloss: 0.291117	valid_1's auc: 0.908554	valid_1's binary_logloss: 0.316048
[61]	valid_0's auc: 0.927454	valid_0's binary_logloss: 0.290517	valid_1's auc: 0.908558	valid_1's binary_logloss: 0.316007
[62]	valid_0's auc: 0.927686	valid_0's binary_logloss: 0.290063	valid_1's auc: 0.90859	valid_1's binary_logloss: 0.31599
[63]	valid_0's auc: 0.928046	valid_0's binary_logloss: 0.289469	valid_1's auc: 0.908388	valid_1's binary_logloss: 0.316305
[64]	valid_0's auc: 0.928376	valid_0's binary_logloss: 0.288875	valid_1's auc: 0.90836	valid_1's binary_logloss: 0.316349
[65]	valid_0's auc: 0.928633	valid_0's binary_logloss: 0.288338	valid_1's auc: 0.908259	valid_1's binary_logloss: 0.316569
[66]	valid_0's auc: 0.928954	valid_0's binary_logloss: 0.287815	valid_1's auc: 0.90832	valid_1's binary_logloss: 0.316501
[67]	valid_0's auc: 0.929233	valid_0's binary_logloss: 0.287287	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.31656
[68]	valid_0's auc: 0.929571	valid_0's binary_logloss: 0.28666	valid_1's auc: 0.908133	valid_1's binary_logloss: 0.316776
[69]	valid_0's auc: 0.929856	valid_0's binary_logloss: 0.286114	valid_1's auc: 0.908088	valid_1's binary_logloss: 0.316866
[70]	valid_0's auc: 0.930184	valid_0's binary_logloss: 0.285584	valid_1's auc: 0.90802	valid_1's binary_logloss: 0.316989
[71]	valid_0's auc: 0.930529	valid_0's binary_logloss: 0.285011	valid_1's auc: 0.908058	valid_1's binary_logloss: 0.316974
[72]	valid_0's auc: 0.930783	valid_0's binary_logloss: 0.284524	valid_1's auc: 0.90794	valid_1's binary_logloss: 0.317187
[73]	valid_0's auc: 0.931083	valid_0's binary_logloss: 0.284038	valid_1's auc: 0.907841	valid_1's binary_logloss: 0.317356
[74]	valid_0's auc: 0.931406	valid_0's binary_logloss: 0.283502	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.317357
[75]	valid_0's auc: 0.931698	valid_0's binary_logloss: 0.282958	valid_1's auc: 0.907775	valid_1's binary_logloss: 0.317616
[76]	valid_0's auc: 0.931924	valid_0's binary_logloss: 0.282539	valid_1's auc: 0.907771	valid_1's binary_logloss: 0.317652
[77]	valid_0's auc: 0.932272	valid_0's binary_logloss: 0.281918	valid_1's auc: 0.907864	valid_1's binary_logloss: 0.317496
[78]	valid_0's auc: 0.932529	valid_0's binary_logloss: 0.281459	valid_1's auc: 0.907837	valid_1's binary_logloss: 0.317524
[79]	valid_0's auc: 0.932777	valid_0's binary_logloss: 0.280976	valid_1's auc: 0.907785	valid_1's binary_logloss: 0.317682
[80]	valid_0's auc: 0.933025	valid_0's binary_logloss: 0.280538	valid_1's auc: 0.90769	valid_1's binary_logloss: 0.31785
[81]	valid_0's auc: 0.933401	valid_0's binary_logloss: 0.27989	valid_1's auc: 0.907718	valid_1's binary_logloss: 0.317857
[82]	valid_0's auc: 0.933653	valid_0's binary_logloss: 0.279474	valid_1's auc: 0.907695	valid_1's binary_logloss: 0.317885
[83]	valid_0's auc: 0.933921	valid_0's binary_logloss: 0.279015	valid_1's auc: 0.907548	valid_1's binary_logloss: 0.318127
[84]	valid_0's auc: 0.934172	valid_0's binary_logloss: 0.278523	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.318307
[85]	valid_0's auc: 0.934368	valid_0's binary_logloss: 0.278154	valid_1's auc: 0.907452	valid_1's binary_logloss: 0.318312
[86]	valid_0's auc: 0.934622	valid_0's binary_logloss: 0.27768	valid_1's auc: 0.907423	valid_1's binary_logloss: 0.318351
[87]	valid_0's auc: 0.93483	valid_0's binary_logloss: 0.277274	valid_1's auc: 0.907422	valid_1's binary_logloss: 0.318387
[88]	valid_0's auc: 0.935025	valid_0's binary_logloss: 0.276861	valid_1's auc: 0.907383	valid_1's binary_logloss: 0.318575
[89]	valid_0's auc: 0.935292	valid_0's binary_logloss: 0.276402	valid_1's auc: 0.907318	valid_1's binary_logloss: 0.31869
[90]	valid_0's auc: 0.935489	valid_0's binary_logloss: 0.276036	valid_1's auc: 0.90726	valid_1's binary_logloss: 0.318867
[91]	valid_0's auc: 0.935864	valid_0's binary_logloss: 0.275448	valid_1's auc: 0.907208	valid_1's binary_logloss: 0.318928
[92]	valid_0's auc: 0.93618	valid_0's binary_logloss: 0.274905	valid_1's auc: 0.90716	valid_1's binary_logloss: 0.319065
[93]	valid_0's auc: 0.936423	valid_0's binary_logloss: 0.274453	valid_1's auc: 0.907044	valid_1's binary_logloss: 0.319289
[94]	valid_0's auc: 0.936622	valid_0's binary_logloss: 0.274081	valid_1's auc: 0.907072	valid_1's binary_logloss: 0.319305
[95]	valid_0's auc: 0.93684	valid_0's binary_logloss: 0.273698	valid_1's auc: 0.906984	valid_1's binary_logloss: 0.319519
[96]	valid_0's auc: 0.937158	valid_0's binary_logloss: 0.273182	valid_1's auc: 0.906961	valid_1's binary_logloss: 0.319533
[97]	valid_0's auc: 0.937508	valid_0's binary_logloss: 0.272642	valid_1's auc: 0.907048	valid_1's binary_logloss: 0.319444
[98]	valid_0's auc: 0.937766	valid_0's binary_logloss: 0.272201	valid_1's auc: 0.906996	valid_1's binary_logloss: 0.319517
[99]	valid_0's auc: 0.938093	valid_0's binary_logloss: 0.27166	valid_1's auc: 0.907079	valid_1's binary_logloss: 0.319328
[100]	valid_0's auc: 0.938316	valid_0's binary_logloss: 0.271276	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.319272
[101]	valid_0's auc: 0.938685	valid_0's binary_logloss: 0.270675	valid_1's auc: 0.907051	valid_1's binary_logloss: 0.319412
[102]	valid_0's auc: 0.938854	valid_0's binary_logloss: 0.270319	valid_1's auc: 0.906996	valid_1's binary_logloss: 0.319541
[103]	valid_0's auc: 0.939072	valid_0's binary_logloss: 0.269918	valid_1's auc: 0.907042	valid_1's binary_logloss: 0.319459
[104]	valid_0's auc: 0.939259	valid_0's binary_logloss: 0.269535	valid_1's auc: 0.907049	valid_1's binary_logloss: 0.319452
[105]	valid_0's auc: 0.9395	valid_0's binary_logloss: 0.269118	valid_1's auc: 0.906985	valid_1's binary_logloss: 0.319529
[106]	valid_0's auc: 0.939727	valid_0's binary_logloss: 0.268749	valid_1's auc: 0.906955	valid_1's binary_logloss: 0.319585
[107]	valid_0's auc: 0.939951	valid_0's binary_logloss: 0.268335	valid_1's auc: 0.906967	valid_1's binary_logloss: 0.319561
[108]	valid_0's auc: 0.940218	valid_0's binary_logloss: 0.267897	valid_1's auc: 0.906929	valid_1's binary_logloss: 0.319586
[109]	valid_0's auc: 0.940443	valid_0's binary_logloss: 0.267477	valid_1's auc: 0.906794	valid_1's binary_logloss: 0.319827
[110]	valid_0's auc: 0.940665	valid_0's binary_logloss: 0.267096	valid_1's auc: 0.906686	valid_1's binary_logloss: 0.320009
[111]	valid_0's auc: 0.940924	valid_0's binary_logloss: 0.266638	valid_1's auc: 0.906588	valid_1's binary_logloss: 0.320188
[112]	valid_0's auc: 0.941144	valid_0's binary_logloss: 0.266195	valid_1's auc: 0.906551	valid_1's binary_logloss: 0.320262
[113]	valid_0's auc: 0.941297	valid_0's binary_logloss: 0.265856	valid_1's auc: 0.906429	valid_1's binary_logloss: 0.320505
[114]	valid_0's auc: 0.941472	valid_0's binary_logloss: 0.265543	valid_1's auc: 0.906324	valid_1's binary_logloss: 0.320688
[115]	valid_0's auc: 0.941633	valid_0's binary_logloss: 0.265209	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.320763
[116]	valid_0's auc: 0.941829	valid_0's binary_logloss: 0.264854	valid_1's auc: 0.90625	valid_1's binary_logloss: 0.320848
[117]	valid_0's auc: 0.942026	valid_0's binary_logloss: 0.264496	valid_1's auc: 0.906236	valid_1's binary_logloss: 0.320909
[118]	valid_0's auc: 0.942307	valid_0's binary_logloss: 0.263948	valid_1's auc: 0.906279	valid_1's binary_logloss: 0.320901
[119]	valid_0's auc: 0.94248	valid_0's binary_logloss: 0.263622	valid_1's auc: 0.90622	valid_1's binary_logloss: 0.320999
[120]	valid_0's auc: 0.942622	valid_0's binary_logloss: 0.263312	valid_1's auc: 0.906155	valid_1's binary_logloss: 0.321122
[121]	valid_0's auc: 0.942807	valid_0's binary_logloss: 0.262989	valid_1's auc: 0.906068	valid_1's binary_logloss: 0.321307
[122]	valid_0's auc: 0.943073	valid_0's binary_logloss: 0.262508	valid_1's auc: 0.905986	valid_1's binary_logloss: 0.321427
[123]	valid_0's auc: 0.943236	valid_0's binary_logloss: 0.262206	valid_1's auc: 0.905848	valid_1's binary_logloss: 0.321715
[124]	valid_0's auc: 0.943388	valid_0's binary_logloss: 0.261939	valid_1's auc: 0.905734	valid_1's binary_logloss: 0.321929
[125]	valid_0's auc: 0.943552	valid_0's binary_logloss: 0.261623	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.321994
[126]	valid_0's auc: 0.943737	valid_0's binary_logloss: 0.261277	valid_1's auc: 0.905733	valid_1's binary_logloss: 0.322007
[127]	valid_0's auc: 0.943997	valid_0's binary_logloss: 0.260789	valid_1's auc: 0.90577	valid_1's binary_logloss: 0.321959
[128]	valid_0's auc: 0.94416	valid_0's binary_logloss: 0.260495	valid_1's auc: 0.905721	valid_1's binary_logloss: 0.322057
[129]	valid_0's auc: 0.944396	valid_0's binary_logloss: 0.260085	valid_1's auc: 0.905682	valid_1's binary_logloss: 0.322132
[130]	valid_0's auc: 0.944561	valid_0's binary_logloss: 0.259764	valid_1's auc: 0.905672	valid_1's binary_logloss: 0.322187
[131]	valid_0's auc: 0.944717	valid_0's binary_logloss: 0.259469	valid_1's auc: 0.90559	valid_1's binary_logloss: 0.32237
[132]	valid_0's auc: 0.94496	valid_0's binary_logloss: 0.259057	valid_1's auc: 0.905533	valid_1's binary_logloss: 0.32246
[133]	valid_0's auc: 0.945113	valid_0's binary_logloss: 0.258753	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.322625
[134]	valid_0's auc: 0.945346	valid_0's binary_logloss: 0.258341	valid_1's auc: 0.905439	valid_1's binary_logloss: 0.322656
[135]	valid_0's auc: 0.945527	valid_0's binary_logloss: 0.257972	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322833
[136]	valid_0's auc: 0.945729	valid_0's binary_logloss: 0.257624	valid_1's auc: 0.905383	valid_1's binary_logloss: 0.322849
[137]	valid_0's auc: 0.945899	valid_0's binary_logloss: 0.257286	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.323046
[138]	valid_0's auc: 0.946053	valid_0's binary_logloss: 0.257007	valid_1's auc: 0.905287	valid_1's binary_logloss: 0.3231
[139]	valid_0's auc: 0.946249	valid_0's binary_logloss: 0.256674	valid_1's auc: 0.905247	valid_1's binary_logloss: 0.323165
[140]	valid_0's auc: 0.94644	valid_0's binary_logloss: 0.256355	valid_1's auc: 0.905202	valid_1's binary_logloss: 0.323247
Early stopping, best iteration is:
[40]	valid_0's auc: 0.919749	valid_0's binary_logloss: 0.305228	valid_1's auc: 0.909725	valid_1's binary_logloss: 0.315747
[1]	valid_0's auc: 0.883999	valid_0's binary_logloss: 0.517495	valid_1's auc: 0.891234	valid_1's binary_logloss: 0.508616
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891027	valid_0's binary_logloss: 0.488825	valid_1's auc: 0.896641	valid_1's binary_logloss: 0.479157
[3]	valid_0's auc: 0.894951	valid_0's binary_logloss: 0.465291	valid_1's auc: 0.899671	valid_1's binary_logloss: 0.455294
[4]	valid_0's auc: 0.89606	valid_0's binary_logloss: 0.4462	valid_1's auc: 0.900601	valid_1's binary_logloss: 0.435941
[5]	valid_0's auc: 0.897345	valid_0's binary_logloss: 0.43003	valid_1's auc: 0.900711	valid_1's binary_logloss: 0.419873
[6]	valid_0's auc: 0.898499	valid_0's binary_logloss: 0.41635	valid_1's auc: 0.901767	valid_1's binary_logloss: 0.406108
[7]	valid_0's auc: 0.89983	valid_0's binary_logloss: 0.404494	valid_1's auc: 0.903447	valid_1's binary_logloss: 0.394511
[8]	valid_0's auc: 0.900425	valid_0's binary_logloss: 0.394452	valid_1's auc: 0.903731	valid_1's binary_logloss: 0.38466
[9]	valid_0's auc: 0.901201	valid_0's binary_logloss: 0.385617	valid_1's auc: 0.903911	valid_1's binary_logloss: 0.376198
[10]	valid_0's auc: 0.901776	valid_0's binary_logloss: 0.378074	valid_1's auc: 0.904371	valid_1's binary_logloss: 0.368708
[11]	valid_0's auc: 0.902544	valid_0's binary_logloss: 0.37121	valid_1's auc: 0.905007	valid_1's binary_logloss: 0.362032
[12]	valid_0's auc: 0.90366	valid_0's binary_logloss: 0.364887	valid_1's auc: 0.905323	valid_1's binary_logloss: 0.356476
[13]	valid_0's auc: 0.904305	valid_0's binary_logloss: 0.359711	valid_1's auc: 0.905489	valid_1's binary_logloss: 0.351728
[14]	valid_0's auc: 0.905262	valid_0's binary_logloss: 0.354826	valid_1's auc: 0.906348	valid_1's binary_logloss: 0.347409
[15]	valid_0's auc: 0.90587	valid_0's binary_logloss: 0.350644	valid_1's auc: 0.906499	valid_1's binary_logloss: 0.343687
[16]	valid_0's auc: 0.90626	valid_0's binary_logloss: 0.347097	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.34054
[17]	valid_0's auc: 0.906847	valid_0's binary_logloss: 0.343667	valid_1's auc: 0.906957	valid_1's binary_logloss: 0.337566
[18]	valid_0's auc: 0.907604	valid_0's binary_logloss: 0.340382	valid_1's auc: 0.907072	valid_1's binary_logloss: 0.334917
[19]	valid_0's auc: 0.908469	valid_0's binary_logloss: 0.337526	valid_1's auc: 0.907472	valid_1's binary_logloss: 0.332813
[20]	valid_0's auc: 0.909106	valid_0's binary_logloss: 0.334823	valid_1's auc: 0.908123	valid_1's binary_logloss: 0.330379
[21]	valid_0's auc: 0.90983	valid_0's binary_logloss: 0.332275	valid_1's auc: 0.908248	valid_1's binary_logloss: 0.328609
[22]	valid_0's auc: 0.910423	valid_0's binary_logloss: 0.330039	valid_1's auc: 0.908273	valid_1's binary_logloss: 0.327082
[23]	valid_0's auc: 0.911024	valid_0's binary_logloss: 0.327868	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.325315
[24]	valid_0's auc: 0.911643	valid_0's binary_logloss: 0.325822	valid_1's auc: 0.908721	valid_1's binary_logloss: 0.323958
[25]	valid_0's auc: 0.912262	valid_0's binary_logloss: 0.323893	valid_1's auc: 0.908958	valid_1's binary_logloss: 0.322623
[26]	valid_0's auc: 0.912921	valid_0's binary_logloss: 0.3221	valid_1's auc: 0.909061	valid_1's binary_logloss: 0.321584
[27]	valid_0's auc: 0.913534	valid_0's binary_logloss: 0.320456	valid_1's auc: 0.90905	valid_1's binary_logloss: 0.320858
[28]	valid_0's auc: 0.914054	valid_0's binary_logloss: 0.318955	valid_1's auc: 0.909104	valid_1's binary_logloss: 0.320027
[29]	valid_0's auc: 0.914615	valid_0's binary_logloss: 0.317458	valid_1's auc: 0.909226	valid_1's binary_logloss: 0.319309
[30]	valid_0's auc: 0.915149	valid_0's binary_logloss: 0.31606	valid_1's auc: 0.909254	valid_1's binary_logloss: 0.318635
[31]	valid_0's auc: 0.915747	valid_0's binary_logloss: 0.314594	valid_1's auc: 0.909271	valid_1's binary_logloss: 0.318097
[32]	valid_0's auc: 0.916292	valid_0's binary_logloss: 0.313305	valid_1's auc: 0.909364	valid_1's binary_logloss: 0.317534
[33]	valid_0's auc: 0.916726	valid_0's binary_logloss: 0.312095	valid_1's auc: 0.909305	valid_1's binary_logloss: 0.317174
[34]	valid_0's auc: 0.917118	valid_0's binary_logloss: 0.311005	valid_1's auc: 0.909362	valid_1's binary_logloss: 0.316755
[35]	valid_0's auc: 0.917654	valid_0's binary_logloss: 0.309841	valid_1's auc: 0.909523	valid_1's binary_logloss: 0.316201
[36]	valid_0's auc: 0.918039	valid_0's binary_logloss: 0.308913	valid_1's auc: 0.909495	valid_1's binary_logloss: 0.315974
[37]	valid_0's auc: 0.918497	valid_0's binary_logloss: 0.307924	valid_1's auc: 0.909609	valid_1's binary_logloss: 0.315616
[38]	valid_0's auc: 0.918861	valid_0's binary_logloss: 0.307015	valid_1's auc: 0.90966	valid_1's binary_logloss: 0.315252
[39]	valid_0's auc: 0.919305	valid_0's binary_logloss: 0.306077	valid_1's auc: 0.9097	valid_1's binary_logloss: 0.31504
[40]	valid_0's auc: 0.919842	valid_0's binary_logloss: 0.304975	valid_1's auc: 0.909724	valid_1's binary_logloss: 0.314742
[41]	valid_0's auc: 0.920194	valid_0's binary_logloss: 0.304166	valid_1's auc: 0.909677	valid_1's binary_logloss: 0.314676
[42]	valid_0's auc: 0.920645	valid_0's binary_logloss: 0.303277	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.31463
[43]	valid_0's auc: 0.921103	valid_0's binary_logloss: 0.302336	valid_1's auc: 0.909543	valid_1's binary_logloss: 0.31457
[44]	valid_0's auc: 0.921552	valid_0's binary_logloss: 0.30149	valid_1's auc: 0.909581	valid_1's binary_logloss: 0.314423
[45]	valid_0's auc: 0.921975	valid_0's binary_logloss: 0.3007	valid_1's auc: 0.909648	valid_1's binary_logloss: 0.314297
[46]	valid_0's auc: 0.922381	valid_0's binary_logloss: 0.299954	valid_1's auc: 0.909694	valid_1's binary_logloss: 0.314123
[47]	valid_0's auc: 0.922765	valid_0's binary_logloss: 0.299204	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.314006
[48]	valid_0's auc: 0.923109	valid_0's binary_logloss: 0.298492	valid_1's auc: 0.909707	valid_1's binary_logloss: 0.313963
[49]	valid_0's auc: 0.923454	valid_0's binary_logloss: 0.29784	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.314144
[50]	valid_0's auc: 0.92376	valid_0's binary_logloss: 0.297246	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.314209
[51]	valid_0's auc: 0.924082	valid_0's binary_logloss: 0.29663	valid_1's auc: 0.909482	valid_1's binary_logloss: 0.314088
[52]	valid_0's auc: 0.924329	valid_0's binary_logloss: 0.296142	valid_1's auc: 0.909446	valid_1's binary_logloss: 0.314043
[53]	valid_0's auc: 0.924595	valid_0's binary_logloss: 0.295611	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.314055
[54]	valid_0's auc: 0.92491	valid_0's binary_logloss: 0.295061	valid_1's auc: 0.909345	valid_1's binary_logloss: 0.314111
[55]	valid_0's auc: 0.925307	valid_0's binary_logloss: 0.294373	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.314066
[56]	valid_0's auc: 0.925698	valid_0's binary_logloss: 0.293631	valid_1's auc: 0.90932	valid_1's binary_logloss: 0.314162
[57]	valid_0's auc: 0.925986	valid_0's binary_logloss: 0.293135	valid_1's auc: 0.909261	valid_1's binary_logloss: 0.314255
[58]	valid_0's auc: 0.926295	valid_0's binary_logloss: 0.292596	valid_1's auc: 0.909408	valid_1's binary_logloss: 0.314055
[59]	valid_0's auc: 0.926545	valid_0's binary_logloss: 0.292118	valid_1's auc: 0.909387	valid_1's binary_logloss: 0.314014
[60]	valid_0's auc: 0.926869	valid_0's binary_logloss: 0.291548	valid_1's auc: 0.909413	valid_1's binary_logloss: 0.313946
[61]	valid_0's auc: 0.927234	valid_0's binary_logloss: 0.290915	valid_1's auc: 0.909417	valid_1's binary_logloss: 0.313924
[62]	valid_0's auc: 0.927591	valid_0's binary_logloss: 0.290293	valid_1's auc: 0.909518	valid_1's binary_logloss: 0.313753
[63]	valid_0's auc: 0.927831	valid_0's binary_logloss: 0.289853	valid_1's auc: 0.909531	valid_1's binary_logloss: 0.313747
[64]	valid_0's auc: 0.928174	valid_0's binary_logloss: 0.289295	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.313782
[65]	valid_0's auc: 0.928503	valid_0's binary_logloss: 0.288717	valid_1's auc: 0.909415	valid_1's binary_logloss: 0.313939
[66]	valid_0's auc: 0.928851	valid_0's binary_logloss: 0.288131	valid_1's auc: 0.909229	valid_1's binary_logloss: 0.314234
[67]	valid_0's auc: 0.929135	valid_0's binary_logloss: 0.287573	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.314477
[68]	valid_0's auc: 0.929417	valid_0's binary_logloss: 0.287112	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.314477
[69]	valid_0's auc: 0.929673	valid_0's binary_logloss: 0.286648	valid_1's auc: 0.909105	valid_1's binary_logloss: 0.314483
[70]	valid_0's auc: 0.930026	valid_0's binary_logloss: 0.286086	valid_1's auc: 0.909157	valid_1's binary_logloss: 0.314447
[71]	valid_0's auc: 0.930255	valid_0's binary_logloss: 0.28571	valid_1's auc: 0.909062	valid_1's binary_logloss: 0.314559
[72]	valid_0's auc: 0.930527	valid_0's binary_logloss: 0.285169	valid_1's auc: 0.909039	valid_1's binary_logloss: 0.314641
[73]	valid_0's auc: 0.930882	valid_0's binary_logloss: 0.284592	valid_1's auc: 0.908972	valid_1's binary_logloss: 0.314707
[74]	valid_0's auc: 0.931139	valid_0's binary_logloss: 0.284128	valid_1's auc: 0.90892	valid_1's binary_logloss: 0.314808
[75]	valid_0's auc: 0.931483	valid_0's binary_logloss: 0.283549	valid_1's auc: 0.909092	valid_1's binary_logloss: 0.31458
[76]	valid_0's auc: 0.93174	valid_0's binary_logloss: 0.283101	valid_1's auc: 0.909032	valid_1's binary_logloss: 0.31467
[77]	valid_0's auc: 0.931984	valid_0's binary_logloss: 0.282697	valid_1's auc: 0.908881	valid_1's binary_logloss: 0.314923
[78]	valid_0's auc: 0.932301	valid_0's binary_logloss: 0.282171	valid_1's auc: 0.908969	valid_1's binary_logloss: 0.31482
[79]	valid_0's auc: 0.932517	valid_0's binary_logloss: 0.281766	valid_1's auc: 0.909031	valid_1's binary_logloss: 0.314659
[80]	valid_0's auc: 0.932839	valid_0's binary_logloss: 0.28119	valid_1's auc: 0.908827	valid_1's binary_logloss: 0.314988
[81]	valid_0's auc: 0.933145	valid_0's binary_logloss: 0.280682	valid_1's auc: 0.908778	valid_1's binary_logloss: 0.315094
[82]	valid_0's auc: 0.93335	valid_0's binary_logloss: 0.280305	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315242
[83]	valid_0's auc: 0.93357	valid_0's binary_logloss: 0.279883	valid_1's auc: 0.908617	valid_1's binary_logloss: 0.315283
[84]	valid_0's auc: 0.933798	valid_0's binary_logloss: 0.279454	valid_1's auc: 0.908569	valid_1's binary_logloss: 0.315352
[85]	valid_0's auc: 0.934027	valid_0's binary_logloss: 0.279023	valid_1's auc: 0.908448	valid_1's binary_logloss: 0.315584
[86]	valid_0's auc: 0.934253	valid_0's binary_logloss: 0.278627	valid_1's auc: 0.908499	valid_1's binary_logloss: 0.31554
[87]	valid_0's auc: 0.93445	valid_0's binary_logloss: 0.278291	valid_1's auc: 0.908427	valid_1's binary_logloss: 0.31566
[88]	valid_0's auc: 0.934636	valid_0's binary_logloss: 0.277902	valid_1's auc: 0.908313	valid_1's binary_logloss: 0.315875
[89]	valid_0's auc: 0.934867	valid_0's binary_logloss: 0.277492	valid_1's auc: 0.908145	valid_1's binary_logloss: 0.316125
[90]	valid_0's auc: 0.935013	valid_0's binary_logloss: 0.277229	valid_1's auc: 0.908102	valid_1's binary_logloss: 0.316176
[91]	valid_0's auc: 0.935185	valid_0's binary_logloss: 0.276894	valid_1's auc: 0.907975	valid_1's binary_logloss: 0.316406
[92]	valid_0's auc: 0.935491	valid_0's binary_logloss: 0.276378	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.316545
[93]	valid_0's auc: 0.935705	valid_0's binary_logloss: 0.276021	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.316647
[94]	valid_0's auc: 0.935893	valid_0's binary_logloss: 0.275673	valid_1's auc: 0.907684	valid_1's binary_logloss: 0.316884
[95]	valid_0's auc: 0.936121	valid_0's binary_logloss: 0.27527	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.316825
[96]	valid_0's auc: 0.936335	valid_0's binary_logloss: 0.274856	valid_1's auc: 0.907792	valid_1's binary_logloss: 0.316714
[97]	valid_0's auc: 0.936654	valid_0's binary_logloss: 0.274315	valid_1's auc: 0.907797	valid_1's binary_logloss: 0.316697
[98]	valid_0's auc: 0.93684	valid_0's binary_logloss: 0.274	valid_1's auc: 0.90778	valid_1's binary_logloss: 0.316729
[99]	valid_0's auc: 0.937135	valid_0's binary_logloss: 0.273447	valid_1's auc: 0.907729	valid_1's binary_logloss: 0.316844
[100]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272838	valid_1's auc: 0.907638	valid_1's binary_logloss: 0.317007
[101]	valid_0's auc: 0.937768	valid_0's binary_logloss: 0.272395	valid_1's auc: 0.907606	valid_1's binary_logloss: 0.317068
[102]	valid_0's auc: 0.938083	valid_0's binary_logloss: 0.271866	valid_1's auc: 0.907462	valid_1's binary_logloss: 0.317305
[103]	valid_0's auc: 0.938339	valid_0's binary_logloss: 0.271383	valid_1's auc: 0.90754	valid_1's binary_logloss: 0.317201
[104]	valid_0's auc: 0.938592	valid_0's binary_logloss: 0.270937	valid_1's auc: 0.907428	valid_1's binary_logloss: 0.317424
[105]	valid_0's auc: 0.938803	valid_0's binary_logloss: 0.270598	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.31741
[106]	valid_0's auc: 0.939002	valid_0's binary_logloss: 0.270226	valid_1's auc: 0.907431	valid_1's binary_logloss: 0.317448
[107]	valid_0's auc: 0.9392	valid_0's binary_logloss: 0.269848	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.317597
[108]	valid_0's auc: 0.939455	valid_0's binary_logloss: 0.269355	valid_1's auc: 0.907366	valid_1's binary_logloss: 0.317527
[109]	valid_0's auc: 0.939727	valid_0's binary_logloss: 0.268848	valid_1's auc: 0.90739	valid_1's binary_logloss: 0.317498
[110]	valid_0's auc: 0.939978	valid_0's binary_logloss: 0.268406	valid_1's auc: 0.907261	valid_1's binary_logloss: 0.317713
[111]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267974	valid_1's auc: 0.907306	valid_1's binary_logloss: 0.317642
[112]	valid_0's auc: 0.940455	valid_0's binary_logloss: 0.267546	valid_1's auc: 0.90728	valid_1's binary_logloss: 0.317691
[113]	valid_0's auc: 0.940599	valid_0's binary_logloss: 0.267244	valid_1's auc: 0.907165	valid_1's binary_logloss: 0.317902
[114]	valid_0's auc: 0.940778	valid_0's binary_logloss: 0.266903	valid_1's auc: 0.907167	valid_1's binary_logloss: 0.317886
[115]	valid_0's auc: 0.940995	valid_0's binary_logloss: 0.266529	valid_1's auc: 0.907159	valid_1's binary_logloss: 0.317887
[116]	valid_0's auc: 0.941195	valid_0's binary_logloss: 0.266162	valid_1's auc: 0.907224	valid_1's binary_logloss: 0.317838
[117]	valid_0's auc: 0.941428	valid_0's binary_logloss: 0.265734	valid_1's auc: 0.907207	valid_1's binary_logloss: 0.317847
[118]	valid_0's auc: 0.941639	valid_0's binary_logloss: 0.265375	valid_1's auc: 0.90719	valid_1's binary_logloss: 0.317875
[119]	valid_0's auc: 0.941856	valid_0's binary_logloss: 0.265012	valid_1's auc: 0.907101	valid_1's binary_logloss: 0.318061
[120]	valid_0's auc: 0.94203	valid_0's binary_logloss: 0.26467	valid_1's auc: 0.907018	valid_1's binary_logloss: 0.318208
[121]	valid_0's auc: 0.942154	valid_0's binary_logloss: 0.264407	valid_1's auc: 0.907031	valid_1's binary_logloss: 0.318237
[122]	valid_0's auc: 0.942301	valid_0's binary_logloss: 0.264163	valid_1's auc: 0.907016	valid_1's binary_logloss: 0.318303
[123]	valid_0's auc: 0.942464	valid_0's binary_logloss: 0.263845	valid_1's auc: 0.907024	valid_1's binary_logloss: 0.318315
[124]	valid_0's auc: 0.942704	valid_0's binary_logloss: 0.26345	valid_1's auc: 0.906892	valid_1's binary_logloss: 0.318545
[125]	valid_0's auc: 0.942855	valid_0's binary_logloss: 0.263173	valid_1's auc: 0.906851	valid_1's binary_logloss: 0.318627
[126]	valid_0's auc: 0.942954	valid_0's binary_logloss: 0.2629	valid_1's auc: 0.906795	valid_1's binary_logloss: 0.318715
[127]	valid_0's auc: 0.943132	valid_0's binary_logloss: 0.26257	valid_1's auc: 0.906675	valid_1's binary_logloss: 0.318956
[128]	valid_0's auc: 0.943364	valid_0's binary_logloss: 0.26214	valid_1's auc: 0.906659	valid_1's binary_logloss: 0.319022
[129]	valid_0's auc: 0.943558	valid_0's binary_logloss: 0.261799	valid_1's auc: 0.906688	valid_1's binary_logloss: 0.318993
[130]	valid_0's auc: 0.943711	valid_0's binary_logloss: 0.261512	valid_1's auc: 0.906638	valid_1's binary_logloss: 0.319073
[131]	valid_0's auc: 0.94385	valid_0's binary_logloss: 0.261227	valid_1's auc: 0.906581	valid_1's binary_logloss: 0.319177
[132]	valid_0's auc: 0.944038	valid_0's binary_logloss: 0.260879	valid_1's auc: 0.906634	valid_1's binary_logloss: 0.319139
[133]	valid_0's auc: 0.944247	valid_0's binary_logloss: 0.260479	valid_1's auc: 0.906664	valid_1's binary_logloss: 0.319098
[134]	valid_0's auc: 0.944413	valid_0's binary_logloss: 0.260171	valid_1's auc: 0.906651	valid_1's binary_logloss: 0.319109
[135]	valid_0's auc: 0.944612	valid_0's binary_logloss: 0.259818	valid_1's auc: 0.906598	valid_1's binary_logloss: 0.319221
[136]	valid_0's auc: 0.944771	valid_0's binary_logloss: 0.259503	valid_1's auc: 0.906615	valid_1's binary_logloss: 0.319196
[137]	valid_0's auc: 0.945036	valid_0's binary_logloss: 0.259047	valid_1's auc: 0.906452	valid_1's binary_logloss: 0.31953
[138]	valid_0's auc: 0.945208	valid_0's binary_logloss: 0.258705	valid_1's auc: 0.906338	valid_1's binary_logloss: 0.319799
[139]	valid_0's auc: 0.945331	valid_0's binary_logloss: 0.258455	valid_1's auc: 0.906316	valid_1's binary_logloss: 0.319893
[140]	valid_0's auc: 0.945483	valid_0's binary_logloss: 0.258144	valid_1's auc: 0.906293	valid_1's binary_logloss: 0.319918
[141]	valid_0's auc: 0.945617	valid_0's binary_logloss: 0.257888	valid_1's auc: 0.906289	valid_1's binary_logloss: 0.319987
[142]	valid_0's auc: 0.945806	valid_0's binary_logloss: 0.257524	valid_1's auc: 0.906284	valid_1's binary_logloss: 0.320022
[143]	valid_0's auc: 0.945971	valid_0's binary_logloss: 0.257224	valid_1's auc: 0.906255	valid_1's binary_logloss: 0.320056
[144]	valid_0's auc: 0.946117	valid_0's binary_logloss: 0.256909	valid_1's auc: 0.906222	valid_1's binary_logloss: 0.320144
[145]	valid_0's auc: 0.946299	valid_0's binary_logloss: 0.256569	valid_1's auc: 0.906083	valid_1's binary_logloss: 0.320387
[146]	valid_0's auc: 0.946429	valid_0's binary_logloss: 0.256327	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.320478
[147]	valid_0's auc: 0.946694	valid_0's binary_logloss: 0.255828	valid_1's auc: 0.905921	valid_1's binary_logloss: 0.320641
Early stopping, best iteration is:
[47]	valid_0's auc: 0.922765	valid_0's binary_logloss: 0.299204	valid_1's auc: 0.909758	valid_1's binary_logloss: 0.314006
[1]	valid_0's auc: 0.88881	valid_0's binary_logloss: 0.516633	valid_1's auc: 0.897809	valid_1's binary_logloss: 0.50731
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8922	valid_0's binary_logloss: 0.487561	valid_1's auc: 0.899925	valid_1's binary_logloss: 0.477157
[3]	valid_0's auc: 0.892838	valid_0's binary_logloss: 0.464389	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.453152
[4]	valid_0's auc: 0.894608	valid_0's binary_logloss: 0.444961	valid_1's auc: 0.9023	valid_1's binary_logloss: 0.434111
[5]	valid_0's auc: 0.895384	valid_0's binary_logloss: 0.428899	valid_1's auc: 0.901607	valid_1's binary_logloss: 0.41839
[6]	valid_0's auc: 0.895814	valid_0's binary_logloss: 0.415402	valid_1's auc: 0.901971	valid_1's binary_logloss: 0.404739
[7]	valid_0's auc: 0.897179	valid_0's binary_logloss: 0.403646	valid_1's auc: 0.902712	valid_1's binary_logloss: 0.393451
[8]	valid_0's auc: 0.90014	valid_0's binary_logloss: 0.393717	valid_1's auc: 0.904509	valid_1's binary_logloss: 0.383777
[9]	valid_0's auc: 0.901656	valid_0's binary_logloss: 0.384637	valid_1's auc: 0.905082	valid_1's binary_logloss: 0.375071
[10]	valid_0's auc: 0.902441	valid_0's binary_logloss: 0.376979	valid_1's auc: 0.905389	valid_1's binary_logloss: 0.36779
[11]	valid_0's auc: 0.903086	valid_0's binary_logloss: 0.37018	valid_1's auc: 0.905722	valid_1's binary_logloss: 0.361222
[12]	valid_0's auc: 0.903811	valid_0's binary_logloss: 0.364179	valid_1's auc: 0.905739	valid_1's binary_logloss: 0.355887
[13]	valid_0's auc: 0.904555	valid_0's binary_logloss: 0.359017	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.3513
[14]	valid_0's auc: 0.905441	valid_0's binary_logloss: 0.35414	valid_1's auc: 0.90612	valid_1's binary_logloss: 0.347227
[15]	valid_0's auc: 0.906121	valid_0's binary_logloss: 0.349903	valid_1's auc: 0.90617	valid_1's binary_logloss: 0.343705
[16]	valid_0's auc: 0.906823	valid_0's binary_logloss: 0.346182	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.340575
[17]	valid_0's auc: 0.907623	valid_0's binary_logloss: 0.342618	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.337414
[18]	valid_0's auc: 0.908435	valid_0's binary_logloss: 0.339355	valid_1's auc: 0.907089	valid_1's binary_logloss: 0.334802
[19]	valid_0's auc: 0.909244	valid_0's binary_logloss: 0.336401	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.33235
[20]	valid_0's auc: 0.91019	valid_0's binary_logloss: 0.333492	valid_1's auc: 0.907581	valid_1's binary_logloss: 0.330668
[21]	valid_0's auc: 0.910592	valid_0's binary_logloss: 0.331217	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.328752
[22]	valid_0's auc: 0.911201	valid_0's binary_logloss: 0.328996	valid_1's auc: 0.908075	valid_1's binary_logloss: 0.32715
[23]	valid_0's auc: 0.911776	valid_0's binary_logloss: 0.326873	valid_1's auc: 0.908173	valid_1's binary_logloss: 0.325751
[24]	valid_0's auc: 0.912492	valid_0's binary_logloss: 0.324799	valid_1's auc: 0.908508	valid_1's binary_logloss: 0.32443
[25]	valid_0's auc: 0.913089	valid_0's binary_logloss: 0.32297	valid_1's auc: 0.908814	valid_1's binary_logloss: 0.322992
[26]	valid_0's auc: 0.9136	valid_0's binary_logloss: 0.321192	valid_1's auc: 0.908874	valid_1's binary_logloss: 0.32202
[27]	valid_0's auc: 0.914178	valid_0's binary_logloss: 0.319604	valid_1's auc: 0.908948	valid_1's binary_logloss: 0.321157
[28]	valid_0's auc: 0.914633	valid_0's binary_logloss: 0.318173	valid_1's auc: 0.908908	valid_1's binary_logloss: 0.320516
[29]	valid_0's auc: 0.915064	valid_0's binary_logloss: 0.31679	valid_1's auc: 0.909119	valid_1's binary_logloss: 0.319599
[30]	valid_0's auc: 0.915605	valid_0's binary_logloss: 0.315332	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.31877
[31]	valid_0's auc: 0.916108	valid_0's binary_logloss: 0.313967	valid_1's auc: 0.909463	valid_1's binary_logloss: 0.318171
[32]	valid_0's auc: 0.916571	valid_0's binary_logloss: 0.312762	valid_1's auc: 0.909208	valid_1's binary_logloss: 0.31812
[33]	valid_0's auc: 0.917039	valid_0's binary_logloss: 0.311602	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.317603
[34]	valid_0's auc: 0.9174	valid_0's binary_logloss: 0.310537	valid_1's auc: 0.909544	valid_1's binary_logloss: 0.317031
[35]	valid_0's auc: 0.917876	valid_0's binary_logloss: 0.309427	valid_1's auc: 0.909623	valid_1's binary_logloss: 0.316615
[36]	valid_0's auc: 0.918318	valid_0's binary_logloss: 0.308395	valid_1's auc: 0.909647	valid_1's binary_logloss: 0.316259
[37]	valid_0's auc: 0.918718	valid_0's binary_logloss: 0.307424	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.316147
[38]	valid_0's auc: 0.919117	valid_0's binary_logloss: 0.3065	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315994
[39]	valid_0's auc: 0.919602	valid_0's binary_logloss: 0.305479	valid_1's auc: 0.909566	valid_1's binary_logloss: 0.315843
[40]	valid_0's auc: 0.920052	valid_0's binary_logloss: 0.304544	valid_1's auc: 0.909565	valid_1's binary_logloss: 0.315715
[41]	valid_0's auc: 0.920506	valid_0's binary_logloss: 0.303599	valid_1's auc: 0.909729	valid_1's binary_logloss: 0.315279
[42]	valid_0's auc: 0.920955	valid_0's binary_logloss: 0.302692	valid_1's auc: 0.909832	valid_1's binary_logloss: 0.315004
[43]	valid_0's auc: 0.921301	valid_0's binary_logloss: 0.301897	valid_1's auc: 0.909823	valid_1's binary_logloss: 0.314899
[44]	valid_0's auc: 0.921781	valid_0's binary_logloss: 0.30102	valid_1's auc: 0.909762	valid_1's binary_logloss: 0.314946
[45]	valid_0's auc: 0.92213	valid_0's binary_logloss: 0.300287	valid_1's auc: 0.909701	valid_1's binary_logloss: 0.315008
[46]	valid_0's auc: 0.922414	valid_0's binary_logloss: 0.299693	valid_1's auc: 0.909544	valid_1's binary_logloss: 0.315146
[47]	valid_0's auc: 0.922809	valid_0's binary_logloss: 0.298955	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.315117
[48]	valid_0's auc: 0.923123	valid_0's binary_logloss: 0.298268	valid_1's auc: 0.909456	valid_1's binary_logloss: 0.315204
[49]	valid_0's auc: 0.923529	valid_0's binary_logloss: 0.297517	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.315141
[50]	valid_0's auc: 0.923806	valid_0's binary_logloss: 0.296969	valid_1's auc: 0.909572	valid_1's binary_logloss: 0.314996
[51]	valid_0's auc: 0.924082	valid_0's binary_logloss: 0.296402	valid_1's auc: 0.909673	valid_1's binary_logloss: 0.314823
[52]	valid_0's auc: 0.924503	valid_0's binary_logloss: 0.29565	valid_1's auc: 0.909568	valid_1's binary_logloss: 0.314877
[53]	valid_0's auc: 0.924835	valid_0's binary_logloss: 0.29506	valid_1's auc: 0.909538	valid_1's binary_logloss: 0.314905
[54]	valid_0's auc: 0.925114	valid_0's binary_logloss: 0.294531	valid_1's auc: 0.909518	valid_1's binary_logloss: 0.314906
[55]	valid_0's auc: 0.925408	valid_0's binary_logloss: 0.293982	valid_1's auc: 0.909492	valid_1's binary_logloss: 0.314875
[56]	valid_0's auc: 0.925704	valid_0's binary_logloss: 0.293444	valid_1's auc: 0.909342	valid_1's binary_logloss: 0.315111
[57]	valid_0's auc: 0.926134	valid_0's binary_logloss: 0.292702	valid_1's auc: 0.909256	valid_1's binary_logloss: 0.3152
[58]	valid_0's auc: 0.926536	valid_0's binary_logloss: 0.292023	valid_1's auc: 0.90917	valid_1's binary_logloss: 0.315353
[59]	valid_0's auc: 0.92682	valid_0's binary_logloss: 0.291539	valid_1's auc: 0.909074	valid_1's binary_logloss: 0.315467
[60]	valid_0's auc: 0.927054	valid_0's binary_logloss: 0.291037	valid_1's auc: 0.909065	valid_1's binary_logloss: 0.315472
[61]	valid_0's auc: 0.927309	valid_0's binary_logloss: 0.29058	valid_1's auc: 0.909094	valid_1's binary_logloss: 0.315418
[62]	valid_0's auc: 0.92773	valid_0's binary_logloss: 0.289873	valid_1's auc: 0.909016	valid_1's binary_logloss: 0.315547
[63]	valid_0's auc: 0.928014	valid_0's binary_logloss: 0.289346	valid_1's auc: 0.909041	valid_1's binary_logloss: 0.315524
[64]	valid_0's auc: 0.92834	valid_0's binary_logloss: 0.28878	valid_1's auc: 0.908946	valid_1's binary_logloss: 0.315607
[65]	valid_0's auc: 0.928682	valid_0's binary_logloss: 0.2882	valid_1's auc: 0.90892	valid_1's binary_logloss: 0.315649
[66]	valid_0's auc: 0.928922	valid_0's binary_logloss: 0.287759	valid_1's auc: 0.908894	valid_1's binary_logloss: 0.315691
[67]	valid_0's auc: 0.92919	valid_0's binary_logloss: 0.287273	valid_1's auc: 0.908915	valid_1's binary_logloss: 0.315627
[68]	valid_0's auc: 0.929473	valid_0's binary_logloss: 0.286709	valid_1's auc: 0.908951	valid_1's binary_logloss: 0.315556
[69]	valid_0's auc: 0.929712	valid_0's binary_logloss: 0.286288	valid_1's auc: 0.908921	valid_1's binary_logloss: 0.315629
[70]	valid_0's auc: 0.929941	valid_0's binary_logloss: 0.285817	valid_1's auc: 0.909	valid_1's binary_logloss: 0.315509
[71]	valid_0's auc: 0.930342	valid_0's binary_logloss: 0.285161	valid_1's auc: 0.908895	valid_1's binary_logloss: 0.315669
[72]	valid_0's auc: 0.930616	valid_0's binary_logloss: 0.284691	valid_1's auc: 0.908887	valid_1's binary_logloss: 0.315701
[73]	valid_0's auc: 0.930827	valid_0's binary_logloss: 0.284282	valid_1's auc: 0.908707	valid_1's binary_logloss: 0.31595
[74]	valid_0's auc: 0.931103	valid_0's binary_logloss: 0.283811	valid_1's auc: 0.908588	valid_1's binary_logloss: 0.316117
[75]	valid_0's auc: 0.931462	valid_0's binary_logloss: 0.283179	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.316419
[76]	valid_0's auc: 0.931692	valid_0's binary_logloss: 0.282719	valid_1's auc: 0.908379	valid_1's binary_logloss: 0.316475
[77]	valid_0's auc: 0.931967	valid_0's binary_logloss: 0.282254	valid_1's auc: 0.908221	valid_1's binary_logloss: 0.316737
[78]	valid_0's auc: 0.932265	valid_0's binary_logloss: 0.281721	valid_1's auc: 0.908113	valid_1's binary_logloss: 0.316892
[79]	valid_0's auc: 0.932524	valid_0's binary_logloss: 0.28124	valid_1's auc: 0.9081	valid_1's binary_logloss: 0.316917
[80]	valid_0's auc: 0.932781	valid_0's binary_logloss: 0.280808	valid_1's auc: 0.908166	valid_1's binary_logloss: 0.316796
[81]	valid_0's auc: 0.933036	valid_0's binary_logloss: 0.280358	valid_1's auc: 0.908104	valid_1's binary_logloss: 0.316889
[82]	valid_0's auc: 0.933223	valid_0's binary_logloss: 0.279973	valid_1's auc: 0.908107	valid_1's binary_logloss: 0.316867
[83]	valid_0's auc: 0.933561	valid_0's binary_logloss: 0.279372	valid_1's auc: 0.908222	valid_1's binary_logloss: 0.316739
[84]	valid_0's auc: 0.933816	valid_0's binary_logloss: 0.278899	valid_1's auc: 0.908321	valid_1's binary_logloss: 0.3166
[85]	valid_0's auc: 0.934142	valid_0's binary_logloss: 0.278344	valid_1's auc: 0.908276	valid_1's binary_logloss: 0.31665
[86]	valid_0's auc: 0.934471	valid_0's binary_logloss: 0.27782	valid_1's auc: 0.908203	valid_1's binary_logloss: 0.316755
[87]	valid_0's auc: 0.934733	valid_0's binary_logloss: 0.277346	valid_1's auc: 0.908141	valid_1's binary_logloss: 0.316871
[88]	valid_0's auc: 0.934983	valid_0's binary_logloss: 0.276943	valid_1's auc: 0.908135	valid_1's binary_logloss: 0.3169
[89]	valid_0's auc: 0.935247	valid_0's binary_logloss: 0.276471	valid_1's auc: 0.90804	valid_1's binary_logloss: 0.317069
[90]	valid_0's auc: 0.935511	valid_0's binary_logloss: 0.276014	valid_1's auc: 0.908094	valid_1's binary_logloss: 0.31701
[91]	valid_0's auc: 0.935772	valid_0's binary_logloss: 0.275588	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.317343
[92]	valid_0's auc: 0.935945	valid_0's binary_logloss: 0.275249	valid_1's auc: 0.90796	valid_1's binary_logloss: 0.317233
[93]	valid_0's auc: 0.936189	valid_0's binary_logloss: 0.274811	valid_1's auc: 0.907927	valid_1's binary_logloss: 0.317334
[94]	valid_0's auc: 0.936458	valid_0's binary_logloss: 0.274334	valid_1's auc: 0.907757	valid_1's binary_logloss: 0.317608
[95]	valid_0's auc: 0.936693	valid_0's binary_logloss: 0.273914	valid_1's auc: 0.907818	valid_1's binary_logloss: 0.317529
[96]	valid_0's auc: 0.936969	valid_0's binary_logloss: 0.273441	valid_1's auc: 0.907825	valid_1's binary_logloss: 0.317536
[97]	valid_0's auc: 0.937284	valid_0's binary_logloss: 0.272902	valid_1's auc: 0.907795	valid_1's binary_logloss: 0.317582
[98]	valid_0's auc: 0.9375	valid_0's binary_logloss: 0.272531	valid_1's auc: 0.907882	valid_1's binary_logloss: 0.317457
[99]	valid_0's auc: 0.937685	valid_0's binary_logloss: 0.27218	valid_1's auc: 0.907937	valid_1's binary_logloss: 0.31741
[100]	valid_0's auc: 0.937882	valid_0's binary_logloss: 0.271823	valid_1's auc: 0.907858	valid_1's binary_logloss: 0.317571
[101]	valid_0's auc: 0.938136	valid_0's binary_logloss: 0.271393	valid_1's auc: 0.907792	valid_1's binary_logloss: 0.317691
[102]	valid_0's auc: 0.938405	valid_0's binary_logloss: 0.2709	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.317649
[103]	valid_0's auc: 0.938527	valid_0's binary_logloss: 0.270661	valid_1's auc: 0.907828	valid_1's binary_logloss: 0.317663
[104]	valid_0's auc: 0.938881	valid_0's binary_logloss: 0.270075	valid_1's auc: 0.907805	valid_1's binary_logloss: 0.31769
[105]	valid_0's auc: 0.939169	valid_0's binary_logloss: 0.269567	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317883
[106]	valid_0's auc: 0.939411	valid_0's binary_logloss: 0.269135	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.318056
[107]	valid_0's auc: 0.93957	valid_0's binary_logloss: 0.26885	valid_1's auc: 0.907556	valid_1's binary_logloss: 0.318144
[108]	valid_0's auc: 0.939791	valid_0's binary_logloss: 0.268429	valid_1's auc: 0.907508	valid_1's binary_logloss: 0.318241
[109]	valid_0's auc: 0.939985	valid_0's binary_logloss: 0.268097	valid_1's auc: 0.907494	valid_1's binary_logloss: 0.318289
[110]	valid_0's auc: 0.940246	valid_0's binary_logloss: 0.267644	valid_1's auc: 0.907512	valid_1's binary_logloss: 0.318286
[111]	valid_0's auc: 0.940427	valid_0's binary_logloss: 0.267298	valid_1's auc: 0.907518	valid_1's binary_logloss: 0.318282
[112]	valid_0's auc: 0.940611	valid_0's binary_logloss: 0.266964	valid_1's auc: 0.907444	valid_1's binary_logloss: 0.318432
[113]	valid_0's auc: 0.940817	valid_0's binary_logloss: 0.266597	valid_1's auc: 0.907376	valid_1's binary_logloss: 0.318552
[114]	valid_0's auc: 0.941022	valid_0's binary_logloss: 0.26619	valid_1's auc: 0.907316	valid_1's binary_logloss: 0.318675
[115]	valid_0's auc: 0.941189	valid_0's binary_logloss: 0.265891	valid_1's auc: 0.907221	valid_1's binary_logloss: 0.318873
[116]	valid_0's auc: 0.941416	valid_0's binary_logloss: 0.265491	valid_1's auc: 0.907157	valid_1's binary_logloss: 0.318999
[117]	valid_0's auc: 0.941581	valid_0's binary_logloss: 0.265203	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.319127
[118]	valid_0's auc: 0.941764	valid_0's binary_logloss: 0.264857	valid_1's auc: 0.906981	valid_1's binary_logloss: 0.319351
[119]	valid_0's auc: 0.941961	valid_0's binary_logloss: 0.264515	valid_1's auc: 0.906973	valid_1's binary_logloss: 0.31941
[120]	valid_0's auc: 0.942167	valid_0's binary_logloss: 0.264112	valid_1's auc: 0.906999	valid_1's binary_logloss: 0.319384
[121]	valid_0's auc: 0.942449	valid_0's binary_logloss: 0.263633	valid_1's auc: 0.906844	valid_1's binary_logloss: 0.31974
[122]	valid_0's auc: 0.942589	valid_0's binary_logloss: 0.263307	valid_1's auc: 0.906764	valid_1's binary_logloss: 0.319956
[123]	valid_0's auc: 0.942759	valid_0's binary_logloss: 0.263017	valid_1's auc: 0.906711	valid_1's binary_logloss: 0.319992
[124]	valid_0's auc: 0.942957	valid_0's binary_logloss: 0.26267	valid_1's auc: 0.9068	valid_1's binary_logloss: 0.3199
[125]	valid_0's auc: 0.943108	valid_0's binary_logloss: 0.262386	valid_1's auc: 0.906768	valid_1's binary_logloss: 0.319971
[126]	valid_0's auc: 0.94336	valid_0's binary_logloss: 0.261907	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.320052
[127]	valid_0's auc: 0.943581	valid_0's binary_logloss: 0.261486	valid_1's auc: 0.906791	valid_1's binary_logloss: 0.319981
[128]	valid_0's auc: 0.9437	valid_0's binary_logloss: 0.261242	valid_1's auc: 0.906715	valid_1's binary_logloss: 0.320109
[129]	valid_0's auc: 0.943848	valid_0's binary_logloss: 0.260956	valid_1's auc: 0.906648	valid_1's binary_logloss: 0.320251
[130]	valid_0's auc: 0.944112	valid_0's binary_logloss: 0.260507	valid_1's auc: 0.906714	valid_1's binary_logloss: 0.320192
[131]	valid_0's auc: 0.944264	valid_0's binary_logloss: 0.260233	valid_1's auc: 0.906735	valid_1's binary_logloss: 0.320171
[132]	valid_0's auc: 0.944414	valid_0's binary_logloss: 0.259948	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.320298
[133]	valid_0's auc: 0.944524	valid_0's binary_logloss: 0.25974	valid_1's auc: 0.906678	valid_1's binary_logloss: 0.320256
[134]	valid_0's auc: 0.944779	valid_0's binary_logloss: 0.259299	valid_1's auc: 0.906729	valid_1's binary_logloss: 0.320184
[135]	valid_0's auc: 0.944928	valid_0's binary_logloss: 0.259016	valid_1's auc: 0.906739	valid_1's binary_logloss: 0.32021
[136]	valid_0's auc: 0.945016	valid_0's binary_logloss: 0.258823	valid_1's auc: 0.906707	valid_1's binary_logloss: 0.320319
[137]	valid_0's auc: 0.945186	valid_0's binary_logloss: 0.258479	valid_1's auc: 0.906629	valid_1's binary_logloss: 0.32051
[138]	valid_0's auc: 0.945293	valid_0's binary_logloss: 0.258258	valid_1's auc: 0.906617	valid_1's binary_logloss: 0.320569
[139]	valid_0's auc: 0.945537	valid_0's binary_logloss: 0.257809	valid_1's auc: 0.906646	valid_1's binary_logloss: 0.320558
[140]	valid_0's auc: 0.945752	valid_0's binary_logloss: 0.257418	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.320913
[141]	valid_0's auc: 0.945873	valid_0's binary_logloss: 0.257134	valid_1's auc: 0.906449	valid_1's binary_logloss: 0.320996
[142]	valid_0's auc: 0.945985	valid_0's binary_logloss: 0.256925	valid_1's auc: 0.906314	valid_1's binary_logloss: 0.321262
Early stopping, best iteration is:
[42]	valid_0's auc: 0.920955	valid_0's binary_logloss: 0.302692	valid_1's auc: 0.909832	valid_1's binary_logloss: 0.315004
[1]	valid_0's auc: 0.887249	valid_0's binary_logloss: 0.517046	valid_1's auc: 0.892969	valid_1's binary_logloss: 0.508431
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889524	valid_0's binary_logloss: 0.488088	valid_1's auc: 0.89592	valid_1's binary_logloss: 0.478873
[3]	valid_0's auc: 0.891571	valid_0's binary_logloss: 0.464744	valid_1's auc: 0.896177	valid_1's binary_logloss: 0.455472
[4]	valid_0's auc: 0.893868	valid_0's binary_logloss: 0.445249	valid_1's auc: 0.897585	valid_1's binary_logloss: 0.43623
[5]	valid_0's auc: 0.897186	valid_0's binary_logloss: 0.429114	valid_1's auc: 0.900745	valid_1's binary_logloss: 0.419804
[6]	valid_0's auc: 0.898078	valid_0's binary_logloss: 0.415466	valid_1's auc: 0.901242	valid_1's binary_logloss: 0.406401
[7]	valid_0's auc: 0.899398	valid_0's binary_logloss: 0.403794	valid_1's auc: 0.90246	valid_1's binary_logloss: 0.394732
[8]	valid_0's auc: 0.900616	valid_0's binary_logloss: 0.393732	valid_1's auc: 0.902926	valid_1's binary_logloss: 0.385104
[9]	valid_0's auc: 0.901282	valid_0's binary_logloss: 0.384962	valid_1's auc: 0.903761	valid_1's binary_logloss: 0.376423
[10]	valid_0's auc: 0.902116	valid_0's binary_logloss: 0.377268	valid_1's auc: 0.903857	valid_1's binary_logloss: 0.369348
[11]	valid_0's auc: 0.902911	valid_0's binary_logloss: 0.370559	valid_1's auc: 0.90371	valid_1's binary_logloss: 0.36337
[12]	valid_0's auc: 0.903892	valid_0's binary_logloss: 0.364523	valid_1's auc: 0.904465	valid_1's binary_logloss: 0.357744
[13]	valid_0's auc: 0.904864	valid_0's binary_logloss: 0.359224	valid_1's auc: 0.904853	valid_1's binary_logloss: 0.352978
[14]	valid_0's auc: 0.905535	valid_0's binary_logloss: 0.354517	valid_1's auc: 0.905195	valid_1's binary_logloss: 0.348745
[15]	valid_0's auc: 0.906247	valid_0's binary_logloss: 0.350292	valid_1's auc: 0.905529	valid_1's binary_logloss: 0.345032
[16]	valid_0's auc: 0.906797	valid_0's binary_logloss: 0.346472	valid_1's auc: 0.905953	valid_1's binary_logloss: 0.341776
[17]	valid_0's auc: 0.907358	valid_0's binary_logloss: 0.343123	valid_1's auc: 0.906447	valid_1's binary_logloss: 0.338822
[18]	valid_0's auc: 0.908033	valid_0's binary_logloss: 0.339924	valid_1's auc: 0.906787	valid_1's binary_logloss: 0.336244
[19]	valid_0's auc: 0.90894	valid_0's binary_logloss: 0.336948	valid_1's auc: 0.906907	valid_1's binary_logloss: 0.334159
[20]	valid_0's auc: 0.909391	valid_0's binary_logloss: 0.334429	valid_1's auc: 0.907131	valid_1's binary_logloss: 0.33207
[21]	valid_0's auc: 0.910056	valid_0's binary_logloss: 0.332011	valid_1's auc: 0.90702	valid_1's binary_logloss: 0.330628
[22]	valid_0's auc: 0.910577	valid_0's binary_logloss: 0.329834	valid_1's auc: 0.907394	valid_1's binary_logloss: 0.328778
[23]	valid_0's auc: 0.911226	valid_0's binary_logloss: 0.32774	valid_1's auc: 0.90738	valid_1's binary_logloss: 0.32746
[24]	valid_0's auc: 0.911924	valid_0's binary_logloss: 0.325717	valid_1's auc: 0.907391	valid_1's binary_logloss: 0.326361
[25]	valid_0's auc: 0.912617	valid_0's binary_logloss: 0.323749	valid_1's auc: 0.907639	valid_1's binary_logloss: 0.325176
[26]	valid_0's auc: 0.913165	valid_0's binary_logloss: 0.322012	valid_1's auc: 0.907708	valid_1's binary_logloss: 0.324169
[27]	valid_0's auc: 0.913655	valid_0's binary_logloss: 0.320373	valid_1's auc: 0.907891	valid_1's binary_logloss: 0.323092
[28]	valid_0's auc: 0.914286	valid_0's binary_logloss: 0.318824	valid_1's auc: 0.907861	valid_1's binary_logloss: 0.322584
[29]	valid_0's auc: 0.914847	valid_0's binary_logloss: 0.317292	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.321611
[30]	valid_0's auc: 0.915298	valid_0's binary_logloss: 0.315967	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.321195
[31]	valid_0's auc: 0.915775	valid_0's binary_logloss: 0.314611	valid_1's auc: 0.908015	valid_1's binary_logloss: 0.320673
[32]	valid_0's auc: 0.91635	valid_0's binary_logloss: 0.313328	valid_1's auc: 0.908011	valid_1's binary_logloss: 0.320335
[33]	valid_0's auc: 0.916807	valid_0's binary_logloss: 0.312169	valid_1's auc: 0.908099	valid_1's binary_logloss: 0.319871
[34]	valid_0's auc: 0.917257	valid_0's binary_logloss: 0.311013	valid_1's auc: 0.908253	valid_1's binary_logloss: 0.319253
[35]	valid_0's auc: 0.917787	valid_0's binary_logloss: 0.309842	valid_1's auc: 0.908178	valid_1's binary_logloss: 0.31912
[36]	valid_0's auc: 0.918288	valid_0's binary_logloss: 0.308697	valid_1's auc: 0.908109	valid_1's binary_logloss: 0.318934
[37]	valid_0's auc: 0.918804	valid_0's binary_logloss: 0.307571	valid_1's auc: 0.907999	valid_1's binary_logloss: 0.318877
[38]	valid_0's auc: 0.919173	valid_0's binary_logloss: 0.3067	valid_1's auc: 0.907944	valid_1's binary_logloss: 0.318701
[39]	valid_0's auc: 0.919557	valid_0's binary_logloss: 0.305783	valid_1's auc: 0.907894	valid_1's binary_logloss: 0.318635
[40]	valid_0's auc: 0.919943	valid_0's binary_logloss: 0.304916	valid_1's auc: 0.907979	valid_1's binary_logloss: 0.318348
[41]	valid_0's auc: 0.92037	valid_0's binary_logloss: 0.304024	valid_1's auc: 0.907966	valid_1's binary_logloss: 0.318249
[42]	valid_0's auc: 0.920893	valid_0's binary_logloss: 0.302996	valid_1's auc: 0.908023	valid_1's binary_logloss: 0.318068
[43]	valid_0's auc: 0.92124	valid_0's binary_logloss: 0.302253	valid_1's auc: 0.907942	valid_1's binary_logloss: 0.318081
[44]	valid_0's auc: 0.921609	valid_0's binary_logloss: 0.301468	valid_1's auc: 0.908001	valid_1's binary_logloss: 0.317883
[45]	valid_0's auc: 0.922075	valid_0's binary_logloss: 0.30058	valid_1's auc: 0.907876	valid_1's binary_logloss: 0.318003
[46]	valid_0's auc: 0.922551	valid_0's binary_logloss: 0.29974	valid_1's auc: 0.907752	valid_1's binary_logloss: 0.318115
[47]	valid_0's auc: 0.922922	valid_0's binary_logloss: 0.298977	valid_1's auc: 0.907693	valid_1's binary_logloss: 0.318092
[48]	valid_0's auc: 0.923285	valid_0's binary_logloss: 0.29826	valid_1's auc: 0.907499	valid_1's binary_logloss: 0.318308
[49]	valid_0's auc: 0.923627	valid_0's binary_logloss: 0.297577	valid_1's auc: 0.90755	valid_1's binary_logloss: 0.318111
[50]	valid_0's auc: 0.923986	valid_0's binary_logloss: 0.296898	valid_1's auc: 0.907649	valid_1's binary_logloss: 0.31796
[51]	valid_0's auc: 0.924293	valid_0's binary_logloss: 0.296269	valid_1's auc: 0.907599	valid_1's binary_logloss: 0.318015
[52]	valid_0's auc: 0.924596	valid_0's binary_logloss: 0.295708	valid_1's auc: 0.907622	valid_1's binary_logloss: 0.317926
[53]	valid_0's auc: 0.924934	valid_0's binary_logloss: 0.295119	valid_1's auc: 0.907669	valid_1's binary_logloss: 0.317825
[54]	valid_0's auc: 0.925235	valid_0's binary_logloss: 0.29458	valid_1's auc: 0.907473	valid_1's binary_logloss: 0.31809
[55]	valid_0's auc: 0.92551	valid_0's binary_logloss: 0.29404	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.318061
[56]	valid_0's auc: 0.925816	valid_0's binary_logloss: 0.293478	valid_1's auc: 0.907316	valid_1's binary_logloss: 0.318303
[57]	valid_0's auc: 0.926154	valid_0's binary_logloss: 0.292838	valid_1's auc: 0.907253	valid_1's binary_logloss: 0.318391
[58]	valid_0's auc: 0.926504	valid_0's binary_logloss: 0.292189	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318414
[59]	valid_0's auc: 0.926985	valid_0's binary_logloss: 0.291366	valid_1's auc: 0.907139	valid_1's binary_logloss: 0.318608
[60]	valid_0's auc: 0.927304	valid_0's binary_logloss: 0.290795	valid_1's auc: 0.907005	valid_1's binary_logloss: 0.318809
[61]	valid_0's auc: 0.927553	valid_0's binary_logloss: 0.290337	valid_1's auc: 0.906991	valid_1's binary_logloss: 0.318832
[62]	valid_0's auc: 0.927852	valid_0's binary_logloss: 0.289838	valid_1's auc: 0.906952	valid_1's binary_logloss: 0.318876
[63]	valid_0's auc: 0.928145	valid_0's binary_logloss: 0.289317	valid_1's auc: 0.907064	valid_1's binary_logloss: 0.3187
[64]	valid_0's auc: 0.928418	valid_0's binary_logloss: 0.288819	valid_1's auc: 0.907125	valid_1's binary_logloss: 0.318568
[65]	valid_0's auc: 0.9287	valid_0's binary_logloss: 0.288286	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.318489
[66]	valid_0's auc: 0.928994	valid_0's binary_logloss: 0.287769	valid_1's auc: 0.907155	valid_1's binary_logloss: 0.318518
[67]	valid_0's auc: 0.9293	valid_0's binary_logloss: 0.287216	valid_1's auc: 0.907038	valid_1's binary_logloss: 0.318722
[68]	valid_0's auc: 0.929655	valid_0's binary_logloss: 0.286583	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.319015
[69]	valid_0's auc: 0.929913	valid_0's binary_logloss: 0.286077	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.319125
[70]	valid_0's auc: 0.930233	valid_0's binary_logloss: 0.285539	valid_1's auc: 0.906807	valid_1's binary_logloss: 0.319226
[71]	valid_0's auc: 0.930568	valid_0's binary_logloss: 0.284961	valid_1's auc: 0.906803	valid_1's binary_logloss: 0.319246
[72]	valid_0's auc: 0.930792	valid_0's binary_logloss: 0.284562	valid_1's auc: 0.906777	valid_1's binary_logloss: 0.319288
[73]	valid_0's auc: 0.931085	valid_0's binary_logloss: 0.284042	valid_1's auc: 0.906801	valid_1's binary_logloss: 0.319209
[74]	valid_0's auc: 0.931332	valid_0's binary_logloss: 0.283569	valid_1's auc: 0.906751	valid_1's binary_logloss: 0.319299
[75]	valid_0's auc: 0.931579	valid_0's binary_logloss: 0.283123	valid_1's auc: 0.906647	valid_1's binary_logloss: 0.319509
[76]	valid_0's auc: 0.931918	valid_0's binary_logloss: 0.282493	valid_1's auc: 0.906543	valid_1's binary_logloss: 0.319702
[77]	valid_0's auc: 0.932194	valid_0's binary_logloss: 0.282015	valid_1's auc: 0.906574	valid_1's binary_logloss: 0.31965
[78]	valid_0's auc: 0.932473	valid_0's binary_logloss: 0.28153	valid_1's auc: 0.906418	valid_1's binary_logloss: 0.319889
[79]	valid_0's auc: 0.932754	valid_0's binary_logloss: 0.281033	valid_1's auc: 0.906417	valid_1's binary_logloss: 0.31994
[80]	valid_0's auc: 0.9331	valid_0's binary_logloss: 0.28045	valid_1's auc: 0.906488	valid_1's binary_logloss: 0.319837
[81]	valid_0's auc: 0.933319	valid_0's binary_logloss: 0.280032	valid_1's auc: 0.906392	valid_1's binary_logloss: 0.320006
[82]	valid_0's auc: 0.933574	valid_0's binary_logloss: 0.279565	valid_1's auc: 0.906399	valid_1's binary_logloss: 0.319974
[83]	valid_0's auc: 0.933815	valid_0's binary_logloss: 0.279124	valid_1's auc: 0.90638	valid_1's binary_logloss: 0.319972
[84]	valid_0's auc: 0.934054	valid_0's binary_logloss: 0.278694	valid_1's auc: 0.9064	valid_1's binary_logloss: 0.319972
[85]	valid_0's auc: 0.934305	valid_0's binary_logloss: 0.278245	valid_1's auc: 0.906362	valid_1's binary_logloss: 0.32008
[86]	valid_0's auc: 0.934492	valid_0's binary_logloss: 0.277864	valid_1's auc: 0.906283	valid_1's binary_logloss: 0.320265
[87]	valid_0's auc: 0.934723	valid_0's binary_logloss: 0.277446	valid_1's auc: 0.906271	valid_1's binary_logloss: 0.320322
[88]	valid_0's auc: 0.934947	valid_0's binary_logloss: 0.277032	valid_1's auc: 0.906283	valid_1's binary_logloss: 0.320297
[89]	valid_0's auc: 0.935136	valid_0's binary_logloss: 0.276663	valid_1's auc: 0.906198	valid_1's binary_logloss: 0.32049
[90]	valid_0's auc: 0.935346	valid_0's binary_logloss: 0.276287	valid_1's auc: 0.906217	valid_1's binary_logloss: 0.320508
[91]	valid_0's auc: 0.935619	valid_0's binary_logloss: 0.275802	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.320356
[92]	valid_0's auc: 0.935846	valid_0's binary_logloss: 0.275424	valid_1's auc: 0.906227	valid_1's binary_logloss: 0.320453
[93]	valid_0's auc: 0.936065	valid_0's binary_logloss: 0.275032	valid_1's auc: 0.906321	valid_1's binary_logloss: 0.320316
[94]	valid_0's auc: 0.936252	valid_0's binary_logloss: 0.274672	valid_1's auc: 0.906233	valid_1's binary_logloss: 0.320518
[95]	valid_0's auc: 0.936445	valid_0's binary_logloss: 0.274334	valid_1's auc: 0.906183	valid_1's binary_logloss: 0.320564
[96]	valid_0's auc: 0.936672	valid_0's binary_logloss: 0.273923	valid_1's auc: 0.906154	valid_1's binary_logloss: 0.320596
[97]	valid_0's auc: 0.936901	valid_0's binary_logloss: 0.273528	valid_1's auc: 0.906089	valid_1's binary_logloss: 0.320762
[98]	valid_0's auc: 0.93708	valid_0's binary_logloss: 0.273201	valid_1's auc: 0.90606	valid_1's binary_logloss: 0.320816
[99]	valid_0's auc: 0.937283	valid_0's binary_logloss: 0.272835	valid_1's auc: 0.906067	valid_1's binary_logloss: 0.320856
[100]	valid_0's auc: 0.937499	valid_0's binary_logloss: 0.272444	valid_1's auc: 0.906046	valid_1's binary_logloss: 0.320926
[101]	valid_0's auc: 0.937721	valid_0's binary_logloss: 0.272066	valid_1's auc: 0.906036	valid_1's binary_logloss: 0.320947
[102]	valid_0's auc: 0.937963	valid_0's binary_logloss: 0.271618	valid_1's auc: 0.906021	valid_1's binary_logloss: 0.320954
[103]	valid_0's auc: 0.938129	valid_0's binary_logloss: 0.271329	valid_1's auc: 0.906037	valid_1's binary_logloss: 0.321011
[104]	valid_0's auc: 0.938367	valid_0's binary_logloss: 0.270871	valid_1's auc: 0.905985	valid_1's binary_logloss: 0.32118
[105]	valid_0's auc: 0.938537	valid_0's binary_logloss: 0.270548	valid_1's auc: 0.905892	valid_1's binary_logloss: 0.321396
[106]	valid_0's auc: 0.938726	valid_0's binary_logloss: 0.27019	valid_1's auc: 0.905895	valid_1's binary_logloss: 0.32139
[107]	valid_0's auc: 0.938923	valid_0's binary_logloss: 0.269842	valid_1's auc: 0.905919	valid_1's binary_logloss: 0.321356
[108]	valid_0's auc: 0.939075	valid_0's binary_logloss: 0.269579	valid_1's auc: 0.905891	valid_1's binary_logloss: 0.321416
[109]	valid_0's auc: 0.939344	valid_0's binary_logloss: 0.269115	valid_1's auc: 0.905922	valid_1's binary_logloss: 0.321438
[110]	valid_0's auc: 0.939572	valid_0's binary_logloss: 0.268724	valid_1's auc: 0.905857	valid_1's binary_logloss: 0.321602
[111]	valid_0's auc: 0.93982	valid_0's binary_logloss: 0.268267	valid_1's auc: 0.905818	valid_1's binary_logloss: 0.32167
[112]	valid_0's auc: 0.940029	valid_0's binary_logloss: 0.267894	valid_1's auc: 0.905707	valid_1's binary_logloss: 0.321826
[113]	valid_0's auc: 0.940206	valid_0's binary_logloss: 0.267508	valid_1's auc: 0.905638	valid_1's binary_logloss: 0.321991
[114]	valid_0's auc: 0.940462	valid_0's binary_logloss: 0.267049	valid_1's auc: 0.905593	valid_1's binary_logloss: 0.322087
[115]	valid_0's auc: 0.940639	valid_0's binary_logloss: 0.266716	valid_1's auc: 0.90557	valid_1's binary_logloss: 0.32215
[116]	valid_0's auc: 0.94083	valid_0's binary_logloss: 0.266406	valid_1's auc: 0.905444	valid_1's binary_logloss: 0.322341
[117]	valid_0's auc: 0.941021	valid_0's binary_logloss: 0.266029	valid_1's auc: 0.905374	valid_1's binary_logloss: 0.322546
[118]	valid_0's auc: 0.941259	valid_0's binary_logloss: 0.265625	valid_1's auc: 0.905347	valid_1's binary_logloss: 0.322609
[119]	valid_0's auc: 0.941491	valid_0's binary_logloss: 0.265255	valid_1's auc: 0.905292	valid_1's binary_logloss: 0.322695
[120]	valid_0's auc: 0.941711	valid_0's binary_logloss: 0.264853	valid_1's auc: 0.90531	valid_1's binary_logloss: 0.322673
[121]	valid_0's auc: 0.941847	valid_0's binary_logloss: 0.264551	valid_1's auc: 0.905391	valid_1's binary_logloss: 0.322663
[122]	valid_0's auc: 0.942006	valid_0's binary_logloss: 0.264255	valid_1's auc: 0.905345	valid_1's binary_logloss: 0.322787
[123]	valid_0's auc: 0.942171	valid_0's binary_logloss: 0.263909	valid_1's auc: 0.905214	valid_1's binary_logloss: 0.323012
[124]	valid_0's auc: 0.942392	valid_0's binary_logloss: 0.263522	valid_1's auc: 0.905208	valid_1's binary_logloss: 0.323058
[125]	valid_0's auc: 0.942556	valid_0's binary_logloss: 0.263229	valid_1's auc: 0.905137	valid_1's binary_logloss: 0.323252
[126]	valid_0's auc: 0.9427	valid_0's binary_logloss: 0.262933	valid_1's auc: 0.905096	valid_1's binary_logloss: 0.323417
[127]	valid_0's auc: 0.94286	valid_0's binary_logloss: 0.262591	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.323675
[128]	valid_0's auc: 0.943043	valid_0's binary_logloss: 0.262256	valid_1's auc: 0.904917	valid_1's binary_logloss: 0.323789
[129]	valid_0's auc: 0.943206	valid_0's binary_logloss: 0.261946	valid_1's auc: 0.90497	valid_1's binary_logloss: 0.323759
[130]	valid_0's auc: 0.943418	valid_0's binary_logloss: 0.261588	valid_1's auc: 0.90479	valid_1's binary_logloss: 0.324096
[131]	valid_0's auc: 0.943584	valid_0's binary_logloss: 0.261263	valid_1's auc: 0.90464	valid_1's binary_logloss: 0.324415
[132]	valid_0's auc: 0.943738	valid_0's binary_logloss: 0.260986	valid_1's auc: 0.904691	valid_1's binary_logloss: 0.324351
[133]	valid_0's auc: 0.943902	valid_0's binary_logloss: 0.260669	valid_1's auc: 0.904688	valid_1's binary_logloss: 0.32437
[134]	valid_0's auc: 0.944035	valid_0's binary_logloss: 0.260408	valid_1's auc: 0.904672	valid_1's binary_logloss: 0.324445
Early stopping, best iteration is:
[34]	valid_0's auc: 0.917257	valid_0's binary_logloss: 0.311013	valid_1's auc: 0.908253	valid_1's binary_logloss: 0.319253
[1]	valid_0's auc: 0.888786	valid_0's binary_logloss: 0.516801	valid_1's auc: 0.894376	valid_1's binary_logloss: 0.508215
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.892051	valid_0's binary_logloss: 0.487909	valid_1's auc: 0.897516	valid_1's binary_logloss: 0.478613
[3]	valid_0's auc: 0.892499	valid_0's binary_logloss: 0.464939	valid_1's auc: 0.897999	valid_1's binary_logloss: 0.455284
[4]	valid_0's auc: 0.893544	valid_0's binary_logloss: 0.445997	valid_1's auc: 0.898579	valid_1's binary_logloss: 0.43625
[5]	valid_0's auc: 0.897183	valid_0's binary_logloss: 0.429801	valid_1's auc: 0.901802	valid_1's binary_logloss: 0.419978
[6]	valid_0's auc: 0.898312	valid_0's binary_logloss: 0.416121	valid_1's auc: 0.902211	valid_1's binary_logloss: 0.406386
[7]	valid_0's auc: 0.899236	valid_0's binary_logloss: 0.40443	valid_1's auc: 0.902787	valid_1's binary_logloss: 0.394757
[8]	valid_0's auc: 0.899639	valid_0's binary_logloss: 0.394315	valid_1's auc: 0.90375	valid_1's binary_logloss: 0.384547
[9]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.38557	valid_1's auc: 0.904192	valid_1's binary_logloss: 0.376078
[10]	valid_0's auc: 0.901746	valid_0's binary_logloss: 0.377945	valid_1's auc: 0.904481	valid_1's binary_logloss: 0.368806
[11]	valid_0's auc: 0.90252	valid_0's binary_logloss: 0.371205	valid_1's auc: 0.904908	valid_1's binary_logloss: 0.362532
[12]	valid_0's auc: 0.903208	valid_0's binary_logloss: 0.365265	valid_1's auc: 0.905106	valid_1's binary_logloss: 0.35705
[13]	valid_0's auc: 0.904384	valid_0's binary_logloss: 0.359865	valid_1's auc: 0.90581	valid_1's binary_logloss: 0.352017
[14]	valid_0's auc: 0.905128	valid_0's binary_logloss: 0.355111	valid_1's auc: 0.905975	valid_1's binary_logloss: 0.347824
[15]	valid_0's auc: 0.905705	valid_0's binary_logloss: 0.350793	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.343996
[16]	valid_0's auc: 0.906417	valid_0's binary_logloss: 0.34692	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.340538
[17]	valid_0's auc: 0.906991	valid_0's binary_logloss: 0.343486	valid_1's auc: 0.907413	valid_1's binary_logloss: 0.337566
[18]	valid_0's auc: 0.907685	valid_0's binary_logloss: 0.3403	valid_1's auc: 0.907541	valid_1's binary_logloss: 0.335193
[19]	valid_0's auc: 0.908697	valid_0's binary_logloss: 0.33718	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.332963
[20]	valid_0's auc: 0.909236	valid_0's binary_logloss: 0.334664	valid_1's auc: 0.907698	valid_1's binary_logloss: 0.331169
[21]	valid_0's auc: 0.909946	valid_0's binary_logloss: 0.332149	valid_1's auc: 0.907765	valid_1's binary_logloss: 0.329395
[22]	valid_0's auc: 0.91055	valid_0's binary_logloss: 0.329865	valid_1's auc: 0.907693	valid_1's binary_logloss: 0.327991
[23]	valid_0's auc: 0.911096	valid_0's binary_logloss: 0.327761	valid_1's auc: 0.907887	valid_1's binary_logloss: 0.326502
[24]	valid_0's auc: 0.911622	valid_0's binary_logloss: 0.325895	valid_1's auc: 0.907813	valid_1's binary_logloss: 0.325328
[25]	valid_0's auc: 0.912289	valid_0's binary_logloss: 0.324032	valid_1's auc: 0.907784	valid_1's binary_logloss: 0.324371
[26]	valid_0's auc: 0.912815	valid_0's binary_logloss: 0.32235	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.323317
[27]	valid_0's auc: 0.91329	valid_0's binary_logloss: 0.320853	valid_1's auc: 0.908322	valid_1's binary_logloss: 0.322224
[28]	valid_0's auc: 0.913917	valid_0's binary_logloss: 0.319217	valid_1's auc: 0.908533	valid_1's binary_logloss: 0.321302
[29]	valid_0's auc: 0.914402	valid_0's binary_logloss: 0.317782	valid_1's auc: 0.908546	valid_1's binary_logloss: 0.320602
[30]	valid_0's auc: 0.915019	valid_0's binary_logloss: 0.316293	valid_1's auc: 0.908829	valid_1's binary_logloss: 0.319785
[31]	valid_0's auc: 0.915387	valid_0's binary_logloss: 0.315067	valid_1's auc: 0.909007	valid_1's binary_logloss: 0.319032
[32]	valid_0's auc: 0.91583	valid_0's binary_logloss: 0.31384	valid_1's auc: 0.909138	valid_1's binary_logloss: 0.318339
[33]	valid_0's auc: 0.916354	valid_0's binary_logloss: 0.312538	valid_1's auc: 0.909011	valid_1's binary_logloss: 0.318132
[34]	valid_0's auc: 0.916802	valid_0's binary_logloss: 0.311432	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.317532
[35]	valid_0's auc: 0.917239	valid_0's binary_logloss: 0.310354	valid_1's auc: 0.909012	valid_1's binary_logloss: 0.31753
[36]	valid_0's auc: 0.917734	valid_0's binary_logloss: 0.309295	valid_1's auc: 0.908956	valid_1's binary_logloss: 0.317387
[37]	valid_0's auc: 0.918224	valid_0's binary_logloss: 0.308235	valid_1's auc: 0.908942	valid_1's binary_logloss: 0.317161
[38]	valid_0's auc: 0.918653	valid_0's binary_logloss: 0.307231	valid_1's auc: 0.908973	valid_1's binary_logloss: 0.316889
[39]	valid_0's auc: 0.919059	valid_0's binary_logloss: 0.306309	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.316821
[40]	valid_0's auc: 0.919502	valid_0's binary_logloss: 0.305317	valid_1's auc: 0.908904	valid_1's binary_logloss: 0.316604
[41]	valid_0's auc: 0.919946	valid_0's binary_logloss: 0.30441	valid_1's auc: 0.908979	valid_1's binary_logloss: 0.316364
[42]	valid_0's auc: 0.920401	valid_0's binary_logloss: 0.303521	valid_1's auc: 0.908988	valid_1's binary_logloss: 0.316205
[43]	valid_0's auc: 0.920804	valid_0's binary_logloss: 0.302725	valid_1's auc: 0.908967	valid_1's binary_logloss: 0.316131
[44]	valid_0's auc: 0.921189	valid_0's binary_logloss: 0.301906	valid_1's auc: 0.908826	valid_1's binary_logloss: 0.316251
[45]	valid_0's auc: 0.921589	valid_0's binary_logloss: 0.30112	valid_1's auc: 0.908796	valid_1's binary_logloss: 0.316257
[46]	valid_0's auc: 0.922026	valid_0's binary_logloss: 0.300273	valid_1's auc: 0.908626	valid_1's binary_logloss: 0.316418
[47]	valid_0's auc: 0.92249	valid_0's binary_logloss: 0.299381	valid_1's auc: 0.908726	valid_1's binary_logloss: 0.316232
[48]	valid_0's auc: 0.922875	valid_0's binary_logloss: 0.298649	valid_1's auc: 0.908638	valid_1's binary_logloss: 0.316235
[49]	valid_0's auc: 0.923227	valid_0's binary_logloss: 0.297966	valid_1's auc: 0.908616	valid_1's binary_logloss: 0.316207
[50]	valid_0's auc: 0.923544	valid_0's binary_logloss: 0.297361	valid_1's auc: 0.908662	valid_1's binary_logloss: 0.316117
[51]	valid_0's auc: 0.923934	valid_0's binary_logloss: 0.296621	valid_1's auc: 0.908631	valid_1's binary_logloss: 0.316127
[52]	valid_0's auc: 0.924327	valid_0's binary_logloss: 0.295876	valid_1's auc: 0.908623	valid_1's binary_logloss: 0.316091
[53]	valid_0's auc: 0.924725	valid_0's binary_logloss: 0.295209	valid_1's auc: 0.908666	valid_1's binary_logloss: 0.316003
[54]	valid_0's auc: 0.925046	valid_0's binary_logloss: 0.294597	valid_1's auc: 0.908572	valid_1's binary_logloss: 0.316123
[55]	valid_0's auc: 0.925369	valid_0's binary_logloss: 0.293972	valid_1's auc: 0.908567	valid_1's binary_logloss: 0.316114
[56]	valid_0's auc: 0.925579	valid_0's binary_logloss: 0.293536	valid_1's auc: 0.908619	valid_1's binary_logloss: 0.316026
[57]	valid_0's auc: 0.925931	valid_0's binary_logloss: 0.292928	valid_1's auc: 0.908644	valid_1's binary_logloss: 0.316013
[58]	valid_0's auc: 0.926224	valid_0's binary_logloss: 0.292399	valid_1's auc: 0.908595	valid_1's binary_logloss: 0.316039
[59]	valid_0's auc: 0.926538	valid_0's binary_logloss: 0.291827	valid_1's auc: 0.908602	valid_1's binary_logloss: 0.31605
[60]	valid_0's auc: 0.926954	valid_0's binary_logloss: 0.291086	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.31629
[61]	valid_0's auc: 0.92723	valid_0's binary_logloss: 0.290576	valid_1's auc: 0.908429	valid_1's binary_logloss: 0.31632
[62]	valid_0's auc: 0.927503	valid_0's binary_logloss: 0.290072	valid_1's auc: 0.908419	valid_1's binary_logloss: 0.316357
[63]	valid_0's auc: 0.927803	valid_0's binary_logloss: 0.289538	valid_1's auc: 0.908349	valid_1's binary_logloss: 0.316468
[64]	valid_0's auc: 0.928077	valid_0's binary_logloss: 0.288985	valid_1's auc: 0.908296	valid_1's binary_logloss: 0.316546
[65]	valid_0's auc: 0.928388	valid_0's binary_logloss: 0.288457	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.316546
[66]	valid_0's auc: 0.928733	valid_0's binary_logloss: 0.287876	valid_1's auc: 0.908202	valid_1's binary_logloss: 0.316669
[67]	valid_0's auc: 0.929049	valid_0's binary_logloss: 0.287345	valid_1's auc: 0.908191	valid_1's binary_logloss: 0.316665
[68]	valid_0's auc: 0.929419	valid_0's binary_logloss: 0.286763	valid_1's auc: 0.908169	valid_1's binary_logloss: 0.316757
[69]	valid_0's auc: 0.929715	valid_0's binary_logloss: 0.286234	valid_1's auc: 0.908156	valid_1's binary_logloss: 0.316807
[70]	valid_0's auc: 0.929892	valid_0's binary_logloss: 0.285859	valid_1's auc: 0.908141	valid_1's binary_logloss: 0.316831
[71]	valid_0's auc: 0.930167	valid_0's binary_logloss: 0.285375	valid_1's auc: 0.90812	valid_1's binary_logloss: 0.316851
[72]	valid_0's auc: 0.930415	valid_0's binary_logloss: 0.284952	valid_1's auc: 0.908137	valid_1's binary_logloss: 0.31689
[73]	valid_0's auc: 0.930696	valid_0's binary_logloss: 0.284465	valid_1's auc: 0.908214	valid_1's binary_logloss: 0.316772
[74]	valid_0's auc: 0.930906	valid_0's binary_logloss: 0.284044	valid_1's auc: 0.908148	valid_1's binary_logloss: 0.316901
[75]	valid_0's auc: 0.93114	valid_0's binary_logloss: 0.283662	valid_1's auc: 0.908138	valid_1's binary_logloss: 0.31691
[76]	valid_0's auc: 0.931411	valid_0's binary_logloss: 0.283182	valid_1's auc: 0.908085	valid_1's binary_logloss: 0.31702
[77]	valid_0's auc: 0.931698	valid_0's binary_logloss: 0.282703	valid_1's auc: 0.907998	valid_1's binary_logloss: 0.317124
[78]	valid_0's auc: 0.931918	valid_0's binary_logloss: 0.282304	valid_1's auc: 0.9079	valid_1's binary_logloss: 0.317312
[79]	valid_0's auc: 0.932224	valid_0's binary_logloss: 0.28178	valid_1's auc: 0.907724	valid_1's binary_logloss: 0.317566
[80]	valid_0's auc: 0.932421	valid_0's binary_logloss: 0.281403	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317591
[81]	valid_0's auc: 0.932605	valid_0's binary_logloss: 0.281048	valid_1's auc: 0.907662	valid_1's binary_logloss: 0.317643
[82]	valid_0's auc: 0.932886	valid_0's binary_logloss: 0.280521	valid_1's auc: 0.907624	valid_1's binary_logloss: 0.31769
[83]	valid_0's auc: 0.933196	valid_0's binary_logloss: 0.279997	valid_1's auc: 0.907671	valid_1's binary_logloss: 0.317635
[84]	valid_0's auc: 0.933477	valid_0's binary_logloss: 0.279501	valid_1's auc: 0.907687	valid_1's binary_logloss: 0.317667
[85]	valid_0's auc: 0.933728	valid_0's binary_logloss: 0.279039	valid_1's auc: 0.907616	valid_1's binary_logloss: 0.317781
[86]	valid_0's auc: 0.933976	valid_0's binary_logloss: 0.278647	valid_1's auc: 0.907367	valid_1's binary_logloss: 0.318148
[87]	valid_0's auc: 0.934289	valid_0's binary_logloss: 0.278067	valid_1's auc: 0.907425	valid_1's binary_logloss: 0.318076
[88]	valid_0's auc: 0.934453	valid_0's binary_logloss: 0.277729	valid_1's auc: 0.907298	valid_1's binary_logloss: 0.318265
[89]	valid_0's auc: 0.934682	valid_0's binary_logloss: 0.277329	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.318361
[90]	valid_0's auc: 0.935014	valid_0's binary_logloss: 0.276763	valid_1's auc: 0.907298	valid_1's binary_logloss: 0.318282
[91]	valid_0's auc: 0.935164	valid_0's binary_logloss: 0.276458	valid_1's auc: 0.90724	valid_1's binary_logloss: 0.318411
[92]	valid_0's auc: 0.935467	valid_0's binary_logloss: 0.27594	valid_1's auc: 0.907252	valid_1's binary_logloss: 0.31837
[93]	valid_0's auc: 0.935697	valid_0's binary_logloss: 0.275542	valid_1's auc: 0.907156	valid_1's binary_logloss: 0.318532
[94]	valid_0's auc: 0.935915	valid_0's binary_logloss: 0.275126	valid_1's auc: 0.907188	valid_1's binary_logloss: 0.318485
[95]	valid_0's auc: 0.936162	valid_0's binary_logloss: 0.274699	valid_1's auc: 0.907071	valid_1's binary_logloss: 0.318683
[96]	valid_0's auc: 0.936292	valid_0's binary_logloss: 0.274455	valid_1's auc: 0.90693	valid_1's binary_logloss: 0.318937
[97]	valid_0's auc: 0.936501	valid_0's binary_logloss: 0.274062	valid_1's auc: 0.906819	valid_1's binary_logloss: 0.319142
[98]	valid_0's auc: 0.936673	valid_0's binary_logloss: 0.273734	valid_1's auc: 0.906912	valid_1's binary_logloss: 0.318993
[99]	valid_0's auc: 0.936868	valid_0's binary_logloss: 0.273326	valid_1's auc: 0.907019	valid_1's binary_logloss: 0.318859
[100]	valid_0's auc: 0.937118	valid_0's binary_logloss: 0.272887	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.318774
[101]	valid_0's auc: 0.937303	valid_0's binary_logloss: 0.272559	valid_1's auc: 0.907039	valid_1's binary_logloss: 0.318837
[102]	valid_0's auc: 0.937483	valid_0's binary_logloss: 0.272225	valid_1's auc: 0.907035	valid_1's binary_logloss: 0.318844
[103]	valid_0's auc: 0.937661	valid_0's binary_logloss: 0.271877	valid_1's auc: 0.907013	valid_1's binary_logloss: 0.318849
[104]	valid_0's auc: 0.937867	valid_0's binary_logloss: 0.271476	valid_1's auc: 0.907009	valid_1's binary_logloss: 0.318842
[105]	valid_0's auc: 0.938085	valid_0's binary_logloss: 0.271081	valid_1's auc: 0.906924	valid_1's binary_logloss: 0.318947
[106]	valid_0's auc: 0.938354	valid_0's binary_logloss: 0.270601	valid_1's auc: 0.906937	valid_1's binary_logloss: 0.31897
[107]	valid_0's auc: 0.938565	valid_0's binary_logloss: 0.270235	valid_1's auc: 0.906825	valid_1's binary_logloss: 0.319159
[108]	valid_0's auc: 0.938785	valid_0's binary_logloss: 0.269838	valid_1's auc: 0.906862	valid_1's binary_logloss: 0.319182
[109]	valid_0's auc: 0.938934	valid_0's binary_logloss: 0.269559	valid_1's auc: 0.906779	valid_1's binary_logloss: 0.319397
[110]	valid_0's auc: 0.939096	valid_0's binary_logloss: 0.269258	valid_1's auc: 0.90673	valid_1's binary_logloss: 0.31956
[111]	valid_0's auc: 0.939269	valid_0's binary_logloss: 0.268906	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.319407
[112]	valid_0's auc: 0.939449	valid_0's binary_logloss: 0.268568	valid_1's auc: 0.906731	valid_1's binary_logloss: 0.319576
[113]	valid_0's auc: 0.939771	valid_0's binary_logloss: 0.268029	valid_1's auc: 0.906711	valid_1's binary_logloss: 0.319599
[114]	valid_0's auc: 0.94006	valid_0's binary_logloss: 0.267503	valid_1's auc: 0.906693	valid_1's binary_logloss: 0.319699
[115]	valid_0's auc: 0.940224	valid_0's binary_logloss: 0.2672	valid_1's auc: 0.906679	valid_1's binary_logloss: 0.319714
[116]	valid_0's auc: 0.940445	valid_0's binary_logloss: 0.266824	valid_1's auc: 0.906677	valid_1's binary_logloss: 0.319732
[117]	valid_0's auc: 0.940636	valid_0's binary_logloss: 0.266474	valid_1's auc: 0.906535	valid_1's binary_logloss: 0.320009
[118]	valid_0's auc: 0.940794	valid_0's binary_logloss: 0.266196	valid_1's auc: 0.906415	valid_1's binary_logloss: 0.320227
[119]	valid_0's auc: 0.941021	valid_0's binary_logloss: 0.265793	valid_1's auc: 0.906343	valid_1's binary_logloss: 0.320407
[120]	valid_0's auc: 0.941227	valid_0's binary_logloss: 0.265412	valid_1's auc: 0.906356	valid_1's binary_logloss: 0.320474
[121]	valid_0's auc: 0.941351	valid_0's binary_logloss: 0.26517	valid_1's auc: 0.906213	valid_1's binary_logloss: 0.320714
[122]	valid_0's auc: 0.941582	valid_0's binary_logloss: 0.264732	valid_1's auc: 0.906262	valid_1's binary_logloss: 0.320721
[123]	valid_0's auc: 0.941828	valid_0's binary_logloss: 0.264314	valid_1's auc: 0.906305	valid_1's binary_logloss: 0.320669
[124]	valid_0's auc: 0.942058	valid_0's binary_logloss: 0.263911	valid_1's auc: 0.906263	valid_1's binary_logloss: 0.320703
[125]	valid_0's auc: 0.942219	valid_0's binary_logloss: 0.263604	valid_1's auc: 0.906292	valid_1's binary_logloss: 0.320732
[126]	valid_0's auc: 0.942336	valid_0's binary_logloss: 0.263362	valid_1's auc: 0.906224	valid_1's binary_logloss: 0.320889
[127]	valid_0's auc: 0.942531	valid_0's binary_logloss: 0.263001	valid_1's auc: 0.906188	valid_1's binary_logloss: 0.320982
[128]	valid_0's auc: 0.942742	valid_0's binary_logloss: 0.262636	valid_1's auc: 0.906155	valid_1's binary_logloss: 0.321039
[129]	valid_0's auc: 0.942937	valid_0's binary_logloss: 0.262268	valid_1's auc: 0.905972	valid_1's binary_logloss: 0.321311
[130]	valid_0's auc: 0.943155	valid_0's binary_logloss: 0.261898	valid_1's auc: 0.90588	valid_1's binary_logloss: 0.321501
[131]	valid_0's auc: 0.943378	valid_0's binary_logloss: 0.261518	valid_1's auc: 0.905774	valid_1's binary_logloss: 0.32168
[132]	valid_0's auc: 0.943537	valid_0's binary_logloss: 0.261213	valid_1's auc: 0.905738	valid_1's binary_logloss: 0.32176
[133]	valid_0's auc: 0.943667	valid_0's binary_logloss: 0.260918	valid_1's auc: 0.905698	valid_1's binary_logloss: 0.321856
[134]	valid_0's auc: 0.943811	valid_0's binary_logloss: 0.260644	valid_1's auc: 0.90573	valid_1's binary_logloss: 0.321815
Early stopping, best iteration is:
[34]	valid_0's auc: 0.916802	valid_0's binary_logloss: 0.311432	valid_1's auc: 0.909175	valid_1's binary_logloss: 0.317532
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8932	valid_0's binary_logloss: 0.488767	valid_1's auc: 0.898628	valid_1's binary_logloss: 0.47931
[3]	valid_0's auc: 0.893892	valid_0's binary_logloss: 0.46573	valid_1's auc: 0.899079	valid_1's binary_logloss: 0.45581
[4]	valid_0's auc: 0.895475	valid_0's binary_logloss: 0.446714	valid_1's auc: 0.900674	valid_1's binary_logloss: 0.436743
[5]	valid_0's auc: 0.897074	valid_0's binary_logloss: 0.430337	valid_1's auc: 0.90173	valid_1's binary_logloss: 0.42032
[6]	valid_0's auc: 0.898357	valid_0's binary_logloss: 0.416642	valid_1's auc: 0.902698	valid_1's binary_logloss: 0.406406
[7]	valid_0's auc: 0.899307	valid_0's binary_logloss: 0.404911	valid_1's auc: 0.903472	valid_1's binary_logloss: 0.394687
[8]	valid_0's auc: 0.900174	valid_0's binary_logloss: 0.394885	valid_1's auc: 0.904079	valid_1's binary_logloss: 0.384734
[9]	valid_0's auc: 0.901445	valid_0's binary_logloss: 0.385831	valid_1's auc: 0.904686	valid_1's binary_logloss: 0.375986
[10]	valid_0's auc: 0.901761	valid_0's binary_logloss: 0.378314	valid_1's auc: 0.905095	valid_1's binary_logloss: 0.368578
[11]	valid_0's auc: 0.902733	valid_0's binary_logloss: 0.371404	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.362191
[12]	valid_0's auc: 0.903536	valid_0's binary_logloss: 0.365482	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.356725
[13]	valid_0's auc: 0.903939	valid_0's binary_logloss: 0.360327	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.352125
[14]	valid_0's auc: 0.905191	valid_0's binary_logloss: 0.355322	valid_1's auc: 0.906402	valid_1's binary_logloss: 0.347668
[15]	valid_0's auc: 0.905928	valid_0's binary_logloss: 0.350984	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.343872
[16]	valid_0's auc: 0.906579	valid_0's binary_logloss: 0.347141	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.340579
[17]	valid_0's auc: 0.907267	valid_0's binary_logloss: 0.343682	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.337531
[18]	valid_0's auc: 0.907585	valid_0's binary_logloss: 0.340752	valid_1's auc: 0.907531	valid_1's binary_logloss: 0.335234
[19]	valid_0's auc: 0.907981	valid_0's binary_logloss: 0.338032	valid_1's auc: 0.9076	valid_1's binary_logloss: 0.333033
[20]	valid_0's auc: 0.908579	valid_0's binary_logloss: 0.335439	valid_1's auc: 0.907959	valid_1's binary_logloss: 0.330861
[21]	valid_0's auc: 0.909224	valid_0's binary_logloss: 0.332941	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.329012
[22]	valid_0's auc: 0.909814	valid_0's binary_logloss: 0.330747	valid_1's auc: 0.908289	valid_1's binary_logloss: 0.327299
[23]	valid_0's auc: 0.910367	valid_0's binary_logloss: 0.328736	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.325822
[24]	valid_0's auc: 0.910998	valid_0's binary_logloss: 0.326659	valid_1's auc: 0.908815	valid_1's binary_logloss: 0.324376
[25]	valid_0's auc: 0.911591	valid_0's binary_logloss: 0.324721	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.32308
[26]	valid_0's auc: 0.912063	valid_0's binary_logloss: 0.323012	valid_1's auc: 0.90899	valid_1's binary_logloss: 0.322186
[27]	valid_0's auc: 0.912484	valid_0's binary_logloss: 0.321575	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.321378
[28]	valid_0's auc: 0.912988	valid_0's binary_logloss: 0.320081	valid_1's auc: 0.90915	valid_1's binary_logloss: 0.320579
[29]	valid_0's auc: 0.913467	valid_0's binary_logloss: 0.318722	valid_1's auc: 0.909227	valid_1's binary_logloss: 0.319887
[30]	valid_0's auc: 0.91399	valid_0's binary_logloss: 0.317347	valid_1's auc: 0.909389	valid_1's binary_logloss: 0.319109
[31]	valid_0's auc: 0.91451	valid_0's binary_logloss: 0.316022	valid_1's auc: 0.909505	valid_1's binary_logloss: 0.318472
[32]	valid_0's auc: 0.915025	valid_0's binary_logloss: 0.314768	valid_1's auc: 0.909635	valid_1's binary_logloss: 0.317932
[33]	valid_0's auc: 0.915492	valid_0's binary_logloss: 0.31362	valid_1's auc: 0.909783	valid_1's binary_logloss: 0.317396
[34]	valid_0's auc: 0.91596	valid_0's binary_logloss: 0.312525	valid_1's auc: 0.909863	valid_1's binary_logloss: 0.316953
[35]	valid_0's auc: 0.916329	valid_0's binary_logloss: 0.311549	valid_1's auc: 0.909848	valid_1's binary_logloss: 0.316623
[36]	valid_0's auc: 0.916732	valid_0's binary_logloss: 0.31057	valid_1's auc: 0.909996	valid_1's binary_logloss: 0.316163
[37]	valid_0's auc: 0.917177	valid_0's binary_logloss: 0.30959	valid_1's auc: 0.910027	valid_1's binary_logloss: 0.315878
[38]	valid_0's auc: 0.917608	valid_0's binary_logloss: 0.30868	valid_1's auc: 0.909985	valid_1's binary_logloss: 0.315724
[39]	valid_0's auc: 0.918043	valid_0's binary_logloss: 0.307749	valid_1's auc: 0.909963	valid_1's binary_logloss: 0.315561
[40]	valid_0's auc: 0.918533	valid_0's binary_logloss: 0.306712	valid_1's auc: 0.909808	valid_1's binary_logloss: 0.315598
[41]	valid_0's auc: 0.918897	valid_0's binary_logloss: 0.305891	valid_1's auc: 0.9098	valid_1's binary_logloss: 0.315512
[42]	valid_0's auc: 0.919356	valid_0's binary_logloss: 0.30499	valid_1's auc: 0.90985	valid_1's binary_logloss: 0.315316
[43]	valid_0's auc: 0.919642	valid_0's binary_logloss: 0.304318	valid_1's auc: 0.909983	valid_1's binary_logloss: 0.314974
[44]	valid_0's auc: 0.919956	valid_0's binary_logloss: 0.303636	valid_1's auc: 0.909873	valid_1's binary_logloss: 0.315008
[45]	valid_0's auc: 0.920353	valid_0's binary_logloss: 0.302856	valid_1's auc: 0.909891	valid_1's binary_logloss: 0.314825
[46]	valid_0's auc: 0.920642	valid_0's binary_logloss: 0.302205	valid_1's auc: 0.909874	valid_1's binary_logloss: 0.314755
[47]	valid_0's auc: 0.920954	valid_0's binary_logloss: 0.301597	valid_1's auc: 0.909939	valid_1's binary_logloss: 0.314549
[48]	valid_0's auc: 0.921313	valid_0's binary_logloss: 0.300869	valid_1's auc: 0.910091	valid_1's binary_logloss: 0.314255
[49]	valid_0's auc: 0.921603	valid_0's binary_logloss: 0.300313	valid_1's auc: 0.910099	valid_1's binary_logloss: 0.314128
[50]	valid_0's auc: 0.921962	valid_0's binary_logloss: 0.299636	valid_1's auc: 0.91008	valid_1's binary_logloss: 0.314059
[51]	valid_0's auc: 0.922354	valid_0's binary_logloss: 0.298955	valid_1's auc: 0.909955	valid_1's binary_logloss: 0.31414
[52]	valid_0's auc: 0.922651	valid_0's binary_logloss: 0.298421	valid_1's auc: 0.909936	valid_1's binary_logloss: 0.314118
[53]	valid_0's auc: 0.922888	valid_0's binary_logloss: 0.297889	valid_1's auc: 0.909984	valid_1's binary_logloss: 0.31396
[54]	valid_0's auc: 0.923114	valid_0's binary_logloss: 0.297483	valid_1's auc: 0.909885	valid_1's binary_logloss: 0.314076
[55]	valid_0's auc: 0.923502	valid_0's binary_logloss: 0.296859	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.314015
[56]	valid_0's auc: 0.923783	valid_0's binary_logloss: 0.296359	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.313997
[57]	valid_0's auc: 0.924115	valid_0's binary_logloss: 0.295771	valid_1's auc: 0.909733	valid_1's binary_logloss: 0.314065
[58]	valid_0's auc: 0.924405	valid_0's binary_logloss: 0.29519	valid_1's auc: 0.909696	valid_1's binary_logloss: 0.314093
[59]	valid_0's auc: 0.924766	valid_0's binary_logloss: 0.29456	valid_1's auc: 0.909534	valid_1's binary_logloss: 0.314286
[60]	valid_0's auc: 0.925093	valid_0's binary_logloss: 0.293974	valid_1's auc: 0.909612	valid_1's binary_logloss: 0.314132
[61]	valid_0's auc: 0.925373	valid_0's binary_logloss: 0.293449	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.314146
[62]	valid_0's auc: 0.925605	valid_0's binary_logloss: 0.293006	valid_1's auc: 0.909522	valid_1's binary_logloss: 0.314297
[63]	valid_0's auc: 0.925955	valid_0's binary_logloss: 0.292423	valid_1's auc: 0.909516	valid_1's binary_logloss: 0.314312
[64]	valid_0's auc: 0.926322	valid_0's binary_logloss: 0.291792	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.314427
[65]	valid_0's auc: 0.926646	valid_0's binary_logloss: 0.291225	valid_1's auc: 0.909607	valid_1's binary_logloss: 0.314161
[66]	valid_0's auc: 0.926979	valid_0's binary_logloss: 0.290641	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.314365
[67]	valid_0's auc: 0.927286	valid_0's binary_logloss: 0.290135	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314266
[68]	valid_0's auc: 0.927572	valid_0's binary_logloss: 0.289674	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.314318
[69]	valid_0's auc: 0.927887	valid_0's binary_logloss: 0.289159	valid_1's auc: 0.909494	valid_1's binary_logloss: 0.314294
[70]	valid_0's auc: 0.928168	valid_0's binary_logloss: 0.288664	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314386
[71]	valid_0's auc: 0.928416	valid_0's binary_logloss: 0.288244	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.314417
[72]	valid_0's auc: 0.928647	valid_0's binary_logloss: 0.287841	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314316
[73]	valid_0's auc: 0.928899	valid_0's binary_logloss: 0.28739	valid_1's auc: 0.90939	valid_1's binary_logloss: 0.31438
[74]	valid_0's auc: 0.929123	valid_0's binary_logloss: 0.286929	valid_1's auc: 0.909313	valid_1's binary_logloss: 0.314529
[75]	valid_0's auc: 0.929313	valid_0's binary_logloss: 0.286574	valid_1's auc: 0.909183	valid_1's binary_logloss: 0.314724
[76]	valid_0's auc: 0.929589	valid_0's binary_logloss: 0.286122	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314645
[77]	valid_0's auc: 0.929911	valid_0's binary_logloss: 0.285585	valid_1's auc: 0.909283	valid_1's binary_logloss: 0.314668
[78]	valid_0's auc: 0.930238	valid_0's binary_logloss: 0.284983	valid_1's auc: 0.909161	valid_1's binary_logloss: 0.314818
[79]	valid_0's auc: 0.930456	valid_0's binary_logloss: 0.284605	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.314946
[80]	valid_0's auc: 0.930692	valid_0's binary_logloss: 0.284227	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.314987
[81]	valid_0's auc: 0.930953	valid_0's binary_logloss: 0.283839	valid_1's auc: 0.909057	valid_1's binary_logloss: 0.314989
[82]	valid_0's auc: 0.931189	valid_0's binary_logloss: 0.283427	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.314987
[83]	valid_0's auc: 0.931412	valid_0's binary_logloss: 0.283015	valid_1's auc: 0.909046	valid_1's binary_logloss: 0.314993
[84]	valid_0's auc: 0.931612	valid_0's binary_logloss: 0.282609	valid_1's auc: 0.908999	valid_1's binary_logloss: 0.315056
[85]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.282069	valid_1's auc: 0.90894	valid_1's binary_logloss: 0.315245
[86]	valid_0's auc: 0.932196	valid_0's binary_logloss: 0.281601	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.315132
[87]	valid_0's auc: 0.932384	valid_0's binary_logloss: 0.281237	valid_1's auc: 0.908925	valid_1's binary_logloss: 0.315259
[88]	valid_0's auc: 0.932563	valid_0's binary_logloss: 0.280891	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.315435
[89]	valid_0's auc: 0.932784	valid_0's binary_logloss: 0.280502	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315602
[90]	valid_0's auc: 0.933094	valid_0's binary_logloss: 0.279944	valid_1's auc: 0.908822	valid_1's binary_logloss: 0.315632
[91]	valid_0's auc: 0.933414	valid_0's binary_logloss: 0.279407	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.315551
[92]	valid_0's auc: 0.9337	valid_0's binary_logloss: 0.278888	valid_1's auc: 0.908842	valid_1's binary_logloss: 0.315573
[93]	valid_0's auc: 0.933934	valid_0's binary_logloss: 0.278476	valid_1's auc: 0.908746	valid_1's binary_logloss: 0.315768
[94]	valid_0's auc: 0.934128	valid_0's binary_logloss: 0.278151	valid_1's auc: 0.908789	valid_1's binary_logloss: 0.3157
[95]	valid_0's auc: 0.934422	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.315626
[96]	valid_0's auc: 0.93463	valid_0's binary_logloss: 0.277331	valid_1's auc: 0.908761	valid_1's binary_logloss: 0.315754
[97]	valid_0's auc: 0.934849	valid_0's binary_logloss: 0.27698	valid_1's auc: 0.908643	valid_1's binary_logloss: 0.315958
[98]	valid_0's auc: 0.93503	valid_0's binary_logloss: 0.27664	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315981
[99]	valid_0's auc: 0.935229	valid_0's binary_logloss: 0.276282	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.316069
[100]	valid_0's auc: 0.935443	valid_0's binary_logloss: 0.275923	valid_1's auc: 0.908452	valid_1's binary_logloss: 0.316341
[101]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275532	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.316502
[102]	valid_0's auc: 0.935864	valid_0's binary_logloss: 0.275199	valid_1's auc: 0.908266	valid_1's binary_logloss: 0.316685
[103]	valid_0's auc: 0.936067	valid_0's binary_logloss: 0.274853	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316763
[104]	valid_0's auc: 0.936238	valid_0's binary_logloss: 0.274524	valid_1's auc: 0.908225	valid_1's binary_logloss: 0.316735
[105]	valid_0's auc: 0.936465	valid_0's binary_logloss: 0.274122	valid_1's auc: 0.908206	valid_1's binary_logloss: 0.316803
[106]	valid_0's auc: 0.93672	valid_0's binary_logloss: 0.27371	valid_1's auc: 0.908147	valid_1's binary_logloss: 0.316885
[107]	valid_0's auc: 0.936991	valid_0's binary_logloss: 0.273246	valid_1's auc: 0.908135	valid_1's binary_logloss: 0.316985
[108]	valid_0's auc: 0.937202	valid_0's binary_logloss: 0.272877	valid_1's auc: 0.908127	valid_1's binary_logloss: 0.316978
[109]	valid_0's auc: 0.937417	valid_0's binary_logloss: 0.272449	valid_1's auc: 0.90804	valid_1's binary_logloss: 0.317113
[110]	valid_0's auc: 0.937688	valid_0's binary_logloss: 0.27202	valid_1's auc: 0.908076	valid_1's binary_logloss: 0.317064
[111]	valid_0's auc: 0.937919	valid_0's binary_logloss: 0.271627	valid_1's auc: 0.907931	valid_1's binary_logloss: 0.317262
[112]	valid_0's auc: 0.938123	valid_0's binary_logloss: 0.271291	valid_1's auc: 0.907912	valid_1's binary_logloss: 0.317307
[113]	valid_0's auc: 0.938332	valid_0's binary_logloss: 0.27093	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317425
[114]	valid_0's auc: 0.938487	valid_0's binary_logloss: 0.27064	valid_1's auc: 0.90789	valid_1's binary_logloss: 0.317408
[115]	valid_0's auc: 0.93863	valid_0's binary_logloss: 0.270362	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317554
[116]	valid_0's auc: 0.938881	valid_0's binary_logloss: 0.269949	valid_1's auc: 0.90777	valid_1's binary_logloss: 0.317682
[117]	valid_0's auc: 0.939069	valid_0's binary_logloss: 0.269617	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.317753
[118]	valid_0's auc: 0.939287	valid_0's binary_logloss: 0.269249	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.317815
[119]	valid_0's auc: 0.93949	valid_0's binary_logloss: 0.268874	valid_1's auc: 0.90763	valid_1's binary_logloss: 0.317948
[120]	valid_0's auc: 0.939693	valid_0's binary_logloss: 0.268528	valid_1's auc: 0.907626	valid_1's binary_logloss: 0.317978
[121]	valid_0's auc: 0.939924	valid_0's binary_logloss: 0.268147	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.318096
[122]	valid_0's auc: 0.940103	valid_0's binary_logloss: 0.267815	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.318261
[123]	valid_0's auc: 0.940249	valid_0's binary_logloss: 0.267532	valid_1's auc: 0.907409	valid_1's binary_logloss: 0.318474
[124]	valid_0's auc: 0.940518	valid_0's binary_logloss: 0.267071	valid_1's auc: 0.90735	valid_1's binary_logloss: 0.318619
[125]	valid_0's auc: 0.940714	valid_0's binary_logloss: 0.266708	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.318723
[126]	valid_0's auc: 0.940927	valid_0's binary_logloss: 0.266327	valid_1's auc: 0.907344	valid_1's binary_logloss: 0.318624
[127]	valid_0's auc: 0.941139	valid_0's binary_logloss: 0.265982	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318776
[128]	valid_0's auc: 0.941299	valid_0's binary_logloss: 0.265688	valid_1's auc: 0.907144	valid_1's binary_logloss: 0.318995
[129]	valid_0's auc: 0.941427	valid_0's binary_logloss: 0.265455	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.319109
[130]	valid_0's auc: 0.941572	valid_0's binary_logloss: 0.26517	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.319302
[131]	valid_0's auc: 0.941737	valid_0's binary_logloss: 0.26486	valid_1's auc: 0.906834	valid_1's binary_logloss: 0.319542
[132]	valid_0's auc: 0.941866	valid_0's binary_logloss: 0.264589	valid_1's auc: 0.906755	valid_1's binary_logloss: 0.319739
[133]	valid_0's auc: 0.942026	valid_0's binary_logloss: 0.264307	valid_1's auc: 0.906645	valid_1's binary_logloss: 0.319946
[134]	valid_0's auc: 0.942229	valid_0's binary_logloss: 0.263922	valid_1's auc: 0.906623	valid_1's binary_logloss: 0.32003
[135]	valid_0's auc: 0.94233	valid_0's binary_logloss: 0.26371	valid_1's auc: 0.906602	valid_1's binary_logloss: 0.320154
[136]	valid_0's auc: 0.942465	valid_0's binary_logloss: 0.263417	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320386
[137]	valid_0's auc: 0.942665	valid_0's binary_logloss: 0.263056	valid_1's auc: 0.906468	valid_1's binary_logloss: 0.32047
[138]	valid_0's auc: 0.942783	valid_0's binary_logloss: 0.262832	valid_1's auc: 0.906382	valid_1's binary_logloss: 0.320648
[139]	valid_0's auc: 0.942916	valid_0's binary_logloss: 0.26256	valid_1's auc: 0.906411	valid_1's binary_logloss: 0.320636
[140]	valid_0's auc: 0.943083	valid_0's binary_logloss: 0.262249	valid_1's auc: 0.906484	valid_1's binary_logloss: 0.320538
[141]	valid_0's auc: 0.943276	valid_0's binary_logloss: 0.261894	valid_1's auc: 0.906459	valid_1's binary_logloss: 0.320551
[142]	valid_0's auc: 0.943505	valid_0's binary_logloss: 0.261504	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.320609
[143]	valid_0's auc: 0.943705	valid_0's binary_logloss: 0.261135	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320639
[144]	valid_0's auc: 0.943955	valid_0's binary_logloss: 0.260661	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320741
[145]	valid_0's auc: 0.944104	valid_0's binary_logloss: 0.260371	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.320844
[146]	valid_0's auc: 0.944221	valid_0's binary_logloss: 0.260134	valid_1's auc: 0.906349	valid_1's binary_logloss: 0.321079
[147]	valid_0's auc: 0.944388	valid_0's binary_logloss: 0.259839	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.321143
[148]	valid_0's auc: 0.944516	valid_0's binary_logloss: 0.259605	valid_1's auc: 0.906319	valid_1's binary_logloss: 0.321184
[149]	valid_0's auc: 0.944756	valid_0's binary_logloss: 0.259183	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.32151
Early stopping, best iteration is:
[49]	valid_0's auc: 0.921603	valid_0's binary_logloss: 0.300313	valid_1's auc: 0.910099	valid_1's binary_logloss: 0.314128
[1]	valid_0's auc: 0.888033	valid_0's binary_logloss: 0.517843	valid_1's auc: 0.894415	valid_1's binary_logloss: 0.508761
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891314	valid_0's binary_logloss: 0.489285	valid_1's auc: 0.895027	valid_1's binary_logloss: 0.479894
[3]	valid_0's auc: 0.894088	valid_0's binary_logloss: 0.465958	valid_1's auc: 0.896489	valid_1's binary_logloss: 0.456524
[4]	valid_0's auc: 0.89488	valid_0's binary_logloss: 0.446911	valid_1's auc: 0.898262	valid_1's binary_logloss: 0.43713
[5]	valid_0's auc: 0.896689	valid_0's binary_logloss: 0.430552	valid_1's auc: 0.899869	valid_1's binary_logloss: 0.420594
[6]	valid_0's auc: 0.898013	valid_0's binary_logloss: 0.416849	valid_1's auc: 0.901707	valid_1's binary_logloss: 0.406699
[7]	valid_0's auc: 0.898754	valid_0's binary_logloss: 0.405125	valid_1's auc: 0.90195	valid_1's binary_logloss: 0.395204
[8]	valid_0's auc: 0.899284	valid_0's binary_logloss: 0.395187	valid_1's auc: 0.903018	valid_1's binary_logloss: 0.385059
[9]	valid_0's auc: 0.90024	valid_0's binary_logloss: 0.386298	valid_1's auc: 0.903497	valid_1's binary_logloss: 0.376501
[10]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.378777	valid_1's auc: 0.903423	valid_1's binary_logloss: 0.369439
[11]	valid_0's auc: 0.901409	valid_0's binary_logloss: 0.372036	valid_1's auc: 0.903966	valid_1's binary_logloss: 0.362807
[12]	valid_0's auc: 0.902026	valid_0's binary_logloss: 0.366154	valid_1's auc: 0.904417	valid_1's binary_logloss: 0.357196
[13]	valid_0's auc: 0.903075	valid_0's binary_logloss: 0.360671	valid_1's auc: 0.905081	valid_1's binary_logloss: 0.352152
[14]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.355876	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.347773
[15]	valid_0's auc: 0.904685	valid_0's binary_logloss: 0.351691	valid_1's auc: 0.905867	valid_1's binary_logloss: 0.344181
[16]	valid_0's auc: 0.905378	valid_0's binary_logloss: 0.34781	valid_1's auc: 0.906444	valid_1's binary_logloss: 0.340635
[17]	valid_0's auc: 0.905952	valid_0's binary_logloss: 0.344376	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.337845
[18]	valid_0's auc: 0.906788	valid_0's binary_logloss: 0.341233	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.335275
[19]	valid_0's auc: 0.907429	valid_0's binary_logloss: 0.33838	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.333194
[20]	valid_0's auc: 0.908014	valid_0's binary_logloss: 0.33582	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.330977
[21]	valid_0's auc: 0.908813	valid_0's binary_logloss: 0.333265	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.329429
[22]	valid_0's auc: 0.909387	valid_0's binary_logloss: 0.331028	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.327796
[23]	valid_0's auc: 0.910076	valid_0's binary_logloss: 0.328812	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.326067
[24]	valid_0's auc: 0.910742	valid_0's binary_logloss: 0.326687	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.324823
[25]	valid_0's auc: 0.911337	valid_0's binary_logloss: 0.324799	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.323652
[26]	valid_0's auc: 0.911971	valid_0's binary_logloss: 0.323012	valid_1's auc: 0.908609	valid_1's binary_logloss: 0.322287
[27]	valid_0's auc: 0.912574	valid_0's binary_logloss: 0.321457	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.321443
[28]	valid_0's auc: 0.913166	valid_0's binary_logloss: 0.319892	valid_1's auc: 0.908754	valid_1's binary_logloss: 0.32056
[29]	valid_0's auc: 0.913592	valid_0's binary_logloss: 0.318573	valid_1's auc: 0.908885	valid_1's binary_logloss: 0.319732
[30]	valid_0's auc: 0.914047	valid_0's binary_logloss: 0.317297	valid_1's auc: 0.908941	valid_1's binary_logloss: 0.319094
[31]	valid_0's auc: 0.914607	valid_0's binary_logloss: 0.31596	valid_1's auc: 0.909089	valid_1's binary_logloss: 0.318424
[32]	valid_0's auc: 0.915222	valid_0's binary_logloss: 0.314541	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317919
[33]	valid_0's auc: 0.915771	valid_0's binary_logloss: 0.313256	valid_1's auc: 0.909168	valid_1's binary_logloss: 0.317448
[34]	valid_0's auc: 0.91618	valid_0's binary_logloss: 0.312226	valid_1's auc: 0.909277	valid_1's binary_logloss: 0.316931
[35]	valid_0's auc: 0.916612	valid_0's binary_logloss: 0.311171	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.316615
[36]	valid_0's auc: 0.917002	valid_0's binary_logloss: 0.310229	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.316384
[37]	valid_0's auc: 0.917396	valid_0's binary_logloss: 0.309223	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.31613
[38]	valid_0's auc: 0.917777	valid_0's binary_logloss: 0.308376	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.315751
[39]	valid_0's auc: 0.918182	valid_0's binary_logloss: 0.307513	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.315564
[40]	valid_0's auc: 0.918592	valid_0's binary_logloss: 0.306601	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.315221
[41]	valid_0's auc: 0.919003	valid_0's binary_logloss: 0.305757	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.315049
[42]	valid_0's auc: 0.919316	valid_0's binary_logloss: 0.305064	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.314864
[43]	valid_0's auc: 0.919809	valid_0's binary_logloss: 0.304145	valid_1's auc: 0.909687	valid_1's binary_logloss: 0.314572
[44]	valid_0's auc: 0.920209	valid_0's binary_logloss: 0.303334	valid_1's auc: 0.909828	valid_1's binary_logloss: 0.314251
[45]	valid_0's auc: 0.920515	valid_0's binary_logloss: 0.302671	valid_1's auc: 0.909768	valid_1's binary_logloss: 0.314269
[46]	valid_0's auc: 0.920904	valid_0's binary_logloss: 0.301937	valid_1's auc: 0.909801	valid_1's binary_logloss: 0.31413
[47]	valid_0's auc: 0.921273	valid_0's binary_logloss: 0.301266	valid_1's auc: 0.909649	valid_1's binary_logloss: 0.314263
[48]	valid_0's auc: 0.921625	valid_0's binary_logloss: 0.300526	valid_1's auc: 0.909504	valid_1's binary_logloss: 0.314354
[49]	valid_0's auc: 0.922057	valid_0's binary_logloss: 0.299754	valid_1's auc: 0.909433	valid_1's binary_logloss: 0.314448
[50]	valid_0's auc: 0.922407	valid_0's binary_logloss: 0.299108	valid_1's auc: 0.909556	valid_1's binary_logloss: 0.31423
[51]	valid_0's auc: 0.922728	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.909547	valid_1's binary_logloss: 0.314214
[52]	valid_0's auc: 0.923006	valid_0's binary_logloss: 0.297973	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.314095
[53]	valid_0's auc: 0.923328	valid_0's binary_logloss: 0.297373	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314019
[54]	valid_0's auc: 0.923665	valid_0's binary_logloss: 0.296779	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.314095
[55]	valid_0's auc: 0.923935	valid_0's binary_logloss: 0.296245	valid_1's auc: 0.909488	valid_1's binary_logloss: 0.314071
[56]	valid_0's auc: 0.924281	valid_0's binary_logloss: 0.295635	valid_1's auc: 0.909434	valid_1's binary_logloss: 0.314146
[57]	valid_0's auc: 0.924554	valid_0's binary_logloss: 0.295136	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.314069
[58]	valid_0's auc: 0.924807	valid_0's binary_logloss: 0.294614	valid_1's auc: 0.909411	valid_1's binary_logloss: 0.314154
[59]	valid_0's auc: 0.925136	valid_0's binary_logloss: 0.294055	valid_1's auc: 0.909331	valid_1's binary_logloss: 0.314277
[60]	valid_0's auc: 0.925349	valid_0's binary_logloss: 0.293631	valid_1's auc: 0.909325	valid_1's binary_logloss: 0.314298
[61]	valid_0's auc: 0.925658	valid_0's binary_logloss: 0.29305	valid_1's auc: 0.909287	valid_1's binary_logloss: 0.314322
[62]	valid_0's auc: 0.925915	valid_0's binary_logloss: 0.292583	valid_1's auc: 0.909368	valid_1's binary_logloss: 0.314219
[63]	valid_0's auc: 0.926266	valid_0's binary_logloss: 0.291997	valid_1's auc: 0.909393	valid_1's binary_logloss: 0.314181
[64]	valid_0's auc: 0.926557	valid_0's binary_logloss: 0.291526	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314404
[65]	valid_0's auc: 0.926834	valid_0's binary_logloss: 0.291019	valid_1's auc: 0.909221	valid_1's binary_logloss: 0.314471
[66]	valid_0's auc: 0.927155	valid_0's binary_logloss: 0.290427	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.314647
[67]	valid_0's auc: 0.927493	valid_0's binary_logloss: 0.289865	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.314748
[68]	valid_0's auc: 0.927797	valid_0's binary_logloss: 0.289324	valid_1's auc: 0.908946	valid_1's binary_logloss: 0.314827
[69]	valid_0's auc: 0.928128	valid_0's binary_logloss: 0.288737	valid_1's auc: 0.908849	valid_1's binary_logloss: 0.314997
[70]	valid_0's auc: 0.928421	valid_0's binary_logloss: 0.288215	valid_1's auc: 0.908649	valid_1's binary_logloss: 0.31532
[71]	valid_0's auc: 0.928711	valid_0's binary_logloss: 0.287705	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.315616
[72]	valid_0's auc: 0.928993	valid_0's binary_logloss: 0.287209	valid_1's auc: 0.908269	valid_1's binary_logloss: 0.315912
[73]	valid_0's auc: 0.929313	valid_0's binary_logloss: 0.28669	valid_1's auc: 0.908251	valid_1's binary_logloss: 0.315903
[74]	valid_0's auc: 0.929609	valid_0's binary_logloss: 0.286148	valid_1's auc: 0.908328	valid_1's binary_logloss: 0.315829
[75]	valid_0's auc: 0.929847	valid_0's binary_logloss: 0.285772	valid_1's auc: 0.908365	valid_1's binary_logloss: 0.315811
[76]	valid_0's auc: 0.930103	valid_0's binary_logloss: 0.28531	valid_1's auc: 0.908384	valid_1's binary_logloss: 0.315751
[77]	valid_0's auc: 0.930338	valid_0's binary_logloss: 0.284892	valid_1's auc: 0.908422	valid_1's binary_logloss: 0.315683
[78]	valid_0's auc: 0.93053	valid_0's binary_logloss: 0.284544	valid_1's auc: 0.90827	valid_1's binary_logloss: 0.315915
[79]	valid_0's auc: 0.930709	valid_0's binary_logloss: 0.284201	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.316141
[80]	valid_0's auc: 0.930914	valid_0's binary_logloss: 0.283809	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.316304
[81]	valid_0's auc: 0.9311	valid_0's binary_logloss: 0.283468	valid_1's auc: 0.907851	valid_1's binary_logloss: 0.316619
[82]	valid_0's auc: 0.931387	valid_0's binary_logloss: 0.28298	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.316697
[83]	valid_0's auc: 0.931647	valid_0's binary_logloss: 0.282472	valid_1's auc: 0.907796	valid_1's binary_logloss: 0.316767
[84]	valid_0's auc: 0.931951	valid_0's binary_logloss: 0.281939	valid_1's auc: 0.907726	valid_1's binary_logloss: 0.316869
[85]	valid_0's auc: 0.932204	valid_0's binary_logloss: 0.281522	valid_1's auc: 0.9076	valid_1's binary_logloss: 0.317084
[86]	valid_0's auc: 0.932444	valid_0's binary_logloss: 0.281106	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.317278
[87]	valid_0's auc: 0.932773	valid_0's binary_logloss: 0.280578	valid_1's auc: 0.907482	valid_1's binary_logloss: 0.317311
[88]	valid_0's auc: 0.932944	valid_0's binary_logloss: 0.280262	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.317371
[89]	valid_0's auc: 0.933268	valid_0's binary_logloss: 0.279722	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.317429
[90]	valid_0's auc: 0.933578	valid_0's binary_logloss: 0.279235	valid_1's auc: 0.907348	valid_1's binary_logloss: 0.317581
[91]	valid_0's auc: 0.933811	valid_0's binary_logloss: 0.27882	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.317611
[92]	valid_0's auc: 0.934056	valid_0's binary_logloss: 0.278433	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.31794
[93]	valid_0's auc: 0.93431	valid_0's binary_logloss: 0.277981	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.318055
[94]	valid_0's auc: 0.934536	valid_0's binary_logloss: 0.277576	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.318089
[95]	valid_0's auc: 0.934716	valid_0's binary_logloss: 0.277207	valid_1's auc: 0.906958	valid_1's binary_logloss: 0.318325
[96]	valid_0's auc: 0.934963	valid_0's binary_logloss: 0.276777	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.318619
[97]	valid_0's auc: 0.935154	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906821	valid_1's binary_logloss: 0.318573
[98]	valid_0's auc: 0.935331	valid_0's binary_logloss: 0.276092	valid_1's auc: 0.90682	valid_1's binary_logloss: 0.318596
[99]	valid_0's auc: 0.935551	valid_0's binary_logloss: 0.275718	valid_1's auc: 0.906756	valid_1's binary_logloss: 0.318675
[100]	valid_0's auc: 0.935703	valid_0's binary_logloss: 0.275432	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.318756
[101]	valid_0's auc: 0.935971	valid_0's binary_logloss: 0.274964	valid_1's auc: 0.906709	valid_1's binary_logloss: 0.318763
[102]	valid_0's auc: 0.936122	valid_0's binary_logloss: 0.274672	valid_1's auc: 0.906708	valid_1's binary_logloss: 0.318826
[103]	valid_0's auc: 0.936445	valid_0's binary_logloss: 0.274133	valid_1's auc: 0.906643	valid_1's binary_logloss: 0.318924
[104]	valid_0's auc: 0.936552	valid_0's binary_logloss: 0.273882	valid_1's auc: 0.906559	valid_1's binary_logloss: 0.319105
[105]	valid_0's auc: 0.936802	valid_0's binary_logloss: 0.273445	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.319186
[106]	valid_0's auc: 0.937097	valid_0's binary_logloss: 0.272911	valid_1's auc: 0.906528	valid_1's binary_logloss: 0.319203
[107]	valid_0's auc: 0.937274	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.319307
[108]	valid_0's auc: 0.937507	valid_0's binary_logloss: 0.272183	valid_1's auc: 0.906424	valid_1's binary_logloss: 0.319428
[109]	valid_0's auc: 0.937707	valid_0's binary_logloss: 0.271832	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.31954
[110]	valid_0's auc: 0.937923	valid_0's binary_logloss: 0.271456	valid_1's auc: 0.906391	valid_1's binary_logloss: 0.319552
[111]	valid_0's auc: 0.938102	valid_0's binary_logloss: 0.271149	valid_1's auc: 0.906285	valid_1's binary_logloss: 0.319742
[112]	valid_0's auc: 0.938209	valid_0's binary_logloss: 0.270949	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.319862
[113]	valid_0's auc: 0.93842	valid_0's binary_logloss: 0.270576	valid_1's auc: 0.906244	valid_1's binary_logloss: 0.319867
[114]	valid_0's auc: 0.938569	valid_0's binary_logloss: 0.270294	valid_1's auc: 0.906278	valid_1's binary_logloss: 0.319839
[115]	valid_0's auc: 0.938688	valid_0's binary_logloss: 0.270037	valid_1's auc: 0.906242	valid_1's binary_logloss: 0.319908
[116]	valid_0's auc: 0.938896	valid_0's binary_logloss: 0.269652	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.320203
[117]	valid_0's auc: 0.939094	valid_0's binary_logloss: 0.269305	valid_1's auc: 0.906165	valid_1's binary_logloss: 0.320134
[118]	valid_0's auc: 0.939305	valid_0's binary_logloss: 0.268941	valid_1's auc: 0.906116	valid_1's binary_logloss: 0.320222
[119]	valid_0's auc: 0.939563	valid_0's binary_logloss: 0.268511	valid_1's auc: 0.906066	valid_1's binary_logloss: 0.320335
[120]	valid_0's auc: 0.939736	valid_0's binary_logloss: 0.26819	valid_1's auc: 0.906008	valid_1's binary_logloss: 0.320452
[121]	valid_0's auc: 0.94	valid_0's binary_logloss: 0.26772	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.320571
[122]	valid_0's auc: 0.94016	valid_0's binary_logloss: 0.267434	valid_1's auc: 0.905825	valid_1's binary_logloss: 0.320743
[123]	valid_0's auc: 0.940332	valid_0's binary_logloss: 0.267127	valid_1's auc: 0.905755	valid_1's binary_logloss: 0.320953
[124]	valid_0's auc: 0.940525	valid_0's binary_logloss: 0.266806	valid_1's auc: 0.905679	valid_1's binary_logloss: 0.32108
[125]	valid_0's auc: 0.940715	valid_0's binary_logloss: 0.266472	valid_1's auc: 0.905571	valid_1's binary_logloss: 0.321309
[126]	valid_0's auc: 0.940836	valid_0's binary_logloss: 0.266243	valid_1's auc: 0.905495	valid_1's binary_logloss: 0.321425
[127]	valid_0's auc: 0.941064	valid_0's binary_logloss: 0.265856	valid_1's auc: 0.905434	valid_1's binary_logloss: 0.321532
[128]	valid_0's auc: 0.941224	valid_0's binary_logloss: 0.265551	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.321726
[129]	valid_0's auc: 0.941359	valid_0's binary_logloss: 0.265285	valid_1's auc: 0.905325	valid_1's binary_logloss: 0.321762
[130]	valid_0's auc: 0.941514	valid_0's binary_logloss: 0.264987	valid_1's auc: 0.905316	valid_1's binary_logloss: 0.321854
[131]	valid_0's auc: 0.941738	valid_0's binary_logloss: 0.264522	valid_1's auc: 0.905137	valid_1's binary_logloss: 0.322147
[132]	valid_0's auc: 0.94193	valid_0's binary_logloss: 0.264174	valid_1's auc: 0.905037	valid_1's binary_logloss: 0.322331
[133]	valid_0's auc: 0.942074	valid_0's binary_logloss: 0.263901	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.322416
[134]	valid_0's auc: 0.942227	valid_0's binary_logloss: 0.263602	valid_1's auc: 0.90495	valid_1's binary_logloss: 0.322561
[135]	valid_0's auc: 0.94233	valid_0's binary_logloss: 0.263395	valid_1's auc: 0.904897	valid_1's binary_logloss: 0.322654
[136]	valid_0's auc: 0.942481	valid_0's binary_logloss: 0.263095	valid_1's auc: 0.904914	valid_1's binary_logloss: 0.322678
[137]	valid_0's auc: 0.942574	valid_0's binary_logloss: 0.262914	valid_1's auc: 0.904842	valid_1's binary_logloss: 0.322822
[138]	valid_0's auc: 0.942714	valid_0's binary_logloss: 0.262657	valid_1's auc: 0.904771	valid_1's binary_logloss: 0.322965
[139]	valid_0's auc: 0.942802	valid_0's binary_logloss: 0.262495	valid_1's auc: 0.904759	valid_1's binary_logloss: 0.322993
[140]	valid_0's auc: 0.94294	valid_0's binary_logloss: 0.262228	valid_1's auc: 0.904755	valid_1's binary_logloss: 0.322994
[141]	valid_0's auc: 0.943106	valid_0's binary_logloss: 0.261955	valid_1's auc: 0.904734	valid_1's binary_logloss: 0.323056
[142]	valid_0's auc: 0.943252	valid_0's binary_logloss: 0.261685	valid_1's auc: 0.90472	valid_1's binary_logloss: 0.323073
[143]	valid_0's auc: 0.943421	valid_0's binary_logloss: 0.261357	valid_1's auc: 0.904722	valid_1's binary_logloss: 0.323114
[144]	valid_0's auc: 0.943598	valid_0's binary_logloss: 0.261024	valid_1's auc: 0.904742	valid_1's binary_logloss: 0.323141
Early stopping, best iteration is:
[44]	valid_0's auc: 0.920209	valid_0's binary_logloss: 0.303334	valid_1's auc: 0.909828	valid_1's binary_logloss: 0.314251
[1]	valid_0's auc: 0.887858	valid_0's binary_logloss: 0.516982	valid_1's auc: 0.894799	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89299	valid_0's binary_logloss: 0.488143	valid_1's auc: 0.899409	valid_1's binary_logloss: 0.478442
[3]	valid_0's auc: 0.894141	valid_0's binary_logloss: 0.464911	valid_1's auc: 0.900492	valid_1's binary_logloss: 0.454848
[4]	valid_0's auc: 0.89588	valid_0's binary_logloss: 0.445631	valid_1's auc: 0.9015	valid_1's binary_logloss: 0.435366
[5]	valid_0's auc: 0.896282	valid_0's binary_logloss: 0.429671	valid_1's auc: 0.902121	valid_1's binary_logloss: 0.419464
[6]	valid_0's auc: 0.897771	valid_0's binary_logloss: 0.415866	valid_1's auc: 0.903603	valid_1's binary_logloss: 0.405593
[7]	valid_0's auc: 0.898298	valid_0's binary_logloss: 0.404446	valid_1's auc: 0.903454	valid_1's binary_logloss: 0.394188
[8]	valid_0's auc: 0.899715	valid_0's binary_logloss: 0.394436	valid_1's auc: 0.904238	valid_1's binary_logloss: 0.384318
[9]	valid_0's auc: 0.900608	valid_0's binary_logloss: 0.385658	valid_1's auc: 0.904344	valid_1's binary_logloss: 0.376143
[10]	valid_0's auc: 0.901136	valid_0's binary_logloss: 0.3781	valid_1's auc: 0.904404	valid_1's binary_logloss: 0.369012
[11]	valid_0's auc: 0.901863	valid_0's binary_logloss: 0.371331	valid_1's auc: 0.904849	valid_1's binary_logloss: 0.362564
[12]	valid_0's auc: 0.902708	valid_0's binary_logloss: 0.365396	valid_1's auc: 0.9053	valid_1's binary_logloss: 0.356977
[13]	valid_0's auc: 0.903652	valid_0's binary_logloss: 0.360065	valid_1's auc: 0.905847	valid_1's binary_logloss: 0.351861
[14]	valid_0's auc: 0.904118	valid_0's binary_logloss: 0.355455	valid_1's auc: 0.905985	valid_1's binary_logloss: 0.347625
[15]	valid_0's auc: 0.905174	valid_0's binary_logloss: 0.351053	valid_1's auc: 0.9063	valid_1's binary_logloss: 0.343845
[16]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.347335	valid_1's auc: 0.906851	valid_1's binary_logloss: 0.340347
[17]	valid_0's auc: 0.906471	valid_0's binary_logloss: 0.343917	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.337309
[18]	valid_0's auc: 0.907256	valid_0's binary_logloss: 0.340601	valid_1's auc: 0.907452	valid_1's binary_logloss: 0.334769
[19]	valid_0's auc: 0.908235	valid_0's binary_logloss: 0.337502	valid_1's auc: 0.9078	valid_1's binary_logloss: 0.332421
[20]	valid_0's auc: 0.908872	valid_0's binary_logloss: 0.334805	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.330319
[21]	valid_0's auc: 0.909594	valid_0's binary_logloss: 0.332301	valid_1's auc: 0.908017	valid_1's binary_logloss: 0.328702
[22]	valid_0's auc: 0.910224	valid_0's binary_logloss: 0.329973	valid_1's auc: 0.908008	valid_1's binary_logloss: 0.32727
[23]	valid_0's auc: 0.910747	valid_0's binary_logloss: 0.327887	valid_1's auc: 0.908244	valid_1's binary_logloss: 0.325638
[24]	valid_0's auc: 0.911358	valid_0's binary_logloss: 0.325813	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.32415
[25]	valid_0's auc: 0.911934	valid_0's binary_logloss: 0.323984	valid_1's auc: 0.908846	valid_1's binary_logloss: 0.322893
[26]	valid_0's auc: 0.912521	valid_0's binary_logloss: 0.322275	valid_1's auc: 0.908901	valid_1's binary_logloss: 0.321977
[27]	valid_0's auc: 0.912976	valid_0's binary_logloss: 0.320789	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.320969
[28]	valid_0's auc: 0.913467	valid_0's binary_logloss: 0.319337	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.320209
[29]	valid_0's auc: 0.91389	valid_0's binary_logloss: 0.318008	valid_1's auc: 0.909267	valid_1's binary_logloss: 0.319489
[30]	valid_0's auc: 0.914386	valid_0's binary_logloss: 0.316659	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.318817
[31]	valid_0's auc: 0.91489	valid_0's binary_logloss: 0.31542	valid_1's auc: 0.909339	valid_1's binary_logloss: 0.318459
[32]	valid_0's auc: 0.915437	valid_0's binary_logloss: 0.314124	valid_1's auc: 0.909391	valid_1's binary_logloss: 0.31793
[33]	valid_0's auc: 0.915858	valid_0's binary_logloss: 0.312972	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.317511
[34]	valid_0's auc: 0.91629	valid_0's binary_logloss: 0.311916	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.317059
[35]	valid_0's auc: 0.91669	valid_0's binary_logloss: 0.310951	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.316719
[36]	valid_0's auc: 0.917101	valid_0's binary_logloss: 0.309966	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.316232
[37]	valid_0's auc: 0.917539	valid_0's binary_logloss: 0.308975	valid_1's auc: 0.909739	valid_1's binary_logloss: 0.315892
[38]	valid_0's auc: 0.917896	valid_0's binary_logloss: 0.308095	valid_1's auc: 0.909706	valid_1's binary_logloss: 0.315721
[39]	valid_0's auc: 0.918278	valid_0's binary_logloss: 0.30725	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.315512
[40]	valid_0's auc: 0.918713	valid_0's binary_logloss: 0.306311	valid_1's auc: 0.909672	valid_1's binary_logloss: 0.315361
[41]	valid_0's auc: 0.919118	valid_0's binary_logloss: 0.305472	valid_1's auc: 0.909665	valid_1's binary_logloss: 0.315161
[42]	valid_0's auc: 0.919496	valid_0's binary_logloss: 0.304681	valid_1's auc: 0.909659	valid_1's binary_logloss: 0.315056
[43]	valid_0's auc: 0.919897	valid_0's binary_logloss: 0.303848	valid_1's auc: 0.90978	valid_1's binary_logloss: 0.314764
[44]	valid_0's auc: 0.920208	valid_0's binary_logloss: 0.303142	valid_1's auc: 0.909865	valid_1's binary_logloss: 0.314563
[45]	valid_0's auc: 0.920584	valid_0's binary_logloss: 0.302337	valid_1's auc: 0.909965	valid_1's binary_logloss: 0.314285
[46]	valid_0's auc: 0.920847	valid_0's binary_logloss: 0.301757	valid_1's auc: 0.909803	valid_1's binary_logloss: 0.314436
[47]	valid_0's auc: 0.921232	valid_0's binary_logloss: 0.301022	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314278
[48]	valid_0's auc: 0.921591	valid_0's binary_logloss: 0.300325	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.313965
[49]	valid_0's auc: 0.921906	valid_0's binary_logloss: 0.299717	valid_1's auc: 0.909965	valid_1's binary_logloss: 0.314039
[50]	valid_0's auc: 0.922223	valid_0's binary_logloss: 0.29908	valid_1's auc: 0.910008	valid_1's binary_logloss: 0.313998
[51]	valid_0's auc: 0.922437	valid_0's binary_logloss: 0.298624	valid_1's auc: 0.910057	valid_1's binary_logloss: 0.313852
[52]	valid_0's auc: 0.922748	valid_0's binary_logloss: 0.29801	valid_1's auc: 0.910051	valid_1's binary_logloss: 0.31389
[53]	valid_0's auc: 0.923108	valid_0's binary_logloss: 0.297392	valid_1's auc: 0.910117	valid_1's binary_logloss: 0.313776
[54]	valid_0's auc: 0.923461	valid_0's binary_logloss: 0.29669	valid_1's auc: 0.910151	valid_1's binary_logloss: 0.313701
[55]	valid_0's auc: 0.923771	valid_0's binary_logloss: 0.29611	valid_1's auc: 0.910133	valid_1's binary_logloss: 0.313685
[56]	valid_0's auc: 0.924143	valid_0's binary_logloss: 0.295489	valid_1's auc: 0.910108	valid_1's binary_logloss: 0.313653
[57]	valid_0's auc: 0.924412	valid_0's binary_logloss: 0.294953	valid_1's auc: 0.910025	valid_1's binary_logloss: 0.313777
[58]	valid_0's auc: 0.924675	valid_0's binary_logloss: 0.294422	valid_1's auc: 0.910004	valid_1's binary_logloss: 0.313838
[59]	valid_0's auc: 0.925033	valid_0's binary_logloss: 0.293831	valid_1's auc: 0.909969	valid_1's binary_logloss: 0.313818
[60]	valid_0's auc: 0.92533	valid_0's binary_logloss: 0.29332	valid_1's auc: 0.909916	valid_1's binary_logloss: 0.313849
[61]	valid_0's auc: 0.92563	valid_0's binary_logloss: 0.292811	valid_1's auc: 0.909975	valid_1's binary_logloss: 0.313774
[62]	valid_0's auc: 0.925959	valid_0's binary_logloss: 0.292263	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.313907
[63]	valid_0's auc: 0.92625	valid_0's binary_logloss: 0.291763	valid_1's auc: 0.909735	valid_1's binary_logloss: 0.314072
[64]	valid_0's auc: 0.926615	valid_0's binary_logloss: 0.291124	valid_1's auc: 0.909831	valid_1's binary_logloss: 0.314019
[65]	valid_0's auc: 0.9269	valid_0's binary_logloss: 0.290634	valid_1's auc: 0.909712	valid_1's binary_logloss: 0.31417
[66]	valid_0's auc: 0.927176	valid_0's binary_logloss: 0.290144	valid_1's auc: 0.909653	valid_1's binary_logloss: 0.314297
[67]	valid_0's auc: 0.927475	valid_0's binary_logloss: 0.289601	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314297
[68]	valid_0's auc: 0.927737	valid_0's binary_logloss: 0.289128	valid_1's auc: 0.909567	valid_1's binary_logloss: 0.314381
[69]	valid_0's auc: 0.927992	valid_0's binary_logloss: 0.288703	valid_1's auc: 0.909555	valid_1's binary_logloss: 0.314401
[70]	valid_0's auc: 0.928289	valid_0's binary_logloss: 0.288195	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.314416
[71]	valid_0's auc: 0.928536	valid_0's binary_logloss: 0.287792	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.31446
[72]	valid_0's auc: 0.928762	valid_0's binary_logloss: 0.287342	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.314597
[73]	valid_0's auc: 0.928952	valid_0's binary_logloss: 0.287026	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314723
[74]	valid_0's auc: 0.929177	valid_0's binary_logloss: 0.286609	valid_1's auc: 0.90947	valid_1's binary_logloss: 0.314605
[75]	valid_0's auc: 0.929403	valid_0's binary_logloss: 0.286186	valid_1's auc: 0.909439	valid_1's binary_logloss: 0.314555
[76]	valid_0's auc: 0.92966	valid_0's binary_logloss: 0.285743	valid_1's auc: 0.909286	valid_1's binary_logloss: 0.314761
[77]	valid_0's auc: 0.929892	valid_0's binary_logloss: 0.285335	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.314973
[78]	valid_0's auc: 0.930102	valid_0's binary_logloss: 0.284942	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.314816
[79]	valid_0's auc: 0.930359	valid_0's binary_logloss: 0.28449	valid_1's auc: 0.909314	valid_1's binary_logloss: 0.314745
[80]	valid_0's auc: 0.930605	valid_0's binary_logloss: 0.284043	valid_1's auc: 0.909319	valid_1's binary_logloss: 0.314764
[81]	valid_0's auc: 0.930858	valid_0's binary_logloss: 0.283639	valid_1's auc: 0.909251	valid_1's binary_logloss: 0.314894
[82]	valid_0's auc: 0.93109	valid_0's binary_logloss: 0.283259	valid_1's auc: 0.909192	valid_1's binary_logloss: 0.315016
[83]	valid_0's auc: 0.931288	valid_0's binary_logloss: 0.282907	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.315086
[84]	valid_0's auc: 0.931528	valid_0's binary_logloss: 0.282472	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.315203
[85]	valid_0's auc: 0.931882	valid_0's binary_logloss: 0.281893	valid_1's auc: 0.90901	valid_1's binary_logloss: 0.315411
[86]	valid_0's auc: 0.932096	valid_0's binary_logloss: 0.281512	valid_1's auc: 0.908926	valid_1's binary_logloss: 0.315512
[87]	valid_0's auc: 0.932312	valid_0's binary_logloss: 0.281144	valid_1's auc: 0.90896	valid_1's binary_logloss: 0.315451
[88]	valid_0's auc: 0.932578	valid_0's binary_logloss: 0.280703	valid_1's auc: 0.908807	valid_1's binary_logloss: 0.315679
[89]	valid_0's auc: 0.932796	valid_0's binary_logloss: 0.280304	valid_1's auc: 0.908747	valid_1's binary_logloss: 0.315858
[90]	valid_0's auc: 0.933043	valid_0's binary_logloss: 0.279893	valid_1's auc: 0.908682	valid_1's binary_logloss: 0.315979
[91]	valid_0's auc: 0.933249	valid_0's binary_logloss: 0.279505	valid_1's auc: 0.908706	valid_1's binary_logloss: 0.316005
[92]	valid_0's auc: 0.933471	valid_0's binary_logloss: 0.279112	valid_1's auc: 0.908613	valid_1's binary_logloss: 0.316205
[93]	valid_0's auc: 0.933674	valid_0's binary_logloss: 0.278766	valid_1's auc: 0.908529	valid_1's binary_logloss: 0.316364
[94]	valid_0's auc: 0.93394	valid_0's binary_logloss: 0.278338	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.316338
[95]	valid_0's auc: 0.934207	valid_0's binary_logloss: 0.277905	valid_1's auc: 0.908537	valid_1's binary_logloss: 0.316385
[96]	valid_0's auc: 0.934451	valid_0's binary_logloss: 0.277514	valid_1's auc: 0.908539	valid_1's binary_logloss: 0.316357
[97]	valid_0's auc: 0.934682	valid_0's binary_logloss: 0.277104	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316353
[98]	valid_0's auc: 0.934874	valid_0's binary_logloss: 0.276757	valid_1's auc: 0.908432	valid_1's binary_logloss: 0.316542
[99]	valid_0's auc: 0.935147	valid_0's binary_logloss: 0.276294	valid_1's auc: 0.908382	valid_1's binary_logloss: 0.316668
[100]	valid_0's auc: 0.935354	valid_0's binary_logloss: 0.275957	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.316684
[101]	valid_0's auc: 0.935573	valid_0's binary_logloss: 0.275569	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.316747
[102]	valid_0's auc: 0.935877	valid_0's binary_logloss: 0.275109	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316928
[103]	valid_0's auc: 0.936071	valid_0's binary_logloss: 0.274759	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.317081
[104]	valid_0's auc: 0.936236	valid_0's binary_logloss: 0.27443	valid_1's auc: 0.908112	valid_1's binary_logloss: 0.317146
[105]	valid_0's auc: 0.936516	valid_0's binary_logloss: 0.273983	valid_1's auc: 0.908063	valid_1's binary_logloss: 0.317268
[106]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.273696	valid_1's auc: 0.908046	valid_1's binary_logloss: 0.317344
[107]	valid_0's auc: 0.936861	valid_0's binary_logloss: 0.273377	valid_1's auc: 0.907985	valid_1's binary_logloss: 0.317433
[108]	valid_0's auc: 0.937086	valid_0's binary_logloss: 0.272946	valid_1's auc: 0.907984	valid_1's binary_logloss: 0.317504
[109]	valid_0's auc: 0.937219	valid_0's binary_logloss: 0.272681	valid_1's auc: 0.907932	valid_1's binary_logloss: 0.317572
[110]	valid_0's auc: 0.937446	valid_0's binary_logloss: 0.272298	valid_1's auc: 0.908085	valid_1's binary_logloss: 0.317359
[111]	valid_0's auc: 0.93767	valid_0's binary_logloss: 0.271916	valid_1's auc: 0.908054	valid_1's binary_logloss: 0.317448
[112]	valid_0's auc: 0.93786	valid_0's binary_logloss: 0.271547	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.317463
[113]	valid_0's auc: 0.938059	valid_0's binary_logloss: 0.271195	valid_1's auc: 0.907988	valid_1's binary_logloss: 0.317603
[114]	valid_0's auc: 0.938328	valid_0's binary_logloss: 0.270765	valid_1's auc: 0.908062	valid_1's binary_logloss: 0.317511
[115]	valid_0's auc: 0.938482	valid_0's binary_logloss: 0.27045	valid_1's auc: 0.907971	valid_1's binary_logloss: 0.317708
[116]	valid_0's auc: 0.938641	valid_0's binary_logloss: 0.270165	valid_1's auc: 0.908024	valid_1's binary_logloss: 0.317638
[117]	valid_0's auc: 0.93882	valid_0's binary_logloss: 0.269833	valid_1's auc: 0.907872	valid_1's binary_logloss: 0.317913
[118]	valid_0's auc: 0.939016	valid_0's binary_logloss: 0.269483	valid_1's auc: 0.907823	valid_1's binary_logloss: 0.318012
[119]	valid_0's auc: 0.93915	valid_0's binary_logloss: 0.269227	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.31793
[120]	valid_0's auc: 0.939398	valid_0's binary_logloss: 0.268788	valid_1's auc: 0.907903	valid_1's binary_logloss: 0.317935
[121]	valid_0's auc: 0.939622	valid_0's binary_logloss: 0.268419	valid_1's auc: 0.907859	valid_1's binary_logloss: 0.318049
[122]	valid_0's auc: 0.939807	valid_0's binary_logloss: 0.268083	valid_1's auc: 0.907712	valid_1's binary_logloss: 0.31831
[123]	valid_0's auc: 0.940023	valid_0's binary_logloss: 0.267743	valid_1's auc: 0.907647	valid_1's binary_logloss: 0.318431
[124]	valid_0's auc: 0.940253	valid_0's binary_logloss: 0.267345	valid_1's auc: 0.90768	valid_1's binary_logloss: 0.318389
[125]	valid_0's auc: 0.940481	valid_0's binary_logloss: 0.266924	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.318566
[126]	valid_0's auc: 0.940765	valid_0's binary_logloss: 0.266447	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.318789
[127]	valid_0's auc: 0.940918	valid_0's binary_logloss: 0.266162	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.318996
[128]	valid_0's auc: 0.94106	valid_0's binary_logloss: 0.265904	valid_1's auc: 0.907299	valid_1's binary_logloss: 0.31911
[129]	valid_0's auc: 0.941259	valid_0's binary_logloss: 0.265552	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.319229
[130]	valid_0's auc: 0.941426	valid_0's binary_logloss: 0.265265	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.319355
[131]	valid_0's auc: 0.941635	valid_0's binary_logloss: 0.264882	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.319548
[132]	valid_0's auc: 0.941824	valid_0's binary_logloss: 0.264546	valid_1's auc: 0.907	valid_1's binary_logloss: 0.31971
[133]	valid_0's auc: 0.941995	valid_0's binary_logloss: 0.264228	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.319602
[134]	valid_0's auc: 0.942206	valid_0's binary_logloss: 0.263852	valid_1's auc: 0.907003	valid_1's binary_logloss: 0.319761
[135]	valid_0's auc: 0.942405	valid_0's binary_logloss: 0.263498	valid_1's auc: 0.90687	valid_1's binary_logloss: 0.319971
[136]	valid_0's auc: 0.942579	valid_0's binary_logloss: 0.263178	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.320108
[137]	valid_0's auc: 0.942714	valid_0's binary_logloss: 0.262896	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.320178
[138]	valid_0's auc: 0.942912	valid_0's binary_logloss: 0.262558	valid_1's auc: 0.906727	valid_1's binary_logloss: 0.320392
[139]	valid_0's auc: 0.943087	valid_0's binary_logloss: 0.262212	valid_1's auc: 0.90667	valid_1's binary_logloss: 0.320541
[140]	valid_0's auc: 0.943238	valid_0's binary_logloss: 0.26193	valid_1's auc: 0.906599	valid_1's binary_logloss: 0.320653
[141]	valid_0's auc: 0.943367	valid_0's binary_logloss: 0.261682	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.32071
[142]	valid_0's auc: 0.943503	valid_0's binary_logloss: 0.26142	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.320854
[143]	valid_0's auc: 0.94366	valid_0's binary_logloss: 0.261129	valid_1's auc: 0.906485	valid_1's binary_logloss: 0.320922
[144]	valid_0's auc: 0.943837	valid_0's binary_logloss: 0.260813	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.320924
[145]	valid_0's auc: 0.944012	valid_0's binary_logloss: 0.260511	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.320913
[146]	valid_0's auc: 0.944149	valid_0's binary_logloss: 0.260234	valid_1's auc: 0.90648	valid_1's binary_logloss: 0.321018
[147]	valid_0's auc: 0.944309	valid_0's binary_logloss: 0.259952	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.321111
[148]	valid_0's auc: 0.944464	valid_0's binary_logloss: 0.259657	valid_1's auc: 0.906347	valid_1's binary_logloss: 0.321293
[149]	valid_0's auc: 0.944624	valid_0's binary_logloss: 0.259346	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.321377
[150]	valid_0's auc: 0.944761	valid_0's binary_logloss: 0.259101	valid_1's auc: 0.906255	valid_1's binary_logloss: 0.321474
[151]	valid_0's auc: 0.944956	valid_0's binary_logloss: 0.258766	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.321581
[152]	valid_0's auc: 0.945089	valid_0's binary_logloss: 0.258515	valid_1's auc: 0.906178	valid_1's binary_logloss: 0.321742
[153]	valid_0's auc: 0.945255	valid_0's binary_logloss: 0.258214	valid_1's auc: 0.906133	valid_1's binary_logloss: 0.321878
[154]	valid_0's auc: 0.94543	valid_0's binary_logloss: 0.257867	valid_1's auc: 0.906108	valid_1's binary_logloss: 0.321994
Early stopping, best iteration is:
[54]	valid_0's auc: 0.923461	valid_0's binary_logloss: 0.29669	valid_1's auc: 0.910151	valid_1's binary_logloss: 0.313701
[1]	valid_0's auc: 0.886572	valid_0's binary_logloss: 0.517393	valid_1's auc: 0.891691	valid_1's binary_logloss: 0.508845
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889325	valid_0's binary_logloss: 0.48844	valid_1's auc: 0.895182	valid_1's binary_logloss: 0.47942
[3]	valid_0's auc: 0.890907	valid_0's binary_logloss: 0.465197	valid_1's auc: 0.896562	valid_1's binary_logloss: 0.455809
[4]	valid_0's auc: 0.89514	valid_0's binary_logloss: 0.445768	valid_1's auc: 0.899296	valid_1's binary_logloss: 0.43648
[5]	valid_0's auc: 0.896951	valid_0's binary_logloss: 0.42971	valid_1's auc: 0.899718	valid_1's binary_logloss: 0.420604
[6]	valid_0's auc: 0.897889	valid_0's binary_logloss: 0.416111	valid_1's auc: 0.900881	valid_1's binary_logloss: 0.406931
[7]	valid_0's auc: 0.898689	valid_0's binary_logloss: 0.404436	valid_1's auc: 0.901422	valid_1's binary_logloss: 0.395411
[8]	valid_0's auc: 0.89958	valid_0's binary_logloss: 0.394345	valid_1's auc: 0.902597	valid_1's binary_logloss: 0.385225
[9]	valid_0's auc: 0.90032	valid_0's binary_logloss: 0.385639	valid_1's auc: 0.902948	valid_1's binary_logloss: 0.376863
[10]	valid_0's auc: 0.901296	valid_0's binary_logloss: 0.378042	valid_1's auc: 0.903458	valid_1's binary_logloss: 0.369727
[11]	valid_0's auc: 0.902004	valid_0's binary_logloss: 0.371306	valid_1's auc: 0.903438	valid_1's binary_logloss: 0.363518
[12]	valid_0's auc: 0.902758	valid_0's binary_logloss: 0.365335	valid_1's auc: 0.903948	valid_1's binary_logloss: 0.357923
[13]	valid_0's auc: 0.903856	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.904456	valid_1's binary_logloss: 0.353137
[14]	valid_0's auc: 0.904376	valid_0's binary_logloss: 0.355393	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.348708
[15]	valid_0's auc: 0.905155	valid_0's binary_logloss: 0.351161	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.345105
[16]	valid_0's auc: 0.905871	valid_0's binary_logloss: 0.347288	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.341559
[17]	valid_0's auc: 0.90683	valid_0's binary_logloss: 0.343704	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.338621
[18]	valid_0's auc: 0.90744	valid_0's binary_logloss: 0.340595	valid_1's auc: 0.906705	valid_1's binary_logloss: 0.336005
[19]	valid_0's auc: 0.908245	valid_0's binary_logloss: 0.337639	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.333835
[20]	valid_0's auc: 0.908769	valid_0's binary_logloss: 0.335121	valid_1's auc: 0.906857	valid_1's binary_logloss: 0.332
[21]	valid_0's auc: 0.909625	valid_0's binary_logloss: 0.332551	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.330061
[22]	valid_0's auc: 0.910309	valid_0's binary_logloss: 0.330205	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.328665
[23]	valid_0's auc: 0.910705	valid_0's binary_logloss: 0.32828	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.327131
[24]	valid_0's auc: 0.911353	valid_0's binary_logloss: 0.326248	valid_1's auc: 0.907499	valid_1's binary_logloss: 0.325824
[25]	valid_0's auc: 0.911836	valid_0's binary_logloss: 0.324481	valid_1's auc: 0.907622	valid_1's binary_logloss: 0.324565
[26]	valid_0's auc: 0.912375	valid_0's binary_logloss: 0.322757	valid_1's auc: 0.90783	valid_1's binary_logloss: 0.323442
[27]	valid_0's auc: 0.912924	valid_0's binary_logloss: 0.321099	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.322676
[28]	valid_0's auc: 0.91347	valid_0's binary_logloss: 0.319577	valid_1's auc: 0.907899	valid_1's binary_logloss: 0.321985
[29]	valid_0's auc: 0.913958	valid_0's binary_logloss: 0.31821	valid_1's auc: 0.908024	valid_1's binary_logloss: 0.321209
[30]	valid_0's auc: 0.91443	valid_0's binary_logloss: 0.316943	valid_1's auc: 0.908232	valid_1's binary_logloss: 0.320596
[31]	valid_0's auc: 0.914903	valid_0's binary_logloss: 0.315637	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.319943
[32]	valid_0's auc: 0.915384	valid_0's binary_logloss: 0.314384	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.3192
[33]	valid_0's auc: 0.915879	valid_0's binary_logloss: 0.313183	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.3187
[34]	valid_0's auc: 0.916305	valid_0's binary_logloss: 0.312159	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.318644
[35]	valid_0's auc: 0.916796	valid_0's binary_logloss: 0.311066	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.318277
[36]	valid_0's auc: 0.917228	valid_0's binary_logloss: 0.310009	valid_1's auc: 0.908673	valid_1's binary_logloss: 0.317932
[37]	valid_0's auc: 0.917693	valid_0's binary_logloss: 0.309012	valid_1's auc: 0.908599	valid_1's binary_logloss: 0.317805
[38]	valid_0's auc: 0.918077	valid_0's binary_logloss: 0.3081	valid_1's auc: 0.908552	valid_1's binary_logloss: 0.317626
[39]	valid_0's auc: 0.918494	valid_0's binary_logloss: 0.307161	valid_1's auc: 0.908505	valid_1's binary_logloss: 0.317462
[40]	valid_0's auc: 0.918873	valid_0's binary_logloss: 0.306342	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.317409
[41]	valid_0's auc: 0.919317	valid_0's binary_logloss: 0.305478	valid_1's auc: 0.908498	valid_1's binary_logloss: 0.317195
[42]	valid_0's auc: 0.91965	valid_0's binary_logloss: 0.30475	valid_1's auc: 0.908487	valid_1's binary_logloss: 0.317133
[43]	valid_0's auc: 0.920116	valid_0's binary_logloss: 0.303866	valid_1's auc: 0.908577	valid_1's binary_logloss: 0.316906
[44]	valid_0's auc: 0.920516	valid_0's binary_logloss: 0.303054	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.316662
[45]	valid_0's auc: 0.920884	valid_0's binary_logloss: 0.302318	valid_1's auc: 0.90864	valid_1's binary_logloss: 0.316669
[46]	valid_0's auc: 0.921198	valid_0's binary_logloss: 0.301623	valid_1's auc: 0.90866	valid_1's binary_logloss: 0.316548
[47]	valid_0's auc: 0.921574	valid_0's binary_logloss: 0.300925	valid_1's auc: 0.908568	valid_1's binary_logloss: 0.316636
[48]	valid_0's auc: 0.92195	valid_0's binary_logloss: 0.300223	valid_1's auc: 0.908527	valid_1's binary_logloss: 0.31662
[49]	valid_0's auc: 0.922292	valid_0's binary_logloss: 0.299574	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.316606
[50]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.298975	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.316756
[51]	valid_0's auc: 0.922904	valid_0's binary_logloss: 0.298393	valid_1's auc: 0.908268	valid_1's binary_logloss: 0.316796
[52]	valid_0's auc: 0.923173	valid_0's binary_logloss: 0.297868	valid_1's auc: 0.908223	valid_1's binary_logloss: 0.316831
[53]	valid_0's auc: 0.923494	valid_0's binary_logloss: 0.297269	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.316578
[54]	valid_0's auc: 0.923776	valid_0's binary_logloss: 0.296719	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.316604
[55]	valid_0's auc: 0.924074	valid_0's binary_logloss: 0.296172	valid_1's auc: 0.908279	valid_1's binary_logloss: 0.316695
[56]	valid_0's auc: 0.924404	valid_0's binary_logloss: 0.295522	valid_1's auc: 0.908107	valid_1's binary_logloss: 0.316946
[57]	valid_0's auc: 0.924636	valid_0's binary_logloss: 0.295046	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.317125
[58]	valid_0's auc: 0.924956	valid_0's binary_logloss: 0.29449	valid_1's auc: 0.907876	valid_1's binary_logloss: 0.317248
[59]	valid_0's auc: 0.925277	valid_0's binary_logloss: 0.293933	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317275
[60]	valid_0's auc: 0.925582	valid_0's binary_logloss: 0.293352	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.317224
[61]	valid_0's auc: 0.925932	valid_0's binary_logloss: 0.292664	valid_1's auc: 0.907804	valid_1's binary_logloss: 0.317283
[62]	valid_0's auc: 0.926218	valid_0's binary_logloss: 0.292181	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.317483
[63]	valid_0's auc: 0.926535	valid_0's binary_logloss: 0.291632	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317408
[64]	valid_0's auc: 0.926836	valid_0's binary_logloss: 0.291102	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.317652
[65]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.290613	valid_1's auc: 0.907418	valid_1's binary_logloss: 0.317955
[66]	valid_0's auc: 0.927366	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.907262	valid_1's binary_logloss: 0.318164
[67]	valid_0's auc: 0.927637	valid_0's binary_logloss: 0.289646	valid_1's auc: 0.907153	valid_1's binary_logloss: 0.318378
[68]	valid_0's auc: 0.927977	valid_0's binary_logloss: 0.289063	valid_1's auc: 0.907238	valid_1's binary_logloss: 0.318297
[69]	valid_0's auc: 0.928214	valid_0's binary_logloss: 0.288657	valid_1's auc: 0.907058	valid_1's binary_logloss: 0.318544
[70]	valid_0's auc: 0.928511	valid_0's binary_logloss: 0.288107	valid_1's auc: 0.907062	valid_1's binary_logloss: 0.318522
[71]	valid_0's auc: 0.928789	valid_0's binary_logloss: 0.287604	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318488
[72]	valid_0's auc: 0.929052	valid_0's binary_logloss: 0.28715	valid_1's auc: 0.907062	valid_1's binary_logloss: 0.31854
[73]	valid_0's auc: 0.929319	valid_0's binary_logloss: 0.286661	valid_1's auc: 0.906949	valid_1's binary_logloss: 0.318797
[74]	valid_0's auc: 0.929563	valid_0's binary_logloss: 0.286196	valid_1's auc: 0.906901	valid_1's binary_logloss: 0.318853
[75]	valid_0's auc: 0.929889	valid_0's binary_logloss: 0.285631	valid_1's auc: 0.906947	valid_1's binary_logloss: 0.318743
[76]	valid_0's auc: 0.930216	valid_0's binary_logloss: 0.285076	valid_1's auc: 0.906948	valid_1's binary_logloss: 0.318746
[77]	valid_0's auc: 0.930476	valid_0's binary_logloss: 0.284605	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.31894
[78]	valid_0's auc: 0.930737	valid_0's binary_logloss: 0.284159	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.319251
[79]	valid_0's auc: 0.931012	valid_0's binary_logloss: 0.283689	valid_1's auc: 0.906611	valid_1's binary_logloss: 0.319318
[80]	valid_0's auc: 0.931224	valid_0's binary_logloss: 0.283324	valid_1's auc: 0.906605	valid_1's binary_logloss: 0.319411
[81]	valid_0's auc: 0.931426	valid_0's binary_logloss: 0.282919	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.319531
[82]	valid_0's auc: 0.93168	valid_0's binary_logloss: 0.282495	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.31954
[83]	valid_0's auc: 0.931906	valid_0's binary_logloss: 0.282067	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319515
[84]	valid_0's auc: 0.932209	valid_0's binary_logloss: 0.281589	valid_1's auc: 0.906471	valid_1's binary_logloss: 0.319707
[85]	valid_0's auc: 0.932458	valid_0's binary_logloss: 0.281136	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.319683
[86]	valid_0's auc: 0.93267	valid_0's binary_logloss: 0.280763	valid_1's auc: 0.906514	valid_1's binary_logloss: 0.319621
[87]	valid_0's auc: 0.932985	valid_0's binary_logloss: 0.280229	valid_1's auc: 0.906398	valid_1's binary_logloss: 0.319778
[88]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.279814	valid_1's auc: 0.906386	valid_1's binary_logloss: 0.319862
[89]	valid_0's auc: 0.933444	valid_0's binary_logloss: 0.279428	valid_1's auc: 0.906342	valid_1's binary_logloss: 0.319928
[90]	valid_0's auc: 0.933666	valid_0's binary_logloss: 0.279032	valid_1's auc: 0.906244	valid_1's binary_logloss: 0.320102
[91]	valid_0's auc: 0.933882	valid_0's binary_logloss: 0.278644	valid_1's auc: 0.906239	valid_1's binary_logloss: 0.320146
[92]	valid_0's auc: 0.934078	valid_0's binary_logloss: 0.278276	valid_1's auc: 0.906142	valid_1's binary_logloss: 0.320347
[93]	valid_0's auc: 0.934326	valid_0's binary_logloss: 0.277813	valid_1's auc: 0.906138	valid_1's binary_logloss: 0.320289
[94]	valid_0's auc: 0.934562	valid_0's binary_logloss: 0.277381	valid_1's auc: 0.906055	valid_1's binary_logloss: 0.32045
[95]	valid_0's auc: 0.93478	valid_0's binary_logloss: 0.277	valid_1's auc: 0.905984	valid_1's binary_logloss: 0.320563
[96]	valid_0's auc: 0.935037	valid_0's binary_logloss: 0.276554	valid_1's auc: 0.905974	valid_1's binary_logloss: 0.320604
[97]	valid_0's auc: 0.93525	valid_0's binary_logloss: 0.276191	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320774
[98]	valid_0's auc: 0.93544	valid_0's binary_logloss: 0.275846	valid_1's auc: 0.905856	valid_1's binary_logloss: 0.320788
[99]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275423	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320846
[100]	valid_0's auc: 0.93587	valid_0's binary_logloss: 0.275066	valid_1's auc: 0.905818	valid_1's binary_logloss: 0.320927
[101]	valid_0's auc: 0.936045	valid_0's binary_logloss: 0.274777	valid_1's auc: 0.905741	valid_1's binary_logloss: 0.321073
[102]	valid_0's auc: 0.936217	valid_0's binary_logloss: 0.274461	valid_1's auc: 0.905696	valid_1's binary_logloss: 0.321136
[103]	valid_0's auc: 0.936379	valid_0's binary_logloss: 0.274141	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.321133
[104]	valid_0's auc: 0.936625	valid_0's binary_logloss: 0.273748	valid_1's auc: 0.905711	valid_1's binary_logloss: 0.321145
[105]	valid_0's auc: 0.936834	valid_0's binary_logloss: 0.273334	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.321218
[106]	valid_0's auc: 0.936996	valid_0's binary_logloss: 0.273053	valid_1's auc: 0.905661	valid_1's binary_logloss: 0.321309
[107]	valid_0's auc: 0.937146	valid_0's binary_logloss: 0.272786	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.32144
[108]	valid_0's auc: 0.937399	valid_0's binary_logloss: 0.272323	valid_1's auc: 0.905645	valid_1's binary_logloss: 0.321355
[109]	valid_0's auc: 0.937668	valid_0's binary_logloss: 0.271874	valid_1's auc: 0.905537	valid_1's binary_logloss: 0.321551
[110]	valid_0's auc: 0.937873	valid_0's binary_logloss: 0.271538	valid_1's auc: 0.905392	valid_1's binary_logloss: 0.321796
[111]	valid_0's auc: 0.938162	valid_0's binary_logloss: 0.271044	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.321749
[112]	valid_0's auc: 0.938408	valid_0's binary_logloss: 0.270629	valid_1's auc: 0.905507	valid_1's binary_logloss: 0.321649
[113]	valid_0's auc: 0.93858	valid_0's binary_logloss: 0.27034	valid_1's auc: 0.905508	valid_1's binary_logloss: 0.321659
[114]	valid_0's auc: 0.938733	valid_0's binary_logloss: 0.270037	valid_1's auc: 0.905462	valid_1's binary_logloss: 0.321751
[115]	valid_0's auc: 0.938926	valid_0's binary_logloss: 0.26969	valid_1's auc: 0.905421	valid_1's binary_logloss: 0.321861
[116]	valid_0's auc: 0.939101	valid_0's binary_logloss: 0.269373	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.321903
[117]	valid_0's auc: 0.939349	valid_0's binary_logloss: 0.268959	valid_1's auc: 0.905167	valid_1's binary_logloss: 0.322256
[118]	valid_0's auc: 0.939564	valid_0's binary_logloss: 0.268578	valid_1's auc: 0.905152	valid_1's binary_logloss: 0.322298
[119]	valid_0's auc: 0.939749	valid_0's binary_logloss: 0.268242	valid_1's auc: 0.90517	valid_1's binary_logloss: 0.32232
[120]	valid_0's auc: 0.939982	valid_0's binary_logloss: 0.267842	valid_1's auc: 0.90523	valid_1's binary_logloss: 0.322213
[121]	valid_0's auc: 0.940148	valid_0's binary_logloss: 0.267552	valid_1's auc: 0.905209	valid_1's binary_logloss: 0.322289
[122]	valid_0's auc: 0.940343	valid_0's binary_logloss: 0.267223	valid_1's auc: 0.905217	valid_1's binary_logloss: 0.322327
[123]	valid_0's auc: 0.940529	valid_0's binary_logloss: 0.266871	valid_1's auc: 0.905176	valid_1's binary_logloss: 0.322456
[124]	valid_0's auc: 0.940696	valid_0's binary_logloss: 0.266544	valid_1's auc: 0.905121	valid_1's binary_logloss: 0.322519
[125]	valid_0's auc: 0.94087	valid_0's binary_logloss: 0.2662	valid_1's auc: 0.905049	valid_1's binary_logloss: 0.322668
[126]	valid_0's auc: 0.941112	valid_0's binary_logloss: 0.265797	valid_1's auc: 0.905067	valid_1's binary_logloss: 0.322684
[127]	valid_0's auc: 0.94129	valid_0's binary_logloss: 0.265464	valid_1's auc: 0.905059	valid_1's binary_logloss: 0.322706
[128]	valid_0's auc: 0.941503	valid_0's binary_logloss: 0.265081	valid_1's auc: 0.90501	valid_1's binary_logloss: 0.322848
[129]	valid_0's auc: 0.941689	valid_0's binary_logloss: 0.264742	valid_1's auc: 0.904905	valid_1's binary_logloss: 0.323085
[130]	valid_0's auc: 0.941937	valid_0's binary_logloss: 0.264306	valid_1's auc: 0.90485	valid_1's binary_logloss: 0.323194
[131]	valid_0's auc: 0.942166	valid_0's binary_logloss: 0.263906	valid_1's auc: 0.904765	valid_1's binary_logloss: 0.323363
[132]	valid_0's auc: 0.942275	valid_0's binary_logloss: 0.263689	valid_1's auc: 0.904797	valid_1's binary_logloss: 0.323366
[133]	valid_0's auc: 0.94244	valid_0's binary_logloss: 0.263377	valid_1's auc: 0.904695	valid_1's binary_logloss: 0.323558
Early stopping, best iteration is:
[33]	valid_0's auc: 0.915879	valid_0's binary_logloss: 0.313183	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.3187
[1]	valid_0's auc: 0.887983	valid_0's binary_logloss: 0.517034	valid_1's auc: 0.891755	valid_1's binary_logloss: 0.508452
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89066	valid_0's binary_logloss: 0.488464	valid_1's auc: 0.89629	valid_1's binary_logloss: 0.478946
[3]	valid_0's auc: 0.891984	valid_0's binary_logloss: 0.465365	valid_1's auc: 0.897538	valid_1's binary_logloss: 0.455741
[4]	valid_0's auc: 0.896159	valid_0's binary_logloss: 0.446069	valid_1's auc: 0.901608	valid_1's binary_logloss: 0.43617
[5]	valid_0's auc: 0.896836	valid_0's binary_logloss: 0.43022	valid_1's auc: 0.902385	valid_1's binary_logloss: 0.420003
[6]	valid_0's auc: 0.897532	valid_0's binary_logloss: 0.416675	valid_1's auc: 0.902107	valid_1's binary_logloss: 0.406595
[7]	valid_0's auc: 0.898859	valid_0's binary_logloss: 0.404875	valid_1's auc: 0.902903	valid_1's binary_logloss: 0.394907
[8]	valid_0's auc: 0.899531	valid_0's binary_logloss: 0.394951	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.384787
[9]	valid_0's auc: 0.899803	valid_0's binary_logloss: 0.386385	valid_1's auc: 0.904479	valid_1's binary_logloss: 0.376169
[10]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.378764	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.369074
[11]	valid_0's auc: 0.901544	valid_0's binary_logloss: 0.372015	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.36246
[12]	valid_0's auc: 0.902572	valid_0's binary_logloss: 0.366163	valid_1's auc: 0.905663	valid_1's binary_logloss: 0.356912
[13]	valid_0's auc: 0.903409	valid_0's binary_logloss: 0.360834	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.352169
[14]	valid_0's auc: 0.904166	valid_0's binary_logloss: 0.356033	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.347704
[15]	valid_0's auc: 0.904991	valid_0's binary_logloss: 0.351586	valid_1's auc: 0.906652	valid_1's binary_logloss: 0.344065
[16]	valid_0's auc: 0.905708	valid_0's binary_logloss: 0.347763	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.340566
[17]	valid_0's auc: 0.906237	valid_0's binary_logloss: 0.344327	valid_1's auc: 0.907197	valid_1's binary_logloss: 0.33777
[18]	valid_0's auc: 0.907243	valid_0's binary_logloss: 0.34106	valid_1's auc: 0.907388	valid_1's binary_logloss: 0.335204
[19]	valid_0's auc: 0.907652	valid_0's binary_logloss: 0.338397	valid_1's auc: 0.90763	valid_1's binary_logloss: 0.332937
[20]	valid_0's auc: 0.908388	valid_0's binary_logloss: 0.335673	valid_1's auc: 0.908	valid_1's binary_logloss: 0.330835
[21]	valid_0's auc: 0.908972	valid_0's binary_logloss: 0.333258	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.32899
[22]	valid_0's auc: 0.909675	valid_0's binary_logloss: 0.330959	valid_1's auc: 0.908303	valid_1's binary_logloss: 0.327561
[23]	valid_0's auc: 0.91047	valid_0's binary_logloss: 0.328639	valid_1's auc: 0.908497	valid_1's binary_logloss: 0.325982
[24]	valid_0's auc: 0.911006	valid_0's binary_logloss: 0.326684	valid_1's auc: 0.908562	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.911567	valid_0's binary_logloss: 0.324816	valid_1's auc: 0.908557	valid_1's binary_logloss: 0.323689
[26]	valid_0's auc: 0.912039	valid_0's binary_logloss: 0.323142	valid_1's auc: 0.908656	valid_1's binary_logloss: 0.322619
[27]	valid_0's auc: 0.912588	valid_0's binary_logloss: 0.321545	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.321518
[28]	valid_0's auc: 0.912989	valid_0's binary_logloss: 0.320191	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.320803
[29]	valid_0's auc: 0.913483	valid_0's binary_logloss: 0.318816	valid_1's auc: 0.909126	valid_1's binary_logloss: 0.319937
[30]	valid_0's auc: 0.913875	valid_0's binary_logloss: 0.317593	valid_1's auc: 0.909143	valid_1's binary_logloss: 0.319384
[31]	valid_0's auc: 0.914309	valid_0's binary_logloss: 0.316371	valid_1's auc: 0.909192	valid_1's binary_logloss: 0.318816
[32]	valid_0's auc: 0.914842	valid_0's binary_logloss: 0.315097	valid_1's auc: 0.909295	valid_1's binary_logloss: 0.318232
[33]	valid_0's auc: 0.915354	valid_0's binary_logloss: 0.31381	valid_1's auc: 0.909416	valid_1's binary_logloss: 0.317664
[34]	valid_0's auc: 0.915971	valid_0's binary_logloss: 0.312557	valid_1's auc: 0.909481	valid_1's binary_logloss: 0.317304
[35]	valid_0's auc: 0.916312	valid_0's binary_logloss: 0.311576	valid_1's auc: 0.909609	valid_1's binary_logloss: 0.316742
[36]	valid_0's auc: 0.916762	valid_0's binary_logloss: 0.310578	valid_1's auc: 0.909798	valid_1's binary_logloss: 0.316233
[37]	valid_0's auc: 0.917132	valid_0's binary_logloss: 0.30965	valid_1's auc: 0.909847	valid_1's binary_logloss: 0.315945
[38]	valid_0's auc: 0.917467	valid_0's binary_logloss: 0.308806	valid_1's auc: 0.909858	valid_1's binary_logloss: 0.315676
[39]	valid_0's auc: 0.917923	valid_0's binary_logloss: 0.307864	valid_1's auc: 0.909957	valid_1's binary_logloss: 0.315347
[40]	valid_0's auc: 0.918344	valid_0's binary_logloss: 0.306975	valid_1's auc: 0.909944	valid_1's binary_logloss: 0.315184
[41]	valid_0's auc: 0.918811	valid_0's binary_logloss: 0.306025	valid_1's auc: 0.909935	valid_1's binary_logloss: 0.315006
[42]	valid_0's auc: 0.919185	valid_0's binary_logloss: 0.305217	valid_1's auc: 0.909923	valid_1's binary_logloss: 0.314895
[43]	valid_0's auc: 0.919624	valid_0's binary_logloss: 0.304381	valid_1's auc: 0.909934	valid_1's binary_logloss: 0.314779
[44]	valid_0's auc: 0.919982	valid_0's binary_logloss: 0.303605	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.314464
[45]	valid_0's auc: 0.920274	valid_0's binary_logloss: 0.302982	valid_1's auc: 0.910127	valid_1's binary_logloss: 0.314187
[46]	valid_0's auc: 0.920539	valid_0's binary_logloss: 0.302396	valid_1's auc: 0.910104	valid_1's binary_logloss: 0.314129
[47]	valid_0's auc: 0.920885	valid_0's binary_logloss: 0.301721	valid_1's auc: 0.910042	valid_1's binary_logloss: 0.314131
[48]	valid_0's auc: 0.921288	valid_0's binary_logloss: 0.300919	valid_1's auc: 0.910064	valid_1's binary_logloss: 0.314023
[49]	valid_0's auc: 0.921685	valid_0's binary_logloss: 0.300189	valid_1's auc: 0.910161	valid_1's binary_logloss: 0.313855
[50]	valid_0's auc: 0.921977	valid_0's binary_logloss: 0.299593	valid_1's auc: 0.910188	valid_1's binary_logloss: 0.3138
[51]	valid_0's auc: 0.922289	valid_0's binary_logloss: 0.299026	valid_1's auc: 0.910113	valid_1's binary_logloss: 0.313817
[52]	valid_0's auc: 0.922541	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.91019	valid_1's binary_logloss: 0.313611
[53]	valid_0's auc: 0.922822	valid_0's binary_logloss: 0.297975	valid_1's auc: 0.910053	valid_1's binary_logloss: 0.313776
[54]	valid_0's auc: 0.923024	valid_0's binary_logloss: 0.297547	valid_1's auc: 0.910078	valid_1's binary_logloss: 0.3137
[55]	valid_0's auc: 0.923286	valid_0's binary_logloss: 0.297035	valid_1's auc: 0.910107	valid_1's binary_logloss: 0.313666
[56]	valid_0's auc: 0.923599	valid_0's binary_logloss: 0.29643	valid_1's auc: 0.910045	valid_1's binary_logloss: 0.313696
[57]	valid_0's auc: 0.923915	valid_0's binary_logloss: 0.295903	valid_1's auc: 0.909854	valid_1's binary_logloss: 0.313887
[58]	valid_0's auc: 0.924221	valid_0's binary_logloss: 0.295347	valid_1's auc: 0.909783	valid_1's binary_logloss: 0.313941
[59]	valid_0's auc: 0.92458	valid_0's binary_logloss: 0.294734	valid_1's auc: 0.909757	valid_1's binary_logloss: 0.313976
[60]	valid_0's auc: 0.924868	valid_0's binary_logloss: 0.294194	valid_1's auc: 0.90969	valid_1's binary_logloss: 0.314054
[61]	valid_0's auc: 0.925202	valid_0's binary_logloss: 0.293691	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.314267
[62]	valid_0's auc: 0.925513	valid_0's binary_logloss: 0.293134	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.314356
[63]	valid_0's auc: 0.925752	valid_0's binary_logloss: 0.292702	valid_1's auc: 0.909354	valid_1's binary_logloss: 0.314538
[64]	valid_0's auc: 0.925984	valid_0's binary_logloss: 0.292237	valid_1's auc: 0.909211	valid_1's binary_logloss: 0.314724
[65]	valid_0's auc: 0.926274	valid_0's binary_logloss: 0.291762	valid_1's auc: 0.909081	valid_1's binary_logloss: 0.314921
[66]	valid_0's auc: 0.926506	valid_0's binary_logloss: 0.291293	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.315021
[67]	valid_0's auc: 0.926802	valid_0's binary_logloss: 0.290795	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.315257
[68]	valid_0's auc: 0.926995	valid_0's binary_logloss: 0.290429	valid_1's auc: 0.908743	valid_1's binary_logloss: 0.315451
[69]	valid_0's auc: 0.927255	valid_0's binary_logloss: 0.289987	valid_1's auc: 0.908613	valid_1's binary_logloss: 0.315651
[70]	valid_0's auc: 0.927499	valid_0's binary_logloss: 0.289546	valid_1's auc: 0.908549	valid_1's binary_logloss: 0.315769
[71]	valid_0's auc: 0.927742	valid_0's binary_logloss: 0.289136	valid_1's auc: 0.908488	valid_1's binary_logloss: 0.315846
[72]	valid_0's auc: 0.92803	valid_0's binary_logloss: 0.288629	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.315783
[73]	valid_0's auc: 0.928358	valid_0's binary_logloss: 0.288108	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.315935
[74]	valid_0's auc: 0.928672	valid_0's binary_logloss: 0.287608	valid_1's auc: 0.908371	valid_1's binary_logloss: 0.316049
[75]	valid_0's auc: 0.928888	valid_0's binary_logloss: 0.287201	valid_1's auc: 0.908467	valid_1's binary_logloss: 0.315869
[76]	valid_0's auc: 0.92927	valid_0's binary_logloss: 0.286577	valid_1's auc: 0.908463	valid_1's binary_logloss: 0.31588
[77]	valid_0's auc: 0.929557	valid_0's binary_logloss: 0.286144	valid_1's auc: 0.908364	valid_1's binary_logloss: 0.316003
[78]	valid_0's auc: 0.92985	valid_0's binary_logloss: 0.285663	valid_1's auc: 0.90833	valid_1's binary_logloss: 0.316036
[79]	valid_0's auc: 0.930083	valid_0's binary_logloss: 0.28523	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.316102
[80]	valid_0's auc: 0.930311	valid_0's binary_logloss: 0.284827	valid_1's auc: 0.908249	valid_1's binary_logloss: 0.316182
[81]	valid_0's auc: 0.930551	valid_0's binary_logloss: 0.284413	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316263
[82]	valid_0's auc: 0.930733	valid_0's binary_logloss: 0.284047	valid_1's auc: 0.908157	valid_1's binary_logloss: 0.316455
[83]	valid_0's auc: 0.930994	valid_0's binary_logloss: 0.283621	valid_1's auc: 0.9081	valid_1's binary_logloss: 0.316557
[84]	valid_0's auc: 0.931205	valid_0's binary_logloss: 0.283243	valid_1's auc: 0.908033	valid_1's binary_logloss: 0.316672
[85]	valid_0's auc: 0.931499	valid_0's binary_logloss: 0.282728	valid_1's auc: 0.908036	valid_1's binary_logloss: 0.316673
[86]	valid_0's auc: 0.931699	valid_0's binary_logloss: 0.282348	valid_1's auc: 0.90799	valid_1's binary_logloss: 0.31681
[87]	valid_0's auc: 0.931942	valid_0's binary_logloss: 0.281864	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.316738
[88]	valid_0's auc: 0.932166	valid_0's binary_logloss: 0.281443	valid_1's auc: 0.907989	valid_1's binary_logloss: 0.316828
[89]	valid_0's auc: 0.932366	valid_0's binary_logloss: 0.281085	valid_1's auc: 0.907987	valid_1's binary_logloss: 0.316836
[90]	valid_0's auc: 0.932656	valid_0's binary_logloss: 0.280619	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.316847
[91]	valid_0's auc: 0.932905	valid_0's binary_logloss: 0.280234	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.316907
[92]	valid_0's auc: 0.933099	valid_0's binary_logloss: 0.279898	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.31692
[93]	valid_0's auc: 0.933327	valid_0's binary_logloss: 0.279525	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317075
[94]	valid_0's auc: 0.933561	valid_0's binary_logloss: 0.279106	valid_1's auc: 0.907781	valid_1's binary_logloss: 0.317198
[95]	valid_0's auc: 0.933759	valid_0's binary_logloss: 0.278767	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317202
[96]	valid_0's auc: 0.934019	valid_0's binary_logloss: 0.278342	valid_1's auc: 0.907815	valid_1's binary_logloss: 0.31719
[97]	valid_0's auc: 0.934224	valid_0's binary_logloss: 0.277961	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317212
[98]	valid_0's auc: 0.934446	valid_0's binary_logloss: 0.277559	valid_1's auc: 0.907809	valid_1's binary_logloss: 0.317279
[99]	valid_0's auc: 0.934644	valid_0's binary_logloss: 0.277217	valid_1's auc: 0.907725	valid_1's binary_logloss: 0.317418
[100]	valid_0's auc: 0.934871	valid_0's binary_logloss: 0.276836	valid_1's auc: 0.907634	valid_1's binary_logloss: 0.317629
[101]	valid_0's auc: 0.935086	valid_0's binary_logloss: 0.276476	valid_1's auc: 0.907515	valid_1's binary_logloss: 0.317831
[102]	valid_0's auc: 0.935279	valid_0's binary_logloss: 0.276141	valid_1's auc: 0.907404	valid_1's binary_logloss: 0.318027
[103]	valid_0's auc: 0.935472	valid_0's binary_logloss: 0.275783	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.318221
[104]	valid_0's auc: 0.93563	valid_0's binary_logloss: 0.275489	valid_1's auc: 0.907203	valid_1's binary_logloss: 0.318405
[105]	valid_0's auc: 0.935793	valid_0's binary_logloss: 0.275148	valid_1's auc: 0.907146	valid_1's binary_logloss: 0.318543
[106]	valid_0's auc: 0.936004	valid_0's binary_logloss: 0.274803	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318485
[107]	valid_0's auc: 0.936191	valid_0's binary_logloss: 0.274476	valid_1's auc: 0.90712	valid_1's binary_logloss: 0.318635
[108]	valid_0's auc: 0.936391	valid_0's binary_logloss: 0.27413	valid_1's auc: 0.90709	valid_1's binary_logloss: 0.318761
[109]	valid_0's auc: 0.936653	valid_0's binary_logloss: 0.27368	valid_1's auc: 0.906937	valid_1's binary_logloss: 0.31906
[110]	valid_0's auc: 0.936928	valid_0's binary_logloss: 0.273228	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.319065
[111]	valid_0's auc: 0.937121	valid_0's binary_logloss: 0.272903	valid_1's auc: 0.906868	valid_1's binary_logloss: 0.319174
[112]	valid_0's auc: 0.937365	valid_0's binary_logloss: 0.272505	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.319228
[113]	valid_0's auc: 0.937533	valid_0's binary_logloss: 0.272191	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.31931
[114]	valid_0's auc: 0.937767	valid_0's binary_logloss: 0.271783	valid_1's auc: 0.906681	valid_1's binary_logloss: 0.319502
[115]	valid_0's auc: 0.93798	valid_0's binary_logloss: 0.271401	valid_1's auc: 0.906652	valid_1's binary_logloss: 0.319567
[116]	valid_0's auc: 0.938155	valid_0's binary_logloss: 0.271111	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.319629
[117]	valid_0's auc: 0.938397	valid_0's binary_logloss: 0.270719	valid_1's auc: 0.906698	valid_1's binary_logloss: 0.319521
[118]	valid_0's auc: 0.938548	valid_0's binary_logloss: 0.270404	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319482
[119]	valid_0's auc: 0.93874	valid_0's binary_logloss: 0.270057	valid_1's auc: 0.906734	valid_1's binary_logloss: 0.31953
[120]	valid_0's auc: 0.938987	valid_0's binary_logloss: 0.269649	valid_1's auc: 0.906597	valid_1's binary_logloss: 0.319805
[121]	valid_0's auc: 0.939129	valid_0's binary_logloss: 0.26937	valid_1's auc: 0.906581	valid_1's binary_logloss: 0.319901
[122]	valid_0's auc: 0.939315	valid_0's binary_logloss: 0.269006	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.319893
[123]	valid_0's auc: 0.939443	valid_0's binary_logloss: 0.268753	valid_1's auc: 0.90651	valid_1's binary_logloss: 0.320144
[124]	valid_0's auc: 0.939606	valid_0's binary_logloss: 0.268419	valid_1's auc: 0.906561	valid_1's binary_logloss: 0.320071
[125]	valid_0's auc: 0.939788	valid_0's binary_logloss: 0.268089	valid_1's auc: 0.906616	valid_1's binary_logloss: 0.320088
[126]	valid_0's auc: 0.939941	valid_0's binary_logloss: 0.267795	valid_1's auc: 0.906622	valid_1's binary_logloss: 0.320135
[127]	valid_0's auc: 0.940169	valid_0's binary_logloss: 0.267365	valid_1's auc: 0.906579	valid_1's binary_logloss: 0.320254
[128]	valid_0's auc: 0.940277	valid_0's binary_logloss: 0.267128	valid_1's auc: 0.906565	valid_1's binary_logloss: 0.320342
[129]	valid_0's auc: 0.940457	valid_0's binary_logloss: 0.266809	valid_1's auc: 0.906544	valid_1's binary_logloss: 0.320434
[130]	valid_0's auc: 0.94066	valid_0's binary_logloss: 0.266418	valid_1's auc: 0.906484	valid_1's binary_logloss: 0.320587
[131]	valid_0's auc: 0.940815	valid_0's binary_logloss: 0.266143	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320657
[132]	valid_0's auc: 0.940931	valid_0's binary_logloss: 0.26592	valid_1's auc: 0.906438	valid_1's binary_logloss: 0.320704
[133]	valid_0's auc: 0.941143	valid_0's binary_logloss: 0.265556	valid_1's auc: 0.906309	valid_1's binary_logloss: 0.3209
[134]	valid_0's auc: 0.941287	valid_0's binary_logloss: 0.265275	valid_1's auc: 0.906412	valid_1's binary_logloss: 0.320812
[135]	valid_0's auc: 0.941466	valid_0's binary_logloss: 0.26494	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.321193
[136]	valid_0's auc: 0.941604	valid_0's binary_logloss: 0.264672	valid_1's auc: 0.906174	valid_1's binary_logloss: 0.321245
[137]	valid_0's auc: 0.94182	valid_0's binary_logloss: 0.26432	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.32151
[138]	valid_0's auc: 0.94196	valid_0's binary_logloss: 0.264038	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.321609
[139]	valid_0's auc: 0.94213	valid_0's binary_logloss: 0.263743	valid_1's auc: 0.905936	valid_1's binary_logloss: 0.321641
[140]	valid_0's auc: 0.942273	valid_0's binary_logloss: 0.263462	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.321726
[141]	valid_0's auc: 0.942418	valid_0's binary_logloss: 0.263207	valid_1's auc: 0.905948	valid_1's binary_logloss: 0.321718
[142]	valid_0's auc: 0.942541	valid_0's binary_logloss: 0.262979	valid_1's auc: 0.905949	valid_1's binary_logloss: 0.321744
[143]	valid_0's auc: 0.942702	valid_0's binary_logloss: 0.262686	valid_1's auc: 0.905857	valid_1's binary_logloss: 0.321916
[144]	valid_0's auc: 0.942871	valid_0's binary_logloss: 0.26238	valid_1's auc: 0.905858	valid_1's binary_logloss: 0.321956
[145]	valid_0's auc: 0.94303	valid_0's binary_logloss: 0.262047	valid_1's auc: 0.905853	valid_1's binary_logloss: 0.321925
[146]	valid_0's auc: 0.943192	valid_0's binary_logloss: 0.261758	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.322018
[147]	valid_0's auc: 0.943327	valid_0's binary_logloss: 0.261482	valid_1's auc: 0.905834	valid_1's binary_logloss: 0.322122
[148]	valid_0's auc: 0.943455	valid_0's binary_logloss: 0.261228	valid_1's auc: 0.905812	valid_1's binary_logloss: 0.322145
[149]	valid_0's auc: 0.943598	valid_0's binary_logloss: 0.260969	valid_1's auc: 0.905716	valid_1's binary_logloss: 0.322296
[150]	valid_0's auc: 0.943787	valid_0's binary_logloss: 0.26064	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.322313
[151]	valid_0's auc: 0.943937	valid_0's binary_logloss: 0.26036	valid_1's auc: 0.905646	valid_1's binary_logloss: 0.32245
[152]	valid_0's auc: 0.944091	valid_0's binary_logloss: 0.260083	valid_1's auc: 0.905594	valid_1's binary_logloss: 0.322579
Early stopping, best iteration is:
[52]	valid_0's auc: 0.922541	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.91019	valid_1's binary_logloss: 0.313611
[1]	valid_0's auc: 0.888249	valid_0's binary_logloss: 0.517487	valid_1's auc: 0.892473	valid_1's binary_logloss: 0.508682
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.8932	valid_0's binary_logloss: 0.488767	valid_1's auc: 0.898628	valid_1's binary_logloss: 0.47931
[3]	valid_0's auc: 0.893892	valid_0's binary_logloss: 0.46573	valid_1's auc: 0.899079	valid_1's binary_logloss: 0.45581
[4]	valid_0's auc: 0.895475	valid_0's binary_logloss: 0.446714	valid_1's auc: 0.900674	valid_1's binary_logloss: 0.436743
[5]	valid_0's auc: 0.897074	valid_0's binary_logloss: 0.430337	valid_1's auc: 0.90173	valid_1's binary_logloss: 0.42032
[6]	valid_0's auc: 0.898357	valid_0's binary_logloss: 0.416642	valid_1's auc: 0.902698	valid_1's binary_logloss: 0.406406
[7]	valid_0's auc: 0.899307	valid_0's binary_logloss: 0.404911	valid_1's auc: 0.903472	valid_1's binary_logloss: 0.394687
[8]	valid_0's auc: 0.900174	valid_0's binary_logloss: 0.394885	valid_1's auc: 0.904079	valid_1's binary_logloss: 0.384734
[9]	valid_0's auc: 0.901445	valid_0's binary_logloss: 0.385831	valid_1's auc: 0.904686	valid_1's binary_logloss: 0.375986
[10]	valid_0's auc: 0.901761	valid_0's binary_logloss: 0.378314	valid_1's auc: 0.905095	valid_1's binary_logloss: 0.368578
[11]	valid_0's auc: 0.902733	valid_0's binary_logloss: 0.371404	valid_1's auc: 0.905468	valid_1's binary_logloss: 0.362191
[12]	valid_0's auc: 0.903536	valid_0's binary_logloss: 0.365482	valid_1's auc: 0.9056	valid_1's binary_logloss: 0.356725
[13]	valid_0's auc: 0.903939	valid_0's binary_logloss: 0.360327	valid_1's auc: 0.905926	valid_1's binary_logloss: 0.352125
[14]	valid_0's auc: 0.905191	valid_0's binary_logloss: 0.355322	valid_1's auc: 0.906402	valid_1's binary_logloss: 0.347668
[15]	valid_0's auc: 0.905928	valid_0's binary_logloss: 0.350984	valid_1's auc: 0.906828	valid_1's binary_logloss: 0.343872
[16]	valid_0's auc: 0.906579	valid_0's binary_logloss: 0.347141	valid_1's auc: 0.907127	valid_1's binary_logloss: 0.340579
[17]	valid_0's auc: 0.907267	valid_0's binary_logloss: 0.343682	valid_1's auc: 0.90761	valid_1's binary_logloss: 0.337531
[18]	valid_0's auc: 0.907585	valid_0's binary_logloss: 0.340752	valid_1's auc: 0.907531	valid_1's binary_logloss: 0.335234
[19]	valid_0's auc: 0.907981	valid_0's binary_logloss: 0.338032	valid_1's auc: 0.9076	valid_1's binary_logloss: 0.333033
[20]	valid_0's auc: 0.908579	valid_0's binary_logloss: 0.335439	valid_1's auc: 0.907959	valid_1's binary_logloss: 0.330861
[21]	valid_0's auc: 0.909224	valid_0's binary_logloss: 0.332941	valid_1's auc: 0.908048	valid_1's binary_logloss: 0.329012
[22]	valid_0's auc: 0.909814	valid_0's binary_logloss: 0.330747	valid_1's auc: 0.908289	valid_1's binary_logloss: 0.327299
[23]	valid_0's auc: 0.910367	valid_0's binary_logloss: 0.328736	valid_1's auc: 0.908495	valid_1's binary_logloss: 0.325822
[24]	valid_0's auc: 0.910998	valid_0's binary_logloss: 0.326659	valid_1's auc: 0.908815	valid_1's binary_logloss: 0.324376
[25]	valid_0's auc: 0.911591	valid_0's binary_logloss: 0.324721	valid_1's auc: 0.909054	valid_1's binary_logloss: 0.32308
[26]	valid_0's auc: 0.912063	valid_0's binary_logloss: 0.323012	valid_1's auc: 0.90899	valid_1's binary_logloss: 0.322186
[27]	valid_0's auc: 0.912484	valid_0's binary_logloss: 0.321575	valid_1's auc: 0.909058	valid_1's binary_logloss: 0.321378
[28]	valid_0's auc: 0.912988	valid_0's binary_logloss: 0.320081	valid_1's auc: 0.90915	valid_1's binary_logloss: 0.320579
[29]	valid_0's auc: 0.913467	valid_0's binary_logloss: 0.318722	valid_1's auc: 0.909227	valid_1's binary_logloss: 0.319887
[30]	valid_0's auc: 0.91399	valid_0's binary_logloss: 0.317347	valid_1's auc: 0.909389	valid_1's binary_logloss: 0.319109
[31]	valid_0's auc: 0.91451	valid_0's binary_logloss: 0.316022	valid_1's auc: 0.909505	valid_1's binary_logloss: 0.318472
[32]	valid_0's auc: 0.915025	valid_0's binary_logloss: 0.314768	valid_1's auc: 0.909635	valid_1's binary_logloss: 0.317932
[33]	valid_0's auc: 0.915492	valid_0's binary_logloss: 0.31362	valid_1's auc: 0.909783	valid_1's binary_logloss: 0.317396
[34]	valid_0's auc: 0.91596	valid_0's binary_logloss: 0.312525	valid_1's auc: 0.909863	valid_1's binary_logloss: 0.316953
[35]	valid_0's auc: 0.916329	valid_0's binary_logloss: 0.311549	valid_1's auc: 0.909848	valid_1's binary_logloss: 0.316623
[36]	valid_0's auc: 0.916732	valid_0's binary_logloss: 0.31057	valid_1's auc: 0.909996	valid_1's binary_logloss: 0.316163
[37]	valid_0's auc: 0.917177	valid_0's binary_logloss: 0.30959	valid_1's auc: 0.910027	valid_1's binary_logloss: 0.315878
[38]	valid_0's auc: 0.917608	valid_0's binary_logloss: 0.30868	valid_1's auc: 0.909985	valid_1's binary_logloss: 0.315724
[39]	valid_0's auc: 0.918043	valid_0's binary_logloss: 0.307749	valid_1's auc: 0.909963	valid_1's binary_logloss: 0.315561
[40]	valid_0's auc: 0.918533	valid_0's binary_logloss: 0.306712	valid_1's auc: 0.909808	valid_1's binary_logloss: 0.315598
[41]	valid_0's auc: 0.918897	valid_0's binary_logloss: 0.305891	valid_1's auc: 0.9098	valid_1's binary_logloss: 0.315512
[42]	valid_0's auc: 0.919356	valid_0's binary_logloss: 0.30499	valid_1's auc: 0.90985	valid_1's binary_logloss: 0.315316
[43]	valid_0's auc: 0.919642	valid_0's binary_logloss: 0.304318	valid_1's auc: 0.909983	valid_1's binary_logloss: 0.314974
[44]	valid_0's auc: 0.919956	valid_0's binary_logloss: 0.303636	valid_1's auc: 0.909873	valid_1's binary_logloss: 0.315008
[45]	valid_0's auc: 0.920353	valid_0's binary_logloss: 0.302856	valid_1's auc: 0.909891	valid_1's binary_logloss: 0.314825
[46]	valid_0's auc: 0.920642	valid_0's binary_logloss: 0.302205	valid_1's auc: 0.909874	valid_1's binary_logloss: 0.314755
[47]	valid_0's auc: 0.920954	valid_0's binary_logloss: 0.301597	valid_1's auc: 0.909939	valid_1's binary_logloss: 0.314549
[48]	valid_0's auc: 0.921313	valid_0's binary_logloss: 0.300869	valid_1's auc: 0.910091	valid_1's binary_logloss: 0.314255
[49]	valid_0's auc: 0.921603	valid_0's binary_logloss: 0.300313	valid_1's auc: 0.910099	valid_1's binary_logloss: 0.314128
[50]	valid_0's auc: 0.921962	valid_0's binary_logloss: 0.299636	valid_1's auc: 0.91008	valid_1's binary_logloss: 0.314059
[51]	valid_0's auc: 0.922354	valid_0's binary_logloss: 0.298955	valid_1's auc: 0.909955	valid_1's binary_logloss: 0.31414
[52]	valid_0's auc: 0.922651	valid_0's binary_logloss: 0.298421	valid_1's auc: 0.909936	valid_1's binary_logloss: 0.314118
[53]	valid_0's auc: 0.922888	valid_0's binary_logloss: 0.297889	valid_1's auc: 0.909984	valid_1's binary_logloss: 0.31396
[54]	valid_0's auc: 0.923114	valid_0's binary_logloss: 0.297483	valid_1's auc: 0.909885	valid_1's binary_logloss: 0.314076
[55]	valid_0's auc: 0.923502	valid_0's binary_logloss: 0.296859	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.314015
[56]	valid_0's auc: 0.923783	valid_0's binary_logloss: 0.296359	valid_1's auc: 0.909852	valid_1's binary_logloss: 0.313997
[57]	valid_0's auc: 0.924115	valid_0's binary_logloss: 0.295771	valid_1's auc: 0.909733	valid_1's binary_logloss: 0.314065
[58]	valid_0's auc: 0.924405	valid_0's binary_logloss: 0.29519	valid_1's auc: 0.909696	valid_1's binary_logloss: 0.314093
[59]	valid_0's auc: 0.924766	valid_0's binary_logloss: 0.29456	valid_1's auc: 0.909534	valid_1's binary_logloss: 0.314286
[60]	valid_0's auc: 0.925093	valid_0's binary_logloss: 0.293974	valid_1's auc: 0.909612	valid_1's binary_logloss: 0.314132
[61]	valid_0's auc: 0.925373	valid_0's binary_logloss: 0.293449	valid_1's auc: 0.909622	valid_1's binary_logloss: 0.314146
[62]	valid_0's auc: 0.925605	valid_0's binary_logloss: 0.293006	valid_1's auc: 0.909522	valid_1's binary_logloss: 0.314297
[63]	valid_0's auc: 0.925955	valid_0's binary_logloss: 0.292423	valid_1's auc: 0.909516	valid_1's binary_logloss: 0.314312
[64]	valid_0's auc: 0.926322	valid_0's binary_logloss: 0.291792	valid_1's auc: 0.909467	valid_1's binary_logloss: 0.314427
[65]	valid_0's auc: 0.926646	valid_0's binary_logloss: 0.291225	valid_1's auc: 0.909607	valid_1's binary_logloss: 0.314161
[66]	valid_0's auc: 0.926979	valid_0's binary_logloss: 0.290641	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.314365
[67]	valid_0's auc: 0.927286	valid_0's binary_logloss: 0.290135	valid_1's auc: 0.909532	valid_1's binary_logloss: 0.314266
[68]	valid_0's auc: 0.927572	valid_0's binary_logloss: 0.289674	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.314318
[69]	valid_0's auc: 0.927887	valid_0's binary_logloss: 0.289159	valid_1's auc: 0.909494	valid_1's binary_logloss: 0.314294
[70]	valid_0's auc: 0.928168	valid_0's binary_logloss: 0.288664	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314386
[71]	valid_0's auc: 0.928416	valid_0's binary_logloss: 0.288244	valid_1's auc: 0.90943	valid_1's binary_logloss: 0.314417
[72]	valid_0's auc: 0.928647	valid_0's binary_logloss: 0.287841	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.314316
[73]	valid_0's auc: 0.928899	valid_0's binary_logloss: 0.28739	valid_1's auc: 0.90939	valid_1's binary_logloss: 0.31438
[74]	valid_0's auc: 0.929123	valid_0's binary_logloss: 0.286929	valid_1's auc: 0.909313	valid_1's binary_logloss: 0.314529
[75]	valid_0's auc: 0.929313	valid_0's binary_logloss: 0.286574	valid_1's auc: 0.909183	valid_1's binary_logloss: 0.314724
[76]	valid_0's auc: 0.929589	valid_0's binary_logloss: 0.286122	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314645
[77]	valid_0's auc: 0.929911	valid_0's binary_logloss: 0.285585	valid_1's auc: 0.909283	valid_1's binary_logloss: 0.314668
[78]	valid_0's auc: 0.930238	valid_0's binary_logloss: 0.284983	valid_1's auc: 0.909161	valid_1's binary_logloss: 0.314818
[79]	valid_0's auc: 0.930456	valid_0's binary_logloss: 0.284605	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.314946
[80]	valid_0's auc: 0.930692	valid_0's binary_logloss: 0.284227	valid_1's auc: 0.909068	valid_1's binary_logloss: 0.314987
[81]	valid_0's auc: 0.930953	valid_0's binary_logloss: 0.283839	valid_1's auc: 0.909057	valid_1's binary_logloss: 0.314989
[82]	valid_0's auc: 0.931189	valid_0's binary_logloss: 0.283427	valid_1's auc: 0.909042	valid_1's binary_logloss: 0.314987
[83]	valid_0's auc: 0.931412	valid_0's binary_logloss: 0.283015	valid_1's auc: 0.909046	valid_1's binary_logloss: 0.314993
[84]	valid_0's auc: 0.931612	valid_0's binary_logloss: 0.282609	valid_1's auc: 0.908999	valid_1's binary_logloss: 0.315056
[85]	valid_0's auc: 0.931926	valid_0's binary_logloss: 0.282069	valid_1's auc: 0.90894	valid_1's binary_logloss: 0.315245
[86]	valid_0's auc: 0.932196	valid_0's binary_logloss: 0.281601	valid_1's auc: 0.909013	valid_1's binary_logloss: 0.315132
[87]	valid_0's auc: 0.932384	valid_0's binary_logloss: 0.281237	valid_1's auc: 0.908925	valid_1's binary_logloss: 0.315259
[88]	valid_0's auc: 0.932563	valid_0's binary_logloss: 0.280891	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.315435
[89]	valid_0's auc: 0.932784	valid_0's binary_logloss: 0.280502	valid_1's auc: 0.908805	valid_1's binary_logloss: 0.315602
[90]	valid_0's auc: 0.933094	valid_0's binary_logloss: 0.279944	valid_1's auc: 0.908822	valid_1's binary_logloss: 0.315632
[91]	valid_0's auc: 0.933414	valid_0's binary_logloss: 0.279407	valid_1's auc: 0.908841	valid_1's binary_logloss: 0.315551
[92]	valid_0's auc: 0.9337	valid_0's binary_logloss: 0.278888	valid_1's auc: 0.908842	valid_1's binary_logloss: 0.315573
[93]	valid_0's auc: 0.933934	valid_0's binary_logloss: 0.278476	valid_1's auc: 0.908746	valid_1's binary_logloss: 0.315768
[94]	valid_0's auc: 0.934128	valid_0's binary_logloss: 0.278151	valid_1's auc: 0.908789	valid_1's binary_logloss: 0.3157
[95]	valid_0's auc: 0.934422	valid_0's binary_logloss: 0.277684	valid_1's auc: 0.908853	valid_1's binary_logloss: 0.315626
[96]	valid_0's auc: 0.93463	valid_0's binary_logloss: 0.277331	valid_1's auc: 0.908761	valid_1's binary_logloss: 0.315754
[97]	valid_0's auc: 0.934849	valid_0's binary_logloss: 0.27698	valid_1's auc: 0.908643	valid_1's binary_logloss: 0.315958
[98]	valid_0's auc: 0.93503	valid_0's binary_logloss: 0.27664	valid_1's auc: 0.908641	valid_1's binary_logloss: 0.315981
[99]	valid_0's auc: 0.935229	valid_0's binary_logloss: 0.276282	valid_1's auc: 0.90861	valid_1's binary_logloss: 0.316069
[100]	valid_0's auc: 0.935443	valid_0's binary_logloss: 0.275923	valid_1's auc: 0.908452	valid_1's binary_logloss: 0.316341
[101]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275532	valid_1's auc: 0.908381	valid_1's binary_logloss: 0.316502
[102]	valid_0's auc: 0.935864	valid_0's binary_logloss: 0.275199	valid_1's auc: 0.908266	valid_1's binary_logloss: 0.316685
[103]	valid_0's auc: 0.936067	valid_0's binary_logloss: 0.274853	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316763
[104]	valid_0's auc: 0.936238	valid_0's binary_logloss: 0.274524	valid_1's auc: 0.908225	valid_1's binary_logloss: 0.316735
[105]	valid_0's auc: 0.936465	valid_0's binary_logloss: 0.274122	valid_1's auc: 0.908206	valid_1's binary_logloss: 0.316803
[106]	valid_0's auc: 0.93672	valid_0's binary_logloss: 0.27371	valid_1's auc: 0.908147	valid_1's binary_logloss: 0.316885
[107]	valid_0's auc: 0.936991	valid_0's binary_logloss: 0.273246	valid_1's auc: 0.908135	valid_1's binary_logloss: 0.316985
[108]	valid_0's auc: 0.937202	valid_0's binary_logloss: 0.272877	valid_1's auc: 0.908127	valid_1's binary_logloss: 0.316978
[109]	valid_0's auc: 0.937417	valid_0's binary_logloss: 0.272449	valid_1's auc: 0.90804	valid_1's binary_logloss: 0.317113
[110]	valid_0's auc: 0.937688	valid_0's binary_logloss: 0.27202	valid_1's auc: 0.908076	valid_1's binary_logloss: 0.317064
[111]	valid_0's auc: 0.937919	valid_0's binary_logloss: 0.271627	valid_1's auc: 0.907931	valid_1's binary_logloss: 0.317262
[112]	valid_0's auc: 0.938123	valid_0's binary_logloss: 0.271291	valid_1's auc: 0.907912	valid_1's binary_logloss: 0.317307
[113]	valid_0's auc: 0.938332	valid_0's binary_logloss: 0.27093	valid_1's auc: 0.907863	valid_1's binary_logloss: 0.317425
[114]	valid_0's auc: 0.938487	valid_0's binary_logloss: 0.27064	valid_1's auc: 0.90789	valid_1's binary_logloss: 0.317408
[115]	valid_0's auc: 0.93863	valid_0's binary_logloss: 0.270362	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317554
[116]	valid_0's auc: 0.938881	valid_0's binary_logloss: 0.269949	valid_1's auc: 0.90777	valid_1's binary_logloss: 0.317682
[117]	valid_0's auc: 0.939069	valid_0's binary_logloss: 0.269617	valid_1's auc: 0.907703	valid_1's binary_logloss: 0.317753
[118]	valid_0's auc: 0.939287	valid_0's binary_logloss: 0.269249	valid_1's auc: 0.907676	valid_1's binary_logloss: 0.317815
[119]	valid_0's auc: 0.93949	valid_0's binary_logloss: 0.268874	valid_1's auc: 0.90763	valid_1's binary_logloss: 0.317948
[120]	valid_0's auc: 0.939693	valid_0's binary_logloss: 0.268528	valid_1's auc: 0.907626	valid_1's binary_logloss: 0.317978
[121]	valid_0's auc: 0.939924	valid_0's binary_logloss: 0.268147	valid_1's auc: 0.90759	valid_1's binary_logloss: 0.318096
[122]	valid_0's auc: 0.940103	valid_0's binary_logloss: 0.267815	valid_1's auc: 0.907522	valid_1's binary_logloss: 0.318261
[123]	valid_0's auc: 0.940249	valid_0's binary_logloss: 0.267532	valid_1's auc: 0.907409	valid_1's binary_logloss: 0.318474
[124]	valid_0's auc: 0.940518	valid_0's binary_logloss: 0.267071	valid_1's auc: 0.90735	valid_1's binary_logloss: 0.318619
[125]	valid_0's auc: 0.940714	valid_0's binary_logloss: 0.266708	valid_1's auc: 0.907272	valid_1's binary_logloss: 0.318723
[126]	valid_0's auc: 0.940927	valid_0's binary_logloss: 0.266327	valid_1's auc: 0.907344	valid_1's binary_logloss: 0.318624
[127]	valid_0's auc: 0.941139	valid_0's binary_logloss: 0.265982	valid_1's auc: 0.907264	valid_1's binary_logloss: 0.318776
[128]	valid_0's auc: 0.941299	valid_0's binary_logloss: 0.265688	valid_1's auc: 0.907144	valid_1's binary_logloss: 0.318995
[129]	valid_0's auc: 0.941427	valid_0's binary_logloss: 0.265455	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.319109
[130]	valid_0's auc: 0.941572	valid_0's binary_logloss: 0.26517	valid_1's auc: 0.906986	valid_1's binary_logloss: 0.319302
[131]	valid_0's auc: 0.941737	valid_0's binary_logloss: 0.26486	valid_1's auc: 0.906834	valid_1's binary_logloss: 0.319542
[132]	valid_0's auc: 0.941866	valid_0's binary_logloss: 0.264589	valid_1's auc: 0.906755	valid_1's binary_logloss: 0.319739
[133]	valid_0's auc: 0.942026	valid_0's binary_logloss: 0.264307	valid_1's auc: 0.906645	valid_1's binary_logloss: 0.319946
[134]	valid_0's auc: 0.942229	valid_0's binary_logloss: 0.263922	valid_1's auc: 0.906623	valid_1's binary_logloss: 0.32003
[135]	valid_0's auc: 0.94233	valid_0's binary_logloss: 0.26371	valid_1's auc: 0.906602	valid_1's binary_logloss: 0.320154
[136]	valid_0's auc: 0.942465	valid_0's binary_logloss: 0.263417	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320386
[137]	valid_0's auc: 0.942665	valid_0's binary_logloss: 0.263056	valid_1's auc: 0.906468	valid_1's binary_logloss: 0.32047
[138]	valid_0's auc: 0.942783	valid_0's binary_logloss: 0.262832	valid_1's auc: 0.906382	valid_1's binary_logloss: 0.320648
[139]	valid_0's auc: 0.942916	valid_0's binary_logloss: 0.26256	valid_1's auc: 0.906411	valid_1's binary_logloss: 0.320636
[140]	valid_0's auc: 0.943083	valid_0's binary_logloss: 0.262249	valid_1's auc: 0.906484	valid_1's binary_logloss: 0.320538
[141]	valid_0's auc: 0.943276	valid_0's binary_logloss: 0.261894	valid_1's auc: 0.906459	valid_1's binary_logloss: 0.320551
[142]	valid_0's auc: 0.943505	valid_0's binary_logloss: 0.261504	valid_1's auc: 0.90646	valid_1's binary_logloss: 0.320609
[143]	valid_0's auc: 0.943705	valid_0's binary_logloss: 0.261135	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320639
[144]	valid_0's auc: 0.943955	valid_0's binary_logloss: 0.260661	valid_1's auc: 0.906486	valid_1's binary_logloss: 0.320741
[145]	valid_0's auc: 0.944104	valid_0's binary_logloss: 0.260371	valid_1's auc: 0.906478	valid_1's binary_logloss: 0.320844
[146]	valid_0's auc: 0.944221	valid_0's binary_logloss: 0.260134	valid_1's auc: 0.906349	valid_1's binary_logloss: 0.321079
[147]	valid_0's auc: 0.944388	valid_0's binary_logloss: 0.259839	valid_1's auc: 0.906298	valid_1's binary_logloss: 0.321143
[148]	valid_0's auc: 0.944516	valid_0's binary_logloss: 0.259605	valid_1's auc: 0.906319	valid_1's binary_logloss: 0.321184
[149]	valid_0's auc: 0.944756	valid_0's binary_logloss: 0.259183	valid_1's auc: 0.906118	valid_1's binary_logloss: 0.32151
Early stopping, best iteration is:
[49]	valid_0's auc: 0.921603	valid_0's binary_logloss: 0.300313	valid_1's auc: 0.910099	valid_1's binary_logloss: 0.314128
[1]	valid_0's auc: 0.888033	valid_0's binary_logloss: 0.517843	valid_1's auc: 0.894415	valid_1's binary_logloss: 0.508761
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.891314	valid_0's binary_logloss: 0.489285	valid_1's auc: 0.895027	valid_1's binary_logloss: 0.479894
[3]	valid_0's auc: 0.894088	valid_0's binary_logloss: 0.465958	valid_1's auc: 0.896489	valid_1's binary_logloss: 0.456524
[4]	valid_0's auc: 0.89488	valid_0's binary_logloss: 0.446911	valid_1's auc: 0.898262	valid_1's binary_logloss: 0.43713
[5]	valid_0's auc: 0.896689	valid_0's binary_logloss: 0.430552	valid_1's auc: 0.899869	valid_1's binary_logloss: 0.420594
[6]	valid_0's auc: 0.898013	valid_0's binary_logloss: 0.416849	valid_1's auc: 0.901707	valid_1's binary_logloss: 0.406699
[7]	valid_0's auc: 0.898754	valid_0's binary_logloss: 0.405125	valid_1's auc: 0.90195	valid_1's binary_logloss: 0.395204
[8]	valid_0's auc: 0.899284	valid_0's binary_logloss: 0.395187	valid_1's auc: 0.903018	valid_1's binary_logloss: 0.385059
[9]	valid_0's auc: 0.90024	valid_0's binary_logloss: 0.386298	valid_1's auc: 0.903497	valid_1's binary_logloss: 0.376501
[10]	valid_0's auc: 0.900834	valid_0's binary_logloss: 0.378777	valid_1's auc: 0.903423	valid_1's binary_logloss: 0.369439
[11]	valid_0's auc: 0.901409	valid_0's binary_logloss: 0.372036	valid_1's auc: 0.903966	valid_1's binary_logloss: 0.362807
[12]	valid_0's auc: 0.902026	valid_0's binary_logloss: 0.366154	valid_1's auc: 0.904417	valid_1's binary_logloss: 0.357196
[13]	valid_0's auc: 0.903075	valid_0's binary_logloss: 0.360671	valid_1's auc: 0.905081	valid_1's binary_logloss: 0.352152
[14]	valid_0's auc: 0.904113	valid_0's binary_logloss: 0.355876	valid_1's auc: 0.905772	valid_1's binary_logloss: 0.347773
[15]	valid_0's auc: 0.904685	valid_0's binary_logloss: 0.351691	valid_1's auc: 0.905867	valid_1's binary_logloss: 0.344181
[16]	valid_0's auc: 0.905378	valid_0's binary_logloss: 0.34781	valid_1's auc: 0.906444	valid_1's binary_logloss: 0.340635
[17]	valid_0's auc: 0.905952	valid_0's binary_logloss: 0.344376	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.337845
[18]	valid_0's auc: 0.906788	valid_0's binary_logloss: 0.341233	valid_1's auc: 0.906935	valid_1's binary_logloss: 0.335275
[19]	valid_0's auc: 0.907429	valid_0's binary_logloss: 0.33838	valid_1's auc: 0.906997	valid_1's binary_logloss: 0.333194
[20]	valid_0's auc: 0.908014	valid_0's binary_logloss: 0.33582	valid_1's auc: 0.907552	valid_1's binary_logloss: 0.330977
[21]	valid_0's auc: 0.908813	valid_0's binary_logloss: 0.333265	valid_1's auc: 0.907487	valid_1's binary_logloss: 0.329429
[22]	valid_0's auc: 0.909387	valid_0's binary_logloss: 0.331028	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.327796
[23]	valid_0's auc: 0.910076	valid_0's binary_logloss: 0.328812	valid_1's auc: 0.907986	valid_1's binary_logloss: 0.326067
[24]	valid_0's auc: 0.910742	valid_0's binary_logloss: 0.326687	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.324823
[25]	valid_0's auc: 0.911337	valid_0's binary_logloss: 0.324799	valid_1's auc: 0.908261	valid_1's binary_logloss: 0.323652
[26]	valid_0's auc: 0.911971	valid_0's binary_logloss: 0.323012	valid_1's auc: 0.908609	valid_1's binary_logloss: 0.322287
[27]	valid_0's auc: 0.912574	valid_0's binary_logloss: 0.321457	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.321443
[28]	valid_0's auc: 0.913166	valid_0's binary_logloss: 0.319892	valid_1's auc: 0.908754	valid_1's binary_logloss: 0.32056
[29]	valid_0's auc: 0.913592	valid_0's binary_logloss: 0.318573	valid_1's auc: 0.908885	valid_1's binary_logloss: 0.319732
[30]	valid_0's auc: 0.914047	valid_0's binary_logloss: 0.317297	valid_1's auc: 0.908941	valid_1's binary_logloss: 0.319094
[31]	valid_0's auc: 0.914607	valid_0's binary_logloss: 0.31596	valid_1's auc: 0.909089	valid_1's binary_logloss: 0.318424
[32]	valid_0's auc: 0.915222	valid_0's binary_logloss: 0.314541	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.317919
[33]	valid_0's auc: 0.915771	valid_0's binary_logloss: 0.313256	valid_1's auc: 0.909168	valid_1's binary_logloss: 0.317448
[34]	valid_0's auc: 0.91618	valid_0's binary_logloss: 0.312226	valid_1's auc: 0.909277	valid_1's binary_logloss: 0.316931
[35]	valid_0's auc: 0.916612	valid_0's binary_logloss: 0.311171	valid_1's auc: 0.90931	valid_1's binary_logloss: 0.316615
[36]	valid_0's auc: 0.917002	valid_0's binary_logloss: 0.310229	valid_1's auc: 0.909347	valid_1's binary_logloss: 0.316384
[37]	valid_0's auc: 0.917396	valid_0's binary_logloss: 0.309223	valid_1's auc: 0.909367	valid_1's binary_logloss: 0.31613
[38]	valid_0's auc: 0.917777	valid_0's binary_logloss: 0.308376	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.315751
[39]	valid_0's auc: 0.918182	valid_0's binary_logloss: 0.307513	valid_1's auc: 0.909468	valid_1's binary_logloss: 0.315564
[40]	valid_0's auc: 0.918592	valid_0's binary_logloss: 0.306601	valid_1's auc: 0.90954	valid_1's binary_logloss: 0.315221
[41]	valid_0's auc: 0.919003	valid_0's binary_logloss: 0.305757	valid_1's auc: 0.909525	valid_1's binary_logloss: 0.315049
[42]	valid_0's auc: 0.919316	valid_0's binary_logloss: 0.305064	valid_1's auc: 0.90958	valid_1's binary_logloss: 0.314864
[43]	valid_0's auc: 0.919809	valid_0's binary_logloss: 0.304145	valid_1's auc: 0.909687	valid_1's binary_logloss: 0.314572
[44]	valid_0's auc: 0.920209	valid_0's binary_logloss: 0.303334	valid_1's auc: 0.909828	valid_1's binary_logloss: 0.314251
[45]	valid_0's auc: 0.920515	valid_0's binary_logloss: 0.302671	valid_1's auc: 0.909768	valid_1's binary_logloss: 0.314269
[46]	valid_0's auc: 0.920904	valid_0's binary_logloss: 0.301937	valid_1's auc: 0.909801	valid_1's binary_logloss: 0.31413
[47]	valid_0's auc: 0.921273	valid_0's binary_logloss: 0.301266	valid_1's auc: 0.909649	valid_1's binary_logloss: 0.314263
[48]	valid_0's auc: 0.921625	valid_0's binary_logloss: 0.300526	valid_1's auc: 0.909504	valid_1's binary_logloss: 0.314354
[49]	valid_0's auc: 0.922057	valid_0's binary_logloss: 0.299754	valid_1's auc: 0.909433	valid_1's binary_logloss: 0.314448
[50]	valid_0's auc: 0.922407	valid_0's binary_logloss: 0.299108	valid_1's auc: 0.909556	valid_1's binary_logloss: 0.31423
[51]	valid_0's auc: 0.922728	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.909547	valid_1's binary_logloss: 0.314214
[52]	valid_0's auc: 0.923006	valid_0's binary_logloss: 0.297973	valid_1's auc: 0.909549	valid_1's binary_logloss: 0.314095
[53]	valid_0's auc: 0.923328	valid_0's binary_logloss: 0.297373	valid_1's auc: 0.909584	valid_1's binary_logloss: 0.314019
[54]	valid_0's auc: 0.923665	valid_0's binary_logloss: 0.296779	valid_1's auc: 0.909503	valid_1's binary_logloss: 0.314095
[55]	valid_0's auc: 0.923935	valid_0's binary_logloss: 0.296245	valid_1's auc: 0.909488	valid_1's binary_logloss: 0.314071
[56]	valid_0's auc: 0.924281	valid_0's binary_logloss: 0.295635	valid_1's auc: 0.909434	valid_1's binary_logloss: 0.314146
[57]	valid_0's auc: 0.924554	valid_0's binary_logloss: 0.295136	valid_1's auc: 0.909461	valid_1's binary_logloss: 0.314069
[58]	valid_0's auc: 0.924807	valid_0's binary_logloss: 0.294614	valid_1's auc: 0.909411	valid_1's binary_logloss: 0.314154
[59]	valid_0's auc: 0.925136	valid_0's binary_logloss: 0.294055	valid_1's auc: 0.909331	valid_1's binary_logloss: 0.314277
[60]	valid_0's auc: 0.925349	valid_0's binary_logloss: 0.293631	valid_1's auc: 0.909325	valid_1's binary_logloss: 0.314298
[61]	valid_0's auc: 0.925658	valid_0's binary_logloss: 0.29305	valid_1's auc: 0.909287	valid_1's binary_logloss: 0.314322
[62]	valid_0's auc: 0.925915	valid_0's binary_logloss: 0.292583	valid_1's auc: 0.909368	valid_1's binary_logloss: 0.314219
[63]	valid_0's auc: 0.926266	valid_0's binary_logloss: 0.291997	valid_1's auc: 0.909393	valid_1's binary_logloss: 0.314181
[64]	valid_0's auc: 0.926557	valid_0's binary_logloss: 0.291526	valid_1's auc: 0.909259	valid_1's binary_logloss: 0.314404
[65]	valid_0's auc: 0.926834	valid_0's binary_logloss: 0.291019	valid_1's auc: 0.909221	valid_1's binary_logloss: 0.314471
[66]	valid_0's auc: 0.927155	valid_0's binary_logloss: 0.290427	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.314647
[67]	valid_0's auc: 0.927493	valid_0's binary_logloss: 0.289865	valid_1's auc: 0.909038	valid_1's binary_logloss: 0.314748
[68]	valid_0's auc: 0.927797	valid_0's binary_logloss: 0.289324	valid_1's auc: 0.908946	valid_1's binary_logloss: 0.314827
[69]	valid_0's auc: 0.928128	valid_0's binary_logloss: 0.288737	valid_1's auc: 0.908849	valid_1's binary_logloss: 0.314997
[70]	valid_0's auc: 0.928421	valid_0's binary_logloss: 0.288215	valid_1's auc: 0.908649	valid_1's binary_logloss: 0.31532
[71]	valid_0's auc: 0.928711	valid_0's binary_logloss: 0.287705	valid_1's auc: 0.908458	valid_1's binary_logloss: 0.315616
[72]	valid_0's auc: 0.928993	valid_0's binary_logloss: 0.287209	valid_1's auc: 0.908269	valid_1's binary_logloss: 0.315912
[73]	valid_0's auc: 0.929313	valid_0's binary_logloss: 0.28669	valid_1's auc: 0.908251	valid_1's binary_logloss: 0.315903
[74]	valid_0's auc: 0.929609	valid_0's binary_logloss: 0.286148	valid_1's auc: 0.908328	valid_1's binary_logloss: 0.315829
[75]	valid_0's auc: 0.929847	valid_0's binary_logloss: 0.285772	valid_1's auc: 0.908365	valid_1's binary_logloss: 0.315811
[76]	valid_0's auc: 0.930103	valid_0's binary_logloss: 0.28531	valid_1's auc: 0.908384	valid_1's binary_logloss: 0.315751
[77]	valid_0's auc: 0.930338	valid_0's binary_logloss: 0.284892	valid_1's auc: 0.908422	valid_1's binary_logloss: 0.315683
[78]	valid_0's auc: 0.93053	valid_0's binary_logloss: 0.284544	valid_1's auc: 0.90827	valid_1's binary_logloss: 0.315915
[79]	valid_0's auc: 0.930709	valid_0's binary_logloss: 0.284201	valid_1's auc: 0.908126	valid_1's binary_logloss: 0.316141
[80]	valid_0's auc: 0.930914	valid_0's binary_logloss: 0.283809	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.316304
[81]	valid_0's auc: 0.9311	valid_0's binary_logloss: 0.283468	valid_1's auc: 0.907851	valid_1's binary_logloss: 0.316619
[82]	valid_0's auc: 0.931387	valid_0's binary_logloss: 0.28298	valid_1's auc: 0.907839	valid_1's binary_logloss: 0.316697
[83]	valid_0's auc: 0.931647	valid_0's binary_logloss: 0.282472	valid_1's auc: 0.907796	valid_1's binary_logloss: 0.316767
[84]	valid_0's auc: 0.931951	valid_0's binary_logloss: 0.281939	valid_1's auc: 0.907726	valid_1's binary_logloss: 0.316869
[85]	valid_0's auc: 0.932204	valid_0's binary_logloss: 0.281522	valid_1's auc: 0.9076	valid_1's binary_logloss: 0.317084
[86]	valid_0's auc: 0.932444	valid_0's binary_logloss: 0.281106	valid_1's auc: 0.907519	valid_1's binary_logloss: 0.317278
[87]	valid_0's auc: 0.932773	valid_0's binary_logloss: 0.280578	valid_1's auc: 0.907482	valid_1's binary_logloss: 0.317311
[88]	valid_0's auc: 0.932944	valid_0's binary_logloss: 0.280262	valid_1's auc: 0.907451	valid_1's binary_logloss: 0.317371
[89]	valid_0's auc: 0.933268	valid_0's binary_logloss: 0.279722	valid_1's auc: 0.907437	valid_1's binary_logloss: 0.317429
[90]	valid_0's auc: 0.933578	valid_0's binary_logloss: 0.279235	valid_1's auc: 0.907348	valid_1's binary_logloss: 0.317581
[91]	valid_0's auc: 0.933811	valid_0's binary_logloss: 0.27882	valid_1's auc: 0.907315	valid_1's binary_logloss: 0.317611
[92]	valid_0's auc: 0.934056	valid_0's binary_logloss: 0.278433	valid_1's auc: 0.907133	valid_1's binary_logloss: 0.31794
[93]	valid_0's auc: 0.93431	valid_0's binary_logloss: 0.277981	valid_1's auc: 0.907102	valid_1's binary_logloss: 0.318055
[94]	valid_0's auc: 0.934536	valid_0's binary_logloss: 0.277576	valid_1's auc: 0.907082	valid_1's binary_logloss: 0.318089
[95]	valid_0's auc: 0.934716	valid_0's binary_logloss: 0.277207	valid_1's auc: 0.906958	valid_1's binary_logloss: 0.318325
[96]	valid_0's auc: 0.934963	valid_0's binary_logloss: 0.276777	valid_1's auc: 0.90679	valid_1's binary_logloss: 0.318619
[97]	valid_0's auc: 0.935154	valid_0's binary_logloss: 0.27644	valid_1's auc: 0.906821	valid_1's binary_logloss: 0.318573
[98]	valid_0's auc: 0.935331	valid_0's binary_logloss: 0.276092	valid_1's auc: 0.90682	valid_1's binary_logloss: 0.318596
[99]	valid_0's auc: 0.935551	valid_0's binary_logloss: 0.275718	valid_1's auc: 0.906756	valid_1's binary_logloss: 0.318675
[100]	valid_0's auc: 0.935703	valid_0's binary_logloss: 0.275432	valid_1's auc: 0.906713	valid_1's binary_logloss: 0.318756
[101]	valid_0's auc: 0.935971	valid_0's binary_logloss: 0.274964	valid_1's auc: 0.906709	valid_1's binary_logloss: 0.318763
[102]	valid_0's auc: 0.936122	valid_0's binary_logloss: 0.274672	valid_1's auc: 0.906708	valid_1's binary_logloss: 0.318826
[103]	valid_0's auc: 0.936445	valid_0's binary_logloss: 0.274133	valid_1's auc: 0.906643	valid_1's binary_logloss: 0.318924
[104]	valid_0's auc: 0.936552	valid_0's binary_logloss: 0.273882	valid_1's auc: 0.906559	valid_1's binary_logloss: 0.319105
[105]	valid_0's auc: 0.936802	valid_0's binary_logloss: 0.273445	valid_1's auc: 0.906508	valid_1's binary_logloss: 0.319186
[106]	valid_0's auc: 0.937097	valid_0's binary_logloss: 0.272911	valid_1's auc: 0.906528	valid_1's binary_logloss: 0.319203
[107]	valid_0's auc: 0.937274	valid_0's binary_logloss: 0.272599	valid_1's auc: 0.906472	valid_1's binary_logloss: 0.319307
[108]	valid_0's auc: 0.937507	valid_0's binary_logloss: 0.272183	valid_1's auc: 0.906424	valid_1's binary_logloss: 0.319428
[109]	valid_0's auc: 0.937707	valid_0's binary_logloss: 0.271832	valid_1's auc: 0.906388	valid_1's binary_logloss: 0.31954
[110]	valid_0's auc: 0.937923	valid_0's binary_logloss: 0.271456	valid_1's auc: 0.906391	valid_1's binary_logloss: 0.319552
[111]	valid_0's auc: 0.938102	valid_0's binary_logloss: 0.271149	valid_1's auc: 0.906285	valid_1's binary_logloss: 0.319742
[112]	valid_0's auc: 0.938209	valid_0's binary_logloss: 0.270949	valid_1's auc: 0.906234	valid_1's binary_logloss: 0.319862
[113]	valid_0's auc: 0.93842	valid_0's binary_logloss: 0.270576	valid_1's auc: 0.906244	valid_1's binary_logloss: 0.319867
[114]	valid_0's auc: 0.938569	valid_0's binary_logloss: 0.270294	valid_1's auc: 0.906278	valid_1's binary_logloss: 0.319839
[115]	valid_0's auc: 0.938688	valid_0's binary_logloss: 0.270037	valid_1's auc: 0.906242	valid_1's binary_logloss: 0.319908
[116]	valid_0's auc: 0.938896	valid_0's binary_logloss: 0.269652	valid_1's auc: 0.90611	valid_1's binary_logloss: 0.320203
[117]	valid_0's auc: 0.939094	valid_0's binary_logloss: 0.269305	valid_1's auc: 0.906165	valid_1's binary_logloss: 0.320134
[118]	valid_0's auc: 0.939305	valid_0's binary_logloss: 0.268941	valid_1's auc: 0.906116	valid_1's binary_logloss: 0.320222
[119]	valid_0's auc: 0.939563	valid_0's binary_logloss: 0.268511	valid_1's auc: 0.906066	valid_1's binary_logloss: 0.320335
[120]	valid_0's auc: 0.939736	valid_0's binary_logloss: 0.26819	valid_1's auc: 0.906008	valid_1's binary_logloss: 0.320452
[121]	valid_0's auc: 0.94	valid_0's binary_logloss: 0.26772	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.320571
[122]	valid_0's auc: 0.94016	valid_0's binary_logloss: 0.267434	valid_1's auc: 0.905825	valid_1's binary_logloss: 0.320743
[123]	valid_0's auc: 0.940332	valid_0's binary_logloss: 0.267127	valid_1's auc: 0.905755	valid_1's binary_logloss: 0.320953
[124]	valid_0's auc: 0.940525	valid_0's binary_logloss: 0.266806	valid_1's auc: 0.905679	valid_1's binary_logloss: 0.32108
[125]	valid_0's auc: 0.940715	valid_0's binary_logloss: 0.266472	valid_1's auc: 0.905571	valid_1's binary_logloss: 0.321309
[126]	valid_0's auc: 0.940836	valid_0's binary_logloss: 0.266243	valid_1's auc: 0.905495	valid_1's binary_logloss: 0.321425
[127]	valid_0's auc: 0.941064	valid_0's binary_logloss: 0.265856	valid_1's auc: 0.905434	valid_1's binary_logloss: 0.321532
[128]	valid_0's auc: 0.941224	valid_0's binary_logloss: 0.265551	valid_1's auc: 0.905334	valid_1's binary_logloss: 0.321726
[129]	valid_0's auc: 0.941359	valid_0's binary_logloss: 0.265285	valid_1's auc: 0.905325	valid_1's binary_logloss: 0.321762
[130]	valid_0's auc: 0.941514	valid_0's binary_logloss: 0.264987	valid_1's auc: 0.905316	valid_1's binary_logloss: 0.321854
[131]	valid_0's auc: 0.941738	valid_0's binary_logloss: 0.264522	valid_1's auc: 0.905137	valid_1's binary_logloss: 0.322147
[132]	valid_0's auc: 0.94193	valid_0's binary_logloss: 0.264174	valid_1's auc: 0.905037	valid_1's binary_logloss: 0.322331
[133]	valid_0's auc: 0.942074	valid_0's binary_logloss: 0.263901	valid_1's auc: 0.904998	valid_1's binary_logloss: 0.322416
[134]	valid_0's auc: 0.942227	valid_0's binary_logloss: 0.263602	valid_1's auc: 0.90495	valid_1's binary_logloss: 0.322561
[135]	valid_0's auc: 0.94233	valid_0's binary_logloss: 0.263395	valid_1's auc: 0.904897	valid_1's binary_logloss: 0.322654
[136]	valid_0's auc: 0.942481	valid_0's binary_logloss: 0.263095	valid_1's auc: 0.904914	valid_1's binary_logloss: 0.322678
[137]	valid_0's auc: 0.942574	valid_0's binary_logloss: 0.262914	valid_1's auc: 0.904842	valid_1's binary_logloss: 0.322822
[138]	valid_0's auc: 0.942714	valid_0's binary_logloss: 0.262657	valid_1's auc: 0.904771	valid_1's binary_logloss: 0.322965
[139]	valid_0's auc: 0.942802	valid_0's binary_logloss: 0.262495	valid_1's auc: 0.904759	valid_1's binary_logloss: 0.322993
[140]	valid_0's auc: 0.94294	valid_0's binary_logloss: 0.262228	valid_1's auc: 0.904755	valid_1's binary_logloss: 0.322994
[141]	valid_0's auc: 0.943106	valid_0's binary_logloss: 0.261955	valid_1's auc: 0.904734	valid_1's binary_logloss: 0.323056
[142]	valid_0's auc: 0.943252	valid_0's binary_logloss: 0.261685	valid_1's auc: 0.90472	valid_1's binary_logloss: 0.323073
[143]	valid_0's auc: 0.943421	valid_0's binary_logloss: 0.261357	valid_1's auc: 0.904722	valid_1's binary_logloss: 0.323114
[144]	valid_0's auc: 0.943598	valid_0's binary_logloss: 0.261024	valid_1's auc: 0.904742	valid_1's binary_logloss: 0.323141
Early stopping, best iteration is:
[44]	valid_0's auc: 0.920209	valid_0's binary_logloss: 0.303334	valid_1's auc: 0.909828	valid_1's binary_logloss: 0.314251
[1]	valid_0's auc: 0.887858	valid_0's binary_logloss: 0.516982	valid_1's auc: 0.894799	valid_1's binary_logloss: 0.508124
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89299	valid_0's binary_logloss: 0.488143	valid_1's auc: 0.899409	valid_1's binary_logloss: 0.478442
[3]	valid_0's auc: 0.894141	valid_0's binary_logloss: 0.464911	valid_1's auc: 0.900492	valid_1's binary_logloss: 0.454848
[4]	valid_0's auc: 0.89588	valid_0's binary_logloss: 0.445631	valid_1's auc: 0.9015	valid_1's binary_logloss: 0.435366
[5]	valid_0's auc: 0.896282	valid_0's binary_logloss: 0.429671	valid_1's auc: 0.902121	valid_1's binary_logloss: 0.419464
[6]	valid_0's auc: 0.897771	valid_0's binary_logloss: 0.415866	valid_1's auc: 0.903603	valid_1's binary_logloss: 0.405593
[7]	valid_0's auc: 0.898298	valid_0's binary_logloss: 0.404446	valid_1's auc: 0.903454	valid_1's binary_logloss: 0.394188
[8]	valid_0's auc: 0.899715	valid_0's binary_logloss: 0.394436	valid_1's auc: 0.904238	valid_1's binary_logloss: 0.384318
[9]	valid_0's auc: 0.900608	valid_0's binary_logloss: 0.385658	valid_1's auc: 0.904344	valid_1's binary_logloss: 0.376143
[10]	valid_0's auc: 0.901136	valid_0's binary_logloss: 0.3781	valid_1's auc: 0.904404	valid_1's binary_logloss: 0.369012
[11]	valid_0's auc: 0.901863	valid_0's binary_logloss: 0.371331	valid_1's auc: 0.904849	valid_1's binary_logloss: 0.362564
[12]	valid_0's auc: 0.902708	valid_0's binary_logloss: 0.365396	valid_1's auc: 0.9053	valid_1's binary_logloss: 0.356977
[13]	valid_0's auc: 0.903652	valid_0's binary_logloss: 0.360065	valid_1's auc: 0.905847	valid_1's binary_logloss: 0.351861
[14]	valid_0's auc: 0.904118	valid_0's binary_logloss: 0.355455	valid_1's auc: 0.905985	valid_1's binary_logloss: 0.347625
[15]	valid_0's auc: 0.905174	valid_0's binary_logloss: 0.351053	valid_1's auc: 0.9063	valid_1's binary_logloss: 0.343845
[16]	valid_0's auc: 0.905837	valid_0's binary_logloss: 0.347335	valid_1's auc: 0.906851	valid_1's binary_logloss: 0.340347
[17]	valid_0's auc: 0.906471	valid_0's binary_logloss: 0.343917	valid_1's auc: 0.907365	valid_1's binary_logloss: 0.337309
[18]	valid_0's auc: 0.907256	valid_0's binary_logloss: 0.340601	valid_1's auc: 0.907452	valid_1's binary_logloss: 0.334769
[19]	valid_0's auc: 0.908235	valid_0's binary_logloss: 0.337502	valid_1's auc: 0.9078	valid_1's binary_logloss: 0.332421
[20]	valid_0's auc: 0.908872	valid_0's binary_logloss: 0.334805	valid_1's auc: 0.908089	valid_1's binary_logloss: 0.330319
[21]	valid_0's auc: 0.909594	valid_0's binary_logloss: 0.332301	valid_1's auc: 0.908017	valid_1's binary_logloss: 0.328702
[22]	valid_0's auc: 0.910224	valid_0's binary_logloss: 0.329973	valid_1's auc: 0.908008	valid_1's binary_logloss: 0.32727
[23]	valid_0's auc: 0.910747	valid_0's binary_logloss: 0.327887	valid_1's auc: 0.908244	valid_1's binary_logloss: 0.325638
[24]	valid_0's auc: 0.911358	valid_0's binary_logloss: 0.325813	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.32415
[25]	valid_0's auc: 0.911934	valid_0's binary_logloss: 0.323984	valid_1's auc: 0.908846	valid_1's binary_logloss: 0.322893
[26]	valid_0's auc: 0.912521	valid_0's binary_logloss: 0.322275	valid_1's auc: 0.908901	valid_1's binary_logloss: 0.321977
[27]	valid_0's auc: 0.912976	valid_0's binary_logloss: 0.320789	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.320969
[28]	valid_0's auc: 0.913467	valid_0's binary_logloss: 0.319337	valid_1's auc: 0.909135	valid_1's binary_logloss: 0.320209
[29]	valid_0's auc: 0.91389	valid_0's binary_logloss: 0.318008	valid_1's auc: 0.909267	valid_1's binary_logloss: 0.319489
[30]	valid_0's auc: 0.914386	valid_0's binary_logloss: 0.316659	valid_1's auc: 0.90937	valid_1's binary_logloss: 0.318817
[31]	valid_0's auc: 0.91489	valid_0's binary_logloss: 0.31542	valid_1's auc: 0.909339	valid_1's binary_logloss: 0.318459
[32]	valid_0's auc: 0.915437	valid_0's binary_logloss: 0.314124	valid_1's auc: 0.909391	valid_1's binary_logloss: 0.31793
[33]	valid_0's auc: 0.915858	valid_0's binary_logloss: 0.312972	valid_1's auc: 0.909363	valid_1's binary_logloss: 0.317511
[34]	valid_0's auc: 0.91629	valid_0's binary_logloss: 0.311916	valid_1's auc: 0.909455	valid_1's binary_logloss: 0.317059
[35]	valid_0's auc: 0.91669	valid_0's binary_logloss: 0.310951	valid_1's auc: 0.909558	valid_1's binary_logloss: 0.316719
[36]	valid_0's auc: 0.917101	valid_0's binary_logloss: 0.309966	valid_1's auc: 0.909678	valid_1's binary_logloss: 0.316232
[37]	valid_0's auc: 0.917539	valid_0's binary_logloss: 0.308975	valid_1's auc: 0.909739	valid_1's binary_logloss: 0.315892
[38]	valid_0's auc: 0.917896	valid_0's binary_logloss: 0.308095	valid_1's auc: 0.909706	valid_1's binary_logloss: 0.315721
[39]	valid_0's auc: 0.918278	valid_0's binary_logloss: 0.30725	valid_1's auc: 0.909698	valid_1's binary_logloss: 0.315512
[40]	valid_0's auc: 0.918713	valid_0's binary_logloss: 0.306311	valid_1's auc: 0.909672	valid_1's binary_logloss: 0.315361
[41]	valid_0's auc: 0.919118	valid_0's binary_logloss: 0.305472	valid_1's auc: 0.909665	valid_1's binary_logloss: 0.315161
[42]	valid_0's auc: 0.919496	valid_0's binary_logloss: 0.304681	valid_1's auc: 0.909659	valid_1's binary_logloss: 0.315056
[43]	valid_0's auc: 0.919897	valid_0's binary_logloss: 0.303848	valid_1's auc: 0.90978	valid_1's binary_logloss: 0.314764
[44]	valid_0's auc: 0.920208	valid_0's binary_logloss: 0.303142	valid_1's auc: 0.909865	valid_1's binary_logloss: 0.314563
[45]	valid_0's auc: 0.920584	valid_0's binary_logloss: 0.302337	valid_1's auc: 0.909965	valid_1's binary_logloss: 0.314285
[46]	valid_0's auc: 0.920847	valid_0's binary_logloss: 0.301757	valid_1's auc: 0.909803	valid_1's binary_logloss: 0.314436
[47]	valid_0's auc: 0.921232	valid_0's binary_logloss: 0.301022	valid_1's auc: 0.909838	valid_1's binary_logloss: 0.314278
[48]	valid_0's auc: 0.921591	valid_0's binary_logloss: 0.300325	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.313965
[49]	valid_0's auc: 0.921906	valid_0's binary_logloss: 0.299717	valid_1's auc: 0.909965	valid_1's binary_logloss: 0.314039
[50]	valid_0's auc: 0.922223	valid_0's binary_logloss: 0.29908	valid_1's auc: 0.910008	valid_1's binary_logloss: 0.313998
[51]	valid_0's auc: 0.922437	valid_0's binary_logloss: 0.298624	valid_1's auc: 0.910057	valid_1's binary_logloss: 0.313852
[52]	valid_0's auc: 0.922748	valid_0's binary_logloss: 0.29801	valid_1's auc: 0.910051	valid_1's binary_logloss: 0.31389
[53]	valid_0's auc: 0.923108	valid_0's binary_logloss: 0.297392	valid_1's auc: 0.910117	valid_1's binary_logloss: 0.313776
[54]	valid_0's auc: 0.923461	valid_0's binary_logloss: 0.29669	valid_1's auc: 0.910151	valid_1's binary_logloss: 0.313701
[55]	valid_0's auc: 0.923771	valid_0's binary_logloss: 0.29611	valid_1's auc: 0.910133	valid_1's binary_logloss: 0.313685
[56]	valid_0's auc: 0.924143	valid_0's binary_logloss: 0.295489	valid_1's auc: 0.910108	valid_1's binary_logloss: 0.313653
[57]	valid_0's auc: 0.924412	valid_0's binary_logloss: 0.294953	valid_1's auc: 0.910025	valid_1's binary_logloss: 0.313777
[58]	valid_0's auc: 0.924675	valid_0's binary_logloss: 0.294422	valid_1's auc: 0.910004	valid_1's binary_logloss: 0.313838
[59]	valid_0's auc: 0.925033	valid_0's binary_logloss: 0.293831	valid_1's auc: 0.909969	valid_1's binary_logloss: 0.313818
[60]	valid_0's auc: 0.92533	valid_0's binary_logloss: 0.29332	valid_1's auc: 0.909916	valid_1's binary_logloss: 0.313849
[61]	valid_0's auc: 0.92563	valid_0's binary_logloss: 0.292811	valid_1's auc: 0.909975	valid_1's binary_logloss: 0.313774
[62]	valid_0's auc: 0.925959	valid_0's binary_logloss: 0.292263	valid_1's auc: 0.909875	valid_1's binary_logloss: 0.313907
[63]	valid_0's auc: 0.92625	valid_0's binary_logloss: 0.291763	valid_1's auc: 0.909735	valid_1's binary_logloss: 0.314072
[64]	valid_0's auc: 0.926615	valid_0's binary_logloss: 0.291124	valid_1's auc: 0.909831	valid_1's binary_logloss: 0.314019
[65]	valid_0's auc: 0.9269	valid_0's binary_logloss: 0.290634	valid_1's auc: 0.909712	valid_1's binary_logloss: 0.31417
[66]	valid_0's auc: 0.927176	valid_0's binary_logloss: 0.290144	valid_1's auc: 0.909653	valid_1's binary_logloss: 0.314297
[67]	valid_0's auc: 0.927475	valid_0's binary_logloss: 0.289601	valid_1's auc: 0.909627	valid_1's binary_logloss: 0.314297
[68]	valid_0's auc: 0.927737	valid_0's binary_logloss: 0.289128	valid_1's auc: 0.909567	valid_1's binary_logloss: 0.314381
[69]	valid_0's auc: 0.927992	valid_0's binary_logloss: 0.288703	valid_1's auc: 0.909555	valid_1's binary_logloss: 0.314401
[70]	valid_0's auc: 0.928289	valid_0's binary_logloss: 0.288195	valid_1's auc: 0.909541	valid_1's binary_logloss: 0.314416
[71]	valid_0's auc: 0.928536	valid_0's binary_logloss: 0.287792	valid_1's auc: 0.909553	valid_1's binary_logloss: 0.31446
[72]	valid_0's auc: 0.928762	valid_0's binary_logloss: 0.287342	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.314597
[73]	valid_0's auc: 0.928952	valid_0's binary_logloss: 0.287026	valid_1's auc: 0.909376	valid_1's binary_logloss: 0.314723
[74]	valid_0's auc: 0.929177	valid_0's binary_logloss: 0.286609	valid_1's auc: 0.90947	valid_1's binary_logloss: 0.314605
[75]	valid_0's auc: 0.929403	valid_0's binary_logloss: 0.286186	valid_1's auc: 0.909439	valid_1's binary_logloss: 0.314555
[76]	valid_0's auc: 0.92966	valid_0's binary_logloss: 0.285743	valid_1's auc: 0.909286	valid_1's binary_logloss: 0.314761
[77]	valid_0's auc: 0.929892	valid_0's binary_logloss: 0.285335	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.314973
[78]	valid_0's auc: 0.930102	valid_0's binary_logloss: 0.284942	valid_1's auc: 0.909238	valid_1's binary_logloss: 0.314816
[79]	valid_0's auc: 0.930359	valid_0's binary_logloss: 0.28449	valid_1's auc: 0.909314	valid_1's binary_logloss: 0.314745
[80]	valid_0's auc: 0.930605	valid_0's binary_logloss: 0.284043	valid_1's auc: 0.909319	valid_1's binary_logloss: 0.314764
[81]	valid_0's auc: 0.930858	valid_0's binary_logloss: 0.283639	valid_1's auc: 0.909251	valid_1's binary_logloss: 0.314894
[82]	valid_0's auc: 0.93109	valid_0's binary_logloss: 0.283259	valid_1's auc: 0.909192	valid_1's binary_logloss: 0.315016
[83]	valid_0's auc: 0.931288	valid_0's binary_logloss: 0.282907	valid_1's auc: 0.909177	valid_1's binary_logloss: 0.315086
[84]	valid_0's auc: 0.931528	valid_0's binary_logloss: 0.282472	valid_1's auc: 0.909101	valid_1's binary_logloss: 0.315203
[85]	valid_0's auc: 0.931882	valid_0's binary_logloss: 0.281893	valid_1's auc: 0.90901	valid_1's binary_logloss: 0.315411
[86]	valid_0's auc: 0.932096	valid_0's binary_logloss: 0.281512	valid_1's auc: 0.908926	valid_1's binary_logloss: 0.315512
[87]	valid_0's auc: 0.932312	valid_0's binary_logloss: 0.281144	valid_1's auc: 0.90896	valid_1's binary_logloss: 0.315451
[88]	valid_0's auc: 0.932578	valid_0's binary_logloss: 0.280703	valid_1's auc: 0.908807	valid_1's binary_logloss: 0.315679
[89]	valid_0's auc: 0.932796	valid_0's binary_logloss: 0.280304	valid_1's auc: 0.908747	valid_1's binary_logloss: 0.315858
[90]	valid_0's auc: 0.933043	valid_0's binary_logloss: 0.279893	valid_1's auc: 0.908682	valid_1's binary_logloss: 0.315979
[91]	valid_0's auc: 0.933249	valid_0's binary_logloss: 0.279505	valid_1's auc: 0.908706	valid_1's binary_logloss: 0.316005
[92]	valid_0's auc: 0.933471	valid_0's binary_logloss: 0.279112	valid_1's auc: 0.908613	valid_1's binary_logloss: 0.316205
[93]	valid_0's auc: 0.933674	valid_0's binary_logloss: 0.278766	valid_1's auc: 0.908529	valid_1's binary_logloss: 0.316364
[94]	valid_0's auc: 0.93394	valid_0's binary_logloss: 0.278338	valid_1's auc: 0.908547	valid_1's binary_logloss: 0.316338
[95]	valid_0's auc: 0.934207	valid_0's binary_logloss: 0.277905	valid_1's auc: 0.908537	valid_1's binary_logloss: 0.316385
[96]	valid_0's auc: 0.934451	valid_0's binary_logloss: 0.277514	valid_1's auc: 0.908539	valid_1's binary_logloss: 0.316357
[97]	valid_0's auc: 0.934682	valid_0's binary_logloss: 0.277104	valid_1's auc: 0.908538	valid_1's binary_logloss: 0.316353
[98]	valid_0's auc: 0.934874	valid_0's binary_logloss: 0.276757	valid_1's auc: 0.908432	valid_1's binary_logloss: 0.316542
[99]	valid_0's auc: 0.935147	valid_0's binary_logloss: 0.276294	valid_1's auc: 0.908382	valid_1's binary_logloss: 0.316668
[100]	valid_0's auc: 0.935354	valid_0's binary_logloss: 0.275957	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.316684
[101]	valid_0's auc: 0.935573	valid_0's binary_logloss: 0.275569	valid_1's auc: 0.908346	valid_1's binary_logloss: 0.316747
[102]	valid_0's auc: 0.935877	valid_0's binary_logloss: 0.275109	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316928
[103]	valid_0's auc: 0.936071	valid_0's binary_logloss: 0.274759	valid_1's auc: 0.908149	valid_1's binary_logloss: 0.317081
[104]	valid_0's auc: 0.936236	valid_0's binary_logloss: 0.27443	valid_1's auc: 0.908112	valid_1's binary_logloss: 0.317146
[105]	valid_0's auc: 0.936516	valid_0's binary_logloss: 0.273983	valid_1's auc: 0.908063	valid_1's binary_logloss: 0.317268
[106]	valid_0's auc: 0.936685	valid_0's binary_logloss: 0.273696	valid_1's auc: 0.908046	valid_1's binary_logloss: 0.317344
[107]	valid_0's auc: 0.936861	valid_0's binary_logloss: 0.273377	valid_1's auc: 0.907985	valid_1's binary_logloss: 0.317433
[108]	valid_0's auc: 0.937086	valid_0's binary_logloss: 0.272946	valid_1's auc: 0.907984	valid_1's binary_logloss: 0.317504
[109]	valid_0's auc: 0.937219	valid_0's binary_logloss: 0.272681	valid_1's auc: 0.907932	valid_1's binary_logloss: 0.317572
[110]	valid_0's auc: 0.937446	valid_0's binary_logloss: 0.272298	valid_1's auc: 0.908085	valid_1's binary_logloss: 0.317359
[111]	valid_0's auc: 0.93767	valid_0's binary_logloss: 0.271916	valid_1's auc: 0.908054	valid_1's binary_logloss: 0.317448
[112]	valid_0's auc: 0.93786	valid_0's binary_logloss: 0.271547	valid_1's auc: 0.908056	valid_1's binary_logloss: 0.317463
[113]	valid_0's auc: 0.938059	valid_0's binary_logloss: 0.271195	valid_1's auc: 0.907988	valid_1's binary_logloss: 0.317603
[114]	valid_0's auc: 0.938328	valid_0's binary_logloss: 0.270765	valid_1's auc: 0.908062	valid_1's binary_logloss: 0.317511
[115]	valid_0's auc: 0.938482	valid_0's binary_logloss: 0.27045	valid_1's auc: 0.907971	valid_1's binary_logloss: 0.317708
[116]	valid_0's auc: 0.938641	valid_0's binary_logloss: 0.270165	valid_1's auc: 0.908024	valid_1's binary_logloss: 0.317638
[117]	valid_0's auc: 0.93882	valid_0's binary_logloss: 0.269833	valid_1's auc: 0.907872	valid_1's binary_logloss: 0.317913
[118]	valid_0's auc: 0.939016	valid_0's binary_logloss: 0.269483	valid_1's auc: 0.907823	valid_1's binary_logloss: 0.318012
[119]	valid_0's auc: 0.93915	valid_0's binary_logloss: 0.269227	valid_1's auc: 0.907886	valid_1's binary_logloss: 0.31793
[120]	valid_0's auc: 0.939398	valid_0's binary_logloss: 0.268788	valid_1's auc: 0.907903	valid_1's binary_logloss: 0.317935
[121]	valid_0's auc: 0.939622	valid_0's binary_logloss: 0.268419	valid_1's auc: 0.907859	valid_1's binary_logloss: 0.318049
[122]	valid_0's auc: 0.939807	valid_0's binary_logloss: 0.268083	valid_1's auc: 0.907712	valid_1's binary_logloss: 0.31831
[123]	valid_0's auc: 0.940023	valid_0's binary_logloss: 0.267743	valid_1's auc: 0.907647	valid_1's binary_logloss: 0.318431
[124]	valid_0's auc: 0.940253	valid_0's binary_logloss: 0.267345	valid_1's auc: 0.90768	valid_1's binary_logloss: 0.318389
[125]	valid_0's auc: 0.940481	valid_0's binary_logloss: 0.266924	valid_1's auc: 0.907582	valid_1's binary_logloss: 0.318566
[126]	valid_0's auc: 0.940765	valid_0's binary_logloss: 0.266447	valid_1's auc: 0.90748	valid_1's binary_logloss: 0.318789
[127]	valid_0's auc: 0.940918	valid_0's binary_logloss: 0.266162	valid_1's auc: 0.907377	valid_1's binary_logloss: 0.318996
[128]	valid_0's auc: 0.94106	valid_0's binary_logloss: 0.265904	valid_1's auc: 0.907299	valid_1's binary_logloss: 0.31911
[129]	valid_0's auc: 0.941259	valid_0's binary_logloss: 0.265552	valid_1's auc: 0.907239	valid_1's binary_logloss: 0.319229
[130]	valid_0's auc: 0.941426	valid_0's binary_logloss: 0.265265	valid_1's auc: 0.907212	valid_1's binary_logloss: 0.319355
[131]	valid_0's auc: 0.941635	valid_0's binary_logloss: 0.264882	valid_1's auc: 0.907119	valid_1's binary_logloss: 0.319548
[132]	valid_0's auc: 0.941824	valid_0's binary_logloss: 0.264546	valid_1's auc: 0.907	valid_1's binary_logloss: 0.31971
[133]	valid_0's auc: 0.941995	valid_0's binary_logloss: 0.264228	valid_1's auc: 0.907065	valid_1's binary_logloss: 0.319602
[134]	valid_0's auc: 0.942206	valid_0's binary_logloss: 0.263852	valid_1's auc: 0.907003	valid_1's binary_logloss: 0.319761
[135]	valid_0's auc: 0.942405	valid_0's binary_logloss: 0.263498	valid_1's auc: 0.90687	valid_1's binary_logloss: 0.319971
[136]	valid_0's auc: 0.942579	valid_0's binary_logloss: 0.263178	valid_1's auc: 0.906824	valid_1's binary_logloss: 0.320108
[137]	valid_0's auc: 0.942714	valid_0's binary_logloss: 0.262896	valid_1's auc: 0.906812	valid_1's binary_logloss: 0.320178
[138]	valid_0's auc: 0.942912	valid_0's binary_logloss: 0.262558	valid_1's auc: 0.906727	valid_1's binary_logloss: 0.320392
[139]	valid_0's auc: 0.943087	valid_0's binary_logloss: 0.262212	valid_1's auc: 0.90667	valid_1's binary_logloss: 0.320541
[140]	valid_0's auc: 0.943238	valid_0's binary_logloss: 0.26193	valid_1's auc: 0.906599	valid_1's binary_logloss: 0.320653
[141]	valid_0's auc: 0.943367	valid_0's binary_logloss: 0.261682	valid_1's auc: 0.906569	valid_1's binary_logloss: 0.32071
[142]	valid_0's auc: 0.943503	valid_0's binary_logloss: 0.26142	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.320854
[143]	valid_0's auc: 0.94366	valid_0's binary_logloss: 0.261129	valid_1's auc: 0.906485	valid_1's binary_logloss: 0.320922
[144]	valid_0's auc: 0.943837	valid_0's binary_logloss: 0.260813	valid_1's auc: 0.9065	valid_1's binary_logloss: 0.320924
[145]	valid_0's auc: 0.944012	valid_0's binary_logloss: 0.260511	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.320913
[146]	valid_0's auc: 0.944149	valid_0's binary_logloss: 0.260234	valid_1's auc: 0.90648	valid_1's binary_logloss: 0.321018
[147]	valid_0's auc: 0.944309	valid_0's binary_logloss: 0.259952	valid_1's auc: 0.90644	valid_1's binary_logloss: 0.321111
[148]	valid_0's auc: 0.944464	valid_0's binary_logloss: 0.259657	valid_1's auc: 0.906347	valid_1's binary_logloss: 0.321293
[149]	valid_0's auc: 0.944624	valid_0's binary_logloss: 0.259346	valid_1's auc: 0.906303	valid_1's binary_logloss: 0.321377
[150]	valid_0's auc: 0.944761	valid_0's binary_logloss: 0.259101	valid_1's auc: 0.906255	valid_1's binary_logloss: 0.321474
[151]	valid_0's auc: 0.944956	valid_0's binary_logloss: 0.258766	valid_1's auc: 0.906216	valid_1's binary_logloss: 0.321581
[152]	valid_0's auc: 0.945089	valid_0's binary_logloss: 0.258515	valid_1's auc: 0.906178	valid_1's binary_logloss: 0.321742
[153]	valid_0's auc: 0.945255	valid_0's binary_logloss: 0.258214	valid_1's auc: 0.906133	valid_1's binary_logloss: 0.321878
[154]	valid_0's auc: 0.94543	valid_0's binary_logloss: 0.257867	valid_1's auc: 0.906108	valid_1's binary_logloss: 0.321994
Early stopping, best iteration is:
[54]	valid_0's auc: 0.923461	valid_0's binary_logloss: 0.29669	valid_1's auc: 0.910151	valid_1's binary_logloss: 0.313701
[1]	valid_0's auc: 0.886572	valid_0's binary_logloss: 0.517393	valid_1's auc: 0.891691	valid_1's binary_logloss: 0.508845
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.889325	valid_0's binary_logloss: 0.48844	valid_1's auc: 0.895182	valid_1's binary_logloss: 0.47942
[3]	valid_0's auc: 0.890907	valid_0's binary_logloss: 0.465197	valid_1's auc: 0.896562	valid_1's binary_logloss: 0.455809
[4]	valid_0's auc: 0.89514	valid_0's binary_logloss: 0.445768	valid_1's auc: 0.899296	valid_1's binary_logloss: 0.43648
[5]	valid_0's auc: 0.896951	valid_0's binary_logloss: 0.42971	valid_1's auc: 0.899718	valid_1's binary_logloss: 0.420604
[6]	valid_0's auc: 0.897889	valid_0's binary_logloss: 0.416111	valid_1's auc: 0.900881	valid_1's binary_logloss: 0.406931
[7]	valid_0's auc: 0.898689	valid_0's binary_logloss: 0.404436	valid_1's auc: 0.901422	valid_1's binary_logloss: 0.395411
[8]	valid_0's auc: 0.89958	valid_0's binary_logloss: 0.394345	valid_1's auc: 0.902597	valid_1's binary_logloss: 0.385225
[9]	valid_0's auc: 0.90032	valid_0's binary_logloss: 0.385639	valid_1's auc: 0.902948	valid_1's binary_logloss: 0.376863
[10]	valid_0's auc: 0.901296	valid_0's binary_logloss: 0.378042	valid_1's auc: 0.903458	valid_1's binary_logloss: 0.369727
[11]	valid_0's auc: 0.902004	valid_0's binary_logloss: 0.371306	valid_1's auc: 0.903438	valid_1's binary_logloss: 0.363518
[12]	valid_0's auc: 0.902758	valid_0's binary_logloss: 0.365335	valid_1's auc: 0.903948	valid_1's binary_logloss: 0.357923
[13]	valid_0's auc: 0.903856	valid_0's binary_logloss: 0.360044	valid_1's auc: 0.904456	valid_1's binary_logloss: 0.353137
[14]	valid_0's auc: 0.904376	valid_0's binary_logloss: 0.355393	valid_1's auc: 0.904877	valid_1's binary_logloss: 0.348708
[15]	valid_0's auc: 0.905155	valid_0's binary_logloss: 0.351161	valid_1's auc: 0.905329	valid_1's binary_logloss: 0.345105
[16]	valid_0's auc: 0.905871	valid_0's binary_logloss: 0.347288	valid_1's auc: 0.906045	valid_1's binary_logloss: 0.341559
[17]	valid_0's auc: 0.90683	valid_0's binary_logloss: 0.343704	valid_1's auc: 0.906619	valid_1's binary_logloss: 0.338621
[18]	valid_0's auc: 0.90744	valid_0's binary_logloss: 0.340595	valid_1's auc: 0.906705	valid_1's binary_logloss: 0.336005
[19]	valid_0's auc: 0.908245	valid_0's binary_logloss: 0.337639	valid_1's auc: 0.906863	valid_1's binary_logloss: 0.333835
[20]	valid_0's auc: 0.908769	valid_0's binary_logloss: 0.335121	valid_1's auc: 0.906857	valid_1's binary_logloss: 0.332
[21]	valid_0's auc: 0.909625	valid_0's binary_logloss: 0.332551	valid_1's auc: 0.90714	valid_1's binary_logloss: 0.330061
[22]	valid_0's auc: 0.910309	valid_0's binary_logloss: 0.330205	valid_1's auc: 0.907145	valid_1's binary_logloss: 0.328665
[23]	valid_0's auc: 0.910705	valid_0's binary_logloss: 0.32828	valid_1's auc: 0.907384	valid_1's binary_logloss: 0.327131
[24]	valid_0's auc: 0.911353	valid_0's binary_logloss: 0.326248	valid_1's auc: 0.907499	valid_1's binary_logloss: 0.325824
[25]	valid_0's auc: 0.911836	valid_0's binary_logloss: 0.324481	valid_1's auc: 0.907622	valid_1's binary_logloss: 0.324565
[26]	valid_0's auc: 0.912375	valid_0's binary_logloss: 0.322757	valid_1's auc: 0.90783	valid_1's binary_logloss: 0.323442
[27]	valid_0's auc: 0.912924	valid_0's binary_logloss: 0.321099	valid_1's auc: 0.907874	valid_1's binary_logloss: 0.322676
[28]	valid_0's auc: 0.91347	valid_0's binary_logloss: 0.319577	valid_1's auc: 0.907899	valid_1's binary_logloss: 0.321985
[29]	valid_0's auc: 0.913958	valid_0's binary_logloss: 0.31821	valid_1's auc: 0.908024	valid_1's binary_logloss: 0.321209
[30]	valid_0's auc: 0.91443	valid_0's binary_logloss: 0.316943	valid_1's auc: 0.908232	valid_1's binary_logloss: 0.320596
[31]	valid_0's auc: 0.914903	valid_0's binary_logloss: 0.315637	valid_1's auc: 0.90834	valid_1's binary_logloss: 0.319943
[32]	valid_0's auc: 0.915384	valid_0's binary_logloss: 0.314384	valid_1's auc: 0.908601	valid_1's binary_logloss: 0.3192
[33]	valid_0's auc: 0.915879	valid_0's binary_logloss: 0.313183	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.3187
[34]	valid_0's auc: 0.916305	valid_0's binary_logloss: 0.312159	valid_1's auc: 0.908582	valid_1's binary_logloss: 0.318644
[35]	valid_0's auc: 0.916796	valid_0's binary_logloss: 0.311066	valid_1's auc: 0.908637	valid_1's binary_logloss: 0.318277
[36]	valid_0's auc: 0.917228	valid_0's binary_logloss: 0.310009	valid_1's auc: 0.908673	valid_1's binary_logloss: 0.317932
[37]	valid_0's auc: 0.917693	valid_0's binary_logloss: 0.309012	valid_1's auc: 0.908599	valid_1's binary_logloss: 0.317805
[38]	valid_0's auc: 0.918077	valid_0's binary_logloss: 0.3081	valid_1's auc: 0.908552	valid_1's binary_logloss: 0.317626
[39]	valid_0's auc: 0.918494	valid_0's binary_logloss: 0.307161	valid_1's auc: 0.908505	valid_1's binary_logloss: 0.317462
[40]	valid_0's auc: 0.918873	valid_0's binary_logloss: 0.306342	valid_1's auc: 0.908445	valid_1's binary_logloss: 0.317409
[41]	valid_0's auc: 0.919317	valid_0's binary_logloss: 0.305478	valid_1's auc: 0.908498	valid_1's binary_logloss: 0.317195
[42]	valid_0's auc: 0.91965	valid_0's binary_logloss: 0.30475	valid_1's auc: 0.908487	valid_1's binary_logloss: 0.317133
[43]	valid_0's auc: 0.920116	valid_0's binary_logloss: 0.303866	valid_1's auc: 0.908577	valid_1's binary_logloss: 0.316906
[44]	valid_0's auc: 0.920516	valid_0's binary_logloss: 0.303054	valid_1's auc: 0.908687	valid_1's binary_logloss: 0.316662
[45]	valid_0's auc: 0.920884	valid_0's binary_logloss: 0.302318	valid_1's auc: 0.90864	valid_1's binary_logloss: 0.316669
[46]	valid_0's auc: 0.921198	valid_0's binary_logloss: 0.301623	valid_1's auc: 0.90866	valid_1's binary_logloss: 0.316548
[47]	valid_0's auc: 0.921574	valid_0's binary_logloss: 0.300925	valid_1's auc: 0.908568	valid_1's binary_logloss: 0.316636
[48]	valid_0's auc: 0.92195	valid_0's binary_logloss: 0.300223	valid_1's auc: 0.908527	valid_1's binary_logloss: 0.31662
[49]	valid_0's auc: 0.922292	valid_0's binary_logloss: 0.299574	valid_1's auc: 0.908485	valid_1's binary_logloss: 0.316606
[50]	valid_0's auc: 0.922599	valid_0's binary_logloss: 0.298975	valid_1's auc: 0.908336	valid_1's binary_logloss: 0.316756
[51]	valid_0's auc: 0.922904	valid_0's binary_logloss: 0.298393	valid_1's auc: 0.908268	valid_1's binary_logloss: 0.316796
[52]	valid_0's auc: 0.923173	valid_0's binary_logloss: 0.297868	valid_1's auc: 0.908223	valid_1's binary_logloss: 0.316831
[53]	valid_0's auc: 0.923494	valid_0's binary_logloss: 0.297269	valid_1's auc: 0.908369	valid_1's binary_logloss: 0.316578
[54]	valid_0's auc: 0.923776	valid_0's binary_logloss: 0.296719	valid_1's auc: 0.908342	valid_1's binary_logloss: 0.316604
[55]	valid_0's auc: 0.924074	valid_0's binary_logloss: 0.296172	valid_1's auc: 0.908279	valid_1's binary_logloss: 0.316695
[56]	valid_0's auc: 0.924404	valid_0's binary_logloss: 0.295522	valid_1's auc: 0.908107	valid_1's binary_logloss: 0.316946
[57]	valid_0's auc: 0.924636	valid_0's binary_logloss: 0.295046	valid_1's auc: 0.907951	valid_1's binary_logloss: 0.317125
[58]	valid_0's auc: 0.924956	valid_0's binary_logloss: 0.29449	valid_1's auc: 0.907876	valid_1's binary_logloss: 0.317248
[59]	valid_0's auc: 0.925277	valid_0's binary_logloss: 0.293933	valid_1's auc: 0.907847	valid_1's binary_logloss: 0.317275
[60]	valid_0's auc: 0.925582	valid_0's binary_logloss: 0.293352	valid_1's auc: 0.90788	valid_1's binary_logloss: 0.317224
[61]	valid_0's auc: 0.925932	valid_0's binary_logloss: 0.292664	valid_1's auc: 0.907804	valid_1's binary_logloss: 0.317283
[62]	valid_0's auc: 0.926218	valid_0's binary_logloss: 0.292181	valid_1's auc: 0.907688	valid_1's binary_logloss: 0.317483
[63]	valid_0's auc: 0.926535	valid_0's binary_logloss: 0.291632	valid_1's auc: 0.907716	valid_1's binary_logloss: 0.317408
[64]	valid_0's auc: 0.926836	valid_0's binary_logloss: 0.291102	valid_1's auc: 0.907587	valid_1's binary_logloss: 0.317652
[65]	valid_0's auc: 0.927096	valid_0's binary_logloss: 0.290613	valid_1's auc: 0.907418	valid_1's binary_logloss: 0.317955
[66]	valid_0's auc: 0.927366	valid_0's binary_logloss: 0.290133	valid_1's auc: 0.907262	valid_1's binary_logloss: 0.318164
[67]	valid_0's auc: 0.927637	valid_0's binary_logloss: 0.289646	valid_1's auc: 0.907153	valid_1's binary_logloss: 0.318378
[68]	valid_0's auc: 0.927977	valid_0's binary_logloss: 0.289063	valid_1's auc: 0.907238	valid_1's binary_logloss: 0.318297
[69]	valid_0's auc: 0.928214	valid_0's binary_logloss: 0.288657	valid_1's auc: 0.907058	valid_1's binary_logloss: 0.318544
[70]	valid_0's auc: 0.928511	valid_0's binary_logloss: 0.288107	valid_1's auc: 0.907062	valid_1's binary_logloss: 0.318522
[71]	valid_0's auc: 0.928789	valid_0's binary_logloss: 0.287604	valid_1's auc: 0.907083	valid_1's binary_logloss: 0.318488
[72]	valid_0's auc: 0.929052	valid_0's binary_logloss: 0.28715	valid_1's auc: 0.907062	valid_1's binary_logloss: 0.31854
[73]	valid_0's auc: 0.929319	valid_0's binary_logloss: 0.286661	valid_1's auc: 0.906949	valid_1's binary_logloss: 0.318797
[74]	valid_0's auc: 0.929563	valid_0's binary_logloss: 0.286196	valid_1's auc: 0.906901	valid_1's binary_logloss: 0.318853
[75]	valid_0's auc: 0.929889	valid_0's binary_logloss: 0.285631	valid_1's auc: 0.906947	valid_1's binary_logloss: 0.318743
[76]	valid_0's auc: 0.930216	valid_0's binary_logloss: 0.285076	valid_1's auc: 0.906948	valid_1's binary_logloss: 0.318746
[77]	valid_0's auc: 0.930476	valid_0's binary_logloss: 0.284605	valid_1's auc: 0.906829	valid_1's binary_logloss: 0.31894
[78]	valid_0's auc: 0.930737	valid_0's binary_logloss: 0.284159	valid_1's auc: 0.906662	valid_1's binary_logloss: 0.319251
[79]	valid_0's auc: 0.931012	valid_0's binary_logloss: 0.283689	valid_1's auc: 0.906611	valid_1's binary_logloss: 0.319318
[80]	valid_0's auc: 0.931224	valid_0's binary_logloss: 0.283324	valid_1's auc: 0.906605	valid_1's binary_logloss: 0.319411
[81]	valid_0's auc: 0.931426	valid_0's binary_logloss: 0.282919	valid_1's auc: 0.906538	valid_1's binary_logloss: 0.319531
[82]	valid_0's auc: 0.93168	valid_0's binary_logloss: 0.282495	valid_1's auc: 0.906572	valid_1's binary_logloss: 0.31954
[83]	valid_0's auc: 0.931906	valid_0's binary_logloss: 0.282067	valid_1's auc: 0.906576	valid_1's binary_logloss: 0.319515
[84]	valid_0's auc: 0.932209	valid_0's binary_logloss: 0.281589	valid_1's auc: 0.906471	valid_1's binary_logloss: 0.319707
[85]	valid_0's auc: 0.932458	valid_0's binary_logloss: 0.281136	valid_1's auc: 0.906493	valid_1's binary_logloss: 0.319683
[86]	valid_0's auc: 0.93267	valid_0's binary_logloss: 0.280763	valid_1's auc: 0.906514	valid_1's binary_logloss: 0.319621
[87]	valid_0's auc: 0.932985	valid_0's binary_logloss: 0.280229	valid_1's auc: 0.906398	valid_1's binary_logloss: 0.319778
[88]	valid_0's auc: 0.933221	valid_0's binary_logloss: 0.279814	valid_1's auc: 0.906386	valid_1's binary_logloss: 0.319862
[89]	valid_0's auc: 0.933444	valid_0's binary_logloss: 0.279428	valid_1's auc: 0.906342	valid_1's binary_logloss: 0.319928
[90]	valid_0's auc: 0.933666	valid_0's binary_logloss: 0.279032	valid_1's auc: 0.906244	valid_1's binary_logloss: 0.320102
[91]	valid_0's auc: 0.933882	valid_0's binary_logloss: 0.278644	valid_1's auc: 0.906239	valid_1's binary_logloss: 0.320146
[92]	valid_0's auc: 0.934078	valid_0's binary_logloss: 0.278276	valid_1's auc: 0.906142	valid_1's binary_logloss: 0.320347
[93]	valid_0's auc: 0.934326	valid_0's binary_logloss: 0.277813	valid_1's auc: 0.906138	valid_1's binary_logloss: 0.320289
[94]	valid_0's auc: 0.934562	valid_0's binary_logloss: 0.277381	valid_1's auc: 0.906055	valid_1's binary_logloss: 0.32045
[95]	valid_0's auc: 0.93478	valid_0's binary_logloss: 0.277	valid_1's auc: 0.905984	valid_1's binary_logloss: 0.320563
[96]	valid_0's auc: 0.935037	valid_0's binary_logloss: 0.276554	valid_1's auc: 0.905974	valid_1's binary_logloss: 0.320604
[97]	valid_0's auc: 0.93525	valid_0's binary_logloss: 0.276191	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320774
[98]	valid_0's auc: 0.93544	valid_0's binary_logloss: 0.275846	valid_1's auc: 0.905856	valid_1's binary_logloss: 0.320788
[99]	valid_0's auc: 0.935664	valid_0's binary_logloss: 0.275423	valid_1's auc: 0.90585	valid_1's binary_logloss: 0.320846
[100]	valid_0's auc: 0.93587	valid_0's binary_logloss: 0.275066	valid_1's auc: 0.905818	valid_1's binary_logloss: 0.320927
[101]	valid_0's auc: 0.936045	valid_0's binary_logloss: 0.274777	valid_1's auc: 0.905741	valid_1's binary_logloss: 0.321073
[102]	valid_0's auc: 0.936217	valid_0's binary_logloss: 0.274461	valid_1's auc: 0.905696	valid_1's binary_logloss: 0.321136
[103]	valid_0's auc: 0.936379	valid_0's binary_logloss: 0.274141	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.321133
[104]	valid_0's auc: 0.936625	valid_0's binary_logloss: 0.273748	valid_1's auc: 0.905711	valid_1's binary_logloss: 0.321145
[105]	valid_0's auc: 0.936834	valid_0's binary_logloss: 0.273334	valid_1's auc: 0.905695	valid_1's binary_logloss: 0.321218
[106]	valid_0's auc: 0.936996	valid_0's binary_logloss: 0.273053	valid_1's auc: 0.905661	valid_1's binary_logloss: 0.321309
[107]	valid_0's auc: 0.937146	valid_0's binary_logloss: 0.272786	valid_1's auc: 0.905607	valid_1's binary_logloss: 0.32144
[108]	valid_0's auc: 0.937399	valid_0's binary_logloss: 0.272323	valid_1's auc: 0.905645	valid_1's binary_logloss: 0.321355
[109]	valid_0's auc: 0.937668	valid_0's binary_logloss: 0.271874	valid_1's auc: 0.905537	valid_1's binary_logloss: 0.321551
[110]	valid_0's auc: 0.937873	valid_0's binary_logloss: 0.271538	valid_1's auc: 0.905392	valid_1's binary_logloss: 0.321796
[111]	valid_0's auc: 0.938162	valid_0's binary_logloss: 0.271044	valid_1's auc: 0.905453	valid_1's binary_logloss: 0.321749
[112]	valid_0's auc: 0.938408	valid_0's binary_logloss: 0.270629	valid_1's auc: 0.905507	valid_1's binary_logloss: 0.321649
[113]	valid_0's auc: 0.93858	valid_0's binary_logloss: 0.27034	valid_1's auc: 0.905508	valid_1's binary_logloss: 0.321659
[114]	valid_0's auc: 0.938733	valid_0's binary_logloss: 0.270037	valid_1's auc: 0.905462	valid_1's binary_logloss: 0.321751
[115]	valid_0's auc: 0.938926	valid_0's binary_logloss: 0.26969	valid_1's auc: 0.905421	valid_1's binary_logloss: 0.321861
[116]	valid_0's auc: 0.939101	valid_0's binary_logloss: 0.269373	valid_1's auc: 0.905387	valid_1's binary_logloss: 0.321903
[117]	valid_0's auc: 0.939349	valid_0's binary_logloss: 0.268959	valid_1's auc: 0.905167	valid_1's binary_logloss: 0.322256
[118]	valid_0's auc: 0.939564	valid_0's binary_logloss: 0.268578	valid_1's auc: 0.905152	valid_1's binary_logloss: 0.322298
[119]	valid_0's auc: 0.939749	valid_0's binary_logloss: 0.268242	valid_1's auc: 0.90517	valid_1's binary_logloss: 0.32232
[120]	valid_0's auc: 0.939982	valid_0's binary_logloss: 0.267842	valid_1's auc: 0.90523	valid_1's binary_logloss: 0.322213
[121]	valid_0's auc: 0.940148	valid_0's binary_logloss: 0.267552	valid_1's auc: 0.905209	valid_1's binary_logloss: 0.322289
[122]	valid_0's auc: 0.940343	valid_0's binary_logloss: 0.267223	valid_1's auc: 0.905217	valid_1's binary_logloss: 0.322327
[123]	valid_0's auc: 0.940529	valid_0's binary_logloss: 0.266871	valid_1's auc: 0.905176	valid_1's binary_logloss: 0.322456
[124]	valid_0's auc: 0.940696	valid_0's binary_logloss: 0.266544	valid_1's auc: 0.905121	valid_1's binary_logloss: 0.322519
[125]	valid_0's auc: 0.94087	valid_0's binary_logloss: 0.2662	valid_1's auc: 0.905049	valid_1's binary_logloss: 0.322668
[126]	valid_0's auc: 0.941112	valid_0's binary_logloss: 0.265797	valid_1's auc: 0.905067	valid_1's binary_logloss: 0.322684
[127]	valid_0's auc: 0.94129	valid_0's binary_logloss: 0.265464	valid_1's auc: 0.905059	valid_1's binary_logloss: 0.322706
[128]	valid_0's auc: 0.941503	valid_0's binary_logloss: 0.265081	valid_1's auc: 0.90501	valid_1's binary_logloss: 0.322848
[129]	valid_0's auc: 0.941689	valid_0's binary_logloss: 0.264742	valid_1's auc: 0.904905	valid_1's binary_logloss: 0.323085
[130]	valid_0's auc: 0.941937	valid_0's binary_logloss: 0.264306	valid_1's auc: 0.90485	valid_1's binary_logloss: 0.323194
[131]	valid_0's auc: 0.942166	valid_0's binary_logloss: 0.263906	valid_1's auc: 0.904765	valid_1's binary_logloss: 0.323363
[132]	valid_0's auc: 0.942275	valid_0's binary_logloss: 0.263689	valid_1's auc: 0.904797	valid_1's binary_logloss: 0.323366
[133]	valid_0's auc: 0.94244	valid_0's binary_logloss: 0.263377	valid_1's auc: 0.904695	valid_1's binary_logloss: 0.323558
Early stopping, best iteration is:
[33]	valid_0's auc: 0.915879	valid_0's binary_logloss: 0.313183	valid_1's auc: 0.908755	valid_1's binary_logloss: 0.3187
[1]	valid_0's auc: 0.887983	valid_0's binary_logloss: 0.517034	valid_1's auc: 0.891755	valid_1's binary_logloss: 0.508452
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.89066	valid_0's binary_logloss: 0.488464	valid_1's auc: 0.89629	valid_1's binary_logloss: 0.478946
[3]	valid_0's auc: 0.891984	valid_0's binary_logloss: 0.465365	valid_1's auc: 0.897538	valid_1's binary_logloss: 0.455741
[4]	valid_0's auc: 0.896159	valid_0's binary_logloss: 0.446069	valid_1's auc: 0.901608	valid_1's binary_logloss: 0.43617
[5]	valid_0's auc: 0.896836	valid_0's binary_logloss: 0.43022	valid_1's auc: 0.902385	valid_1's binary_logloss: 0.420003
[6]	valid_0's auc: 0.897532	valid_0's binary_logloss: 0.416675	valid_1's auc: 0.902107	valid_1's binary_logloss: 0.406595
[7]	valid_0's auc: 0.898859	valid_0's binary_logloss: 0.404875	valid_1's auc: 0.902903	valid_1's binary_logloss: 0.394907
[8]	valid_0's auc: 0.899531	valid_0's binary_logloss: 0.394951	valid_1's auc: 0.903622	valid_1's binary_logloss: 0.384787
[9]	valid_0's auc: 0.899803	valid_0's binary_logloss: 0.386385	valid_1's auc: 0.904479	valid_1's binary_logloss: 0.376169
[10]	valid_0's auc: 0.90085	valid_0's binary_logloss: 0.378764	valid_1's auc: 0.904859	valid_1's binary_logloss: 0.369074
[11]	valid_0's auc: 0.901544	valid_0's binary_logloss: 0.372015	valid_1's auc: 0.905244	valid_1's binary_logloss: 0.36246
[12]	valid_0's auc: 0.902572	valid_0's binary_logloss: 0.366163	valid_1's auc: 0.905663	valid_1's binary_logloss: 0.356912
[13]	valid_0's auc: 0.903409	valid_0's binary_logloss: 0.360834	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.352169
[14]	valid_0's auc: 0.904166	valid_0's binary_logloss: 0.356033	valid_1's auc: 0.906466	valid_1's binary_logloss: 0.347704
[15]	valid_0's auc: 0.904991	valid_0's binary_logloss: 0.351586	valid_1's auc: 0.906652	valid_1's binary_logloss: 0.344065
[16]	valid_0's auc: 0.905708	valid_0's binary_logloss: 0.347763	valid_1's auc: 0.907106	valid_1's binary_logloss: 0.340566
[17]	valid_0's auc: 0.906237	valid_0's binary_logloss: 0.344327	valid_1's auc: 0.907197	valid_1's binary_logloss: 0.33777
[18]	valid_0's auc: 0.907243	valid_0's binary_logloss: 0.34106	valid_1's auc: 0.907388	valid_1's binary_logloss: 0.335204
[19]	valid_0's auc: 0.907652	valid_0's binary_logloss: 0.338397	valid_1's auc: 0.90763	valid_1's binary_logloss: 0.332937
[20]	valid_0's auc: 0.908388	valid_0's binary_logloss: 0.335673	valid_1's auc: 0.908	valid_1's binary_logloss: 0.330835
[21]	valid_0's auc: 0.908972	valid_0's binary_logloss: 0.333258	valid_1's auc: 0.908301	valid_1's binary_logloss: 0.32899
[22]	valid_0's auc: 0.909675	valid_0's binary_logloss: 0.330959	valid_1's auc: 0.908303	valid_1's binary_logloss: 0.327561
[23]	valid_0's auc: 0.91047	valid_0's binary_logloss: 0.328639	valid_1's auc: 0.908497	valid_1's binary_logloss: 0.325982
[24]	valid_0's auc: 0.911006	valid_0's binary_logloss: 0.326684	valid_1's auc: 0.908562	valid_1's binary_logloss: 0.32467
[25]	valid_0's auc: 0.911567	valid_0's binary_logloss: 0.324816	valid_1's auc: 0.908557	valid_1's binary_logloss: 0.323689
[26]	valid_0's auc: 0.912039	valid_0's binary_logloss: 0.323142	valid_1's auc: 0.908656	valid_1's binary_logloss: 0.322619
[27]	valid_0's auc: 0.912588	valid_0's binary_logloss: 0.321545	valid_1's auc: 0.908832	valid_1's binary_logloss: 0.321518
[28]	valid_0's auc: 0.912989	valid_0's binary_logloss: 0.320191	valid_1's auc: 0.908873	valid_1's binary_logloss: 0.320803
[29]	valid_0's auc: 0.913483	valid_0's binary_logloss: 0.318816	valid_1's auc: 0.909126	valid_1's binary_logloss: 0.319937
[30]	valid_0's auc: 0.913875	valid_0's binary_logloss: 0.317593	valid_1's auc: 0.909143	valid_1's binary_logloss: 0.319384
[31]	valid_0's auc: 0.914309	valid_0's binary_logloss: 0.316371	valid_1's auc: 0.909192	valid_1's binary_logloss: 0.318816
[32]	valid_0's auc: 0.914842	valid_0's binary_logloss: 0.315097	valid_1's auc: 0.909295	valid_1's binary_logloss: 0.318232
[33]	valid_0's auc: 0.915354	valid_0's binary_logloss: 0.31381	valid_1's auc: 0.909416	valid_1's binary_logloss: 0.317664
[34]	valid_0's auc: 0.915971	valid_0's binary_logloss: 0.312557	valid_1's auc: 0.909481	valid_1's binary_logloss: 0.317304
[35]	valid_0's auc: 0.916312	valid_0's binary_logloss: 0.311576	valid_1's auc: 0.909609	valid_1's binary_logloss: 0.316742
[36]	valid_0's auc: 0.916762	valid_0's binary_logloss: 0.310578	valid_1's auc: 0.909798	valid_1's binary_logloss: 0.316233
[37]	valid_0's auc: 0.917132	valid_0's binary_logloss: 0.30965	valid_1's auc: 0.909847	valid_1's binary_logloss: 0.315945
[38]	valid_0's auc: 0.917467	valid_0's binary_logloss: 0.308806	valid_1's auc: 0.909858	valid_1's binary_logloss: 0.315676
[39]	valid_0's auc: 0.917923	valid_0's binary_logloss: 0.307864	valid_1's auc: 0.909957	valid_1's binary_logloss: 0.315347
[40]	valid_0's auc: 0.918344	valid_0's binary_logloss: 0.306975	valid_1's auc: 0.909944	valid_1's binary_logloss: 0.315184
[41]	valid_0's auc: 0.918811	valid_0's binary_logloss: 0.306025	valid_1's auc: 0.909935	valid_1's binary_logloss: 0.315006
[42]	valid_0's auc: 0.919185	valid_0's binary_logloss: 0.305217	valid_1's auc: 0.909923	valid_1's binary_logloss: 0.314895
[43]	valid_0's auc: 0.919624	valid_0's binary_logloss: 0.304381	valid_1's auc: 0.909934	valid_1's binary_logloss: 0.314779
[44]	valid_0's auc: 0.919982	valid_0's binary_logloss: 0.303605	valid_1's auc: 0.910059	valid_1's binary_logloss: 0.314464
[45]	valid_0's auc: 0.920274	valid_0's binary_logloss: 0.302982	valid_1's auc: 0.910127	valid_1's binary_logloss: 0.314187
[46]	valid_0's auc: 0.920539	valid_0's binary_logloss: 0.302396	valid_1's auc: 0.910104	valid_1's binary_logloss: 0.314129
[47]	valid_0's auc: 0.920885	valid_0's binary_logloss: 0.301721	valid_1's auc: 0.910042	valid_1's binary_logloss: 0.314131
[48]	valid_0's auc: 0.921288	valid_0's binary_logloss: 0.300919	valid_1's auc: 0.910064	valid_1's binary_logloss: 0.314023
[49]	valid_0's auc: 0.921685	valid_0's binary_logloss: 0.300189	valid_1's auc: 0.910161	valid_1's binary_logloss: 0.313855
[50]	valid_0's auc: 0.921977	valid_0's binary_logloss: 0.299593	valid_1's auc: 0.910188	valid_1's binary_logloss: 0.3138
[51]	valid_0's auc: 0.922289	valid_0's binary_logloss: 0.299026	valid_1's auc: 0.910113	valid_1's binary_logloss: 0.313817
[52]	valid_0's auc: 0.922541	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.91019	valid_1's binary_logloss: 0.313611
[53]	valid_0's auc: 0.922822	valid_0's binary_logloss: 0.297975	valid_1's auc: 0.910053	valid_1's binary_logloss: 0.313776
[54]	valid_0's auc: 0.923024	valid_0's binary_logloss: 0.297547	valid_1's auc: 0.910078	valid_1's binary_logloss: 0.3137
[55]	valid_0's auc: 0.923286	valid_0's binary_logloss: 0.297035	valid_1's auc: 0.910107	valid_1's binary_logloss: 0.313666
[56]	valid_0's auc: 0.923599	valid_0's binary_logloss: 0.29643	valid_1's auc: 0.910045	valid_1's binary_logloss: 0.313696
[57]	valid_0's auc: 0.923915	valid_0's binary_logloss: 0.295903	valid_1's auc: 0.909854	valid_1's binary_logloss: 0.313887
[58]	valid_0's auc: 0.924221	valid_0's binary_logloss: 0.295347	valid_1's auc: 0.909783	valid_1's binary_logloss: 0.313941
[59]	valid_0's auc: 0.92458	valid_0's binary_logloss: 0.294734	valid_1's auc: 0.909757	valid_1's binary_logloss: 0.313976
[60]	valid_0's auc: 0.924868	valid_0's binary_logloss: 0.294194	valid_1's auc: 0.90969	valid_1's binary_logloss: 0.314054
[61]	valid_0's auc: 0.925202	valid_0's binary_logloss: 0.293691	valid_1's auc: 0.909588	valid_1's binary_logloss: 0.314267
[62]	valid_0's auc: 0.925513	valid_0's binary_logloss: 0.293134	valid_1's auc: 0.909501	valid_1's binary_logloss: 0.314356
[63]	valid_0's auc: 0.925752	valid_0's binary_logloss: 0.292702	valid_1's auc: 0.909354	valid_1's binary_logloss: 0.314538
[64]	valid_0's auc: 0.925984	valid_0's binary_logloss: 0.292237	valid_1's auc: 0.909211	valid_1's binary_logloss: 0.314724
[65]	valid_0's auc: 0.926274	valid_0's binary_logloss: 0.291762	valid_1's auc: 0.909081	valid_1's binary_logloss: 0.314921
[66]	valid_0's auc: 0.926506	valid_0's binary_logloss: 0.291293	valid_1's auc: 0.909022	valid_1's binary_logloss: 0.315021
[67]	valid_0's auc: 0.926802	valid_0's binary_logloss: 0.290795	valid_1's auc: 0.908855	valid_1's binary_logloss: 0.315257
[68]	valid_0's auc: 0.926995	valid_0's binary_logloss: 0.290429	valid_1's auc: 0.908743	valid_1's binary_logloss: 0.315451
[69]	valid_0's auc: 0.927255	valid_0's binary_logloss: 0.289987	valid_1's auc: 0.908613	valid_1's binary_logloss: 0.315651
[70]	valid_0's auc: 0.927499	valid_0's binary_logloss: 0.289546	valid_1's auc: 0.908549	valid_1's binary_logloss: 0.315769
[71]	valid_0's auc: 0.927742	valid_0's binary_logloss: 0.289136	valid_1's auc: 0.908488	valid_1's binary_logloss: 0.315846
[72]	valid_0's auc: 0.92803	valid_0's binary_logloss: 0.288629	valid_1's auc: 0.908515	valid_1's binary_logloss: 0.315783
[73]	valid_0's auc: 0.928358	valid_0's binary_logloss: 0.288108	valid_1's auc: 0.908425	valid_1's binary_logloss: 0.315935
[74]	valid_0's auc: 0.928672	valid_0's binary_logloss: 0.287608	valid_1's auc: 0.908371	valid_1's binary_logloss: 0.316049
[75]	valid_0's auc: 0.928888	valid_0's binary_logloss: 0.287201	valid_1's auc: 0.908467	valid_1's binary_logloss: 0.315869
[76]	valid_0's auc: 0.92927	valid_0's binary_logloss: 0.286577	valid_1's auc: 0.908463	valid_1's binary_logloss: 0.31588
[77]	valid_0's auc: 0.929557	valid_0's binary_logloss: 0.286144	valid_1's auc: 0.908364	valid_1's binary_logloss: 0.316003
[78]	valid_0's auc: 0.92985	valid_0's binary_logloss: 0.285663	valid_1's auc: 0.90833	valid_1's binary_logloss: 0.316036
[79]	valid_0's auc: 0.930083	valid_0's binary_logloss: 0.28523	valid_1's auc: 0.908294	valid_1's binary_logloss: 0.316102
[80]	valid_0's auc: 0.930311	valid_0's binary_logloss: 0.284827	valid_1's auc: 0.908249	valid_1's binary_logloss: 0.316182
[81]	valid_0's auc: 0.930551	valid_0's binary_logloss: 0.284413	valid_1's auc: 0.908237	valid_1's binary_logloss: 0.316263
[82]	valid_0's auc: 0.930733	valid_0's binary_logloss: 0.284047	valid_1's auc: 0.908157	valid_1's binary_logloss: 0.316455
[83]	valid_0's auc: 0.930994	valid_0's binary_logloss: 0.283621	valid_1's auc: 0.9081	valid_1's binary_logloss: 0.316557
[84]	valid_0's auc: 0.931205	valid_0's binary_logloss: 0.283243	valid_1's auc: 0.908033	valid_1's binary_logloss: 0.316672
[85]	valid_0's auc: 0.931499	valid_0's binary_logloss: 0.282728	valid_1's auc: 0.908036	valid_1's binary_logloss: 0.316673
[86]	valid_0's auc: 0.931699	valid_0's binary_logloss: 0.282348	valid_1's auc: 0.90799	valid_1's binary_logloss: 0.31681
[87]	valid_0's auc: 0.931942	valid_0's binary_logloss: 0.281864	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.316738
[88]	valid_0's auc: 0.932166	valid_0's binary_logloss: 0.281443	valid_1's auc: 0.907989	valid_1's binary_logloss: 0.316828
[89]	valid_0's auc: 0.932366	valid_0's binary_logloss: 0.281085	valid_1's auc: 0.907987	valid_1's binary_logloss: 0.316836
[90]	valid_0's auc: 0.932656	valid_0's binary_logloss: 0.280619	valid_1's auc: 0.907972	valid_1's binary_logloss: 0.316847
[91]	valid_0's auc: 0.932905	valid_0's binary_logloss: 0.280234	valid_1's auc: 0.907902	valid_1's binary_logloss: 0.316907
[92]	valid_0's auc: 0.933099	valid_0's binary_logloss: 0.279898	valid_1's auc: 0.90791	valid_1's binary_logloss: 0.31692
[93]	valid_0's auc: 0.933327	valid_0's binary_logloss: 0.279525	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317075
[94]	valid_0's auc: 0.933561	valid_0's binary_logloss: 0.279106	valid_1's auc: 0.907781	valid_1's binary_logloss: 0.317198
[95]	valid_0's auc: 0.933759	valid_0's binary_logloss: 0.278767	valid_1's auc: 0.907776	valid_1's binary_logloss: 0.317202
[96]	valid_0's auc: 0.934019	valid_0's binary_logloss: 0.278342	valid_1's auc: 0.907815	valid_1's binary_logloss: 0.31719
[97]	valid_0's auc: 0.934224	valid_0's binary_logloss: 0.277961	valid_1's auc: 0.907824	valid_1's binary_logloss: 0.317212
[98]	valid_0's auc: 0.934446	valid_0's binary_logloss: 0.277559	valid_1's auc: 0.907809	valid_1's binary_logloss: 0.317279
[99]	valid_0's auc: 0.934644	valid_0's binary_logloss: 0.277217	valid_1's auc: 0.907725	valid_1's binary_logloss: 0.317418
[100]	valid_0's auc: 0.934871	valid_0's binary_logloss: 0.276836	valid_1's auc: 0.907634	valid_1's binary_logloss: 0.317629
[101]	valid_0's auc: 0.935086	valid_0's binary_logloss: 0.276476	valid_1's auc: 0.907515	valid_1's binary_logloss: 0.317831
[102]	valid_0's auc: 0.935279	valid_0's binary_logloss: 0.276141	valid_1's auc: 0.907404	valid_1's binary_logloss: 0.318027
[103]	valid_0's auc: 0.935472	valid_0's binary_logloss: 0.275783	valid_1's auc: 0.907314	valid_1's binary_logloss: 0.318221
[104]	valid_0's auc: 0.93563	valid_0's binary_logloss: 0.275489	valid_1's auc: 0.907203	valid_1's binary_logloss: 0.318405
[105]	valid_0's auc: 0.935793	valid_0's binary_logloss: 0.275148	valid_1's auc: 0.907146	valid_1's binary_logloss: 0.318543
[106]	valid_0's auc: 0.936004	valid_0's binary_logloss: 0.274803	valid_1's auc: 0.907182	valid_1's binary_logloss: 0.318485
[107]	valid_0's auc: 0.936191	valid_0's binary_logloss: 0.274476	valid_1's auc: 0.90712	valid_1's binary_logloss: 0.318635
[108]	valid_0's auc: 0.936391	valid_0's binary_logloss: 0.27413	valid_1's auc: 0.90709	valid_1's binary_logloss: 0.318761
[109]	valid_0's auc: 0.936653	valid_0's binary_logloss: 0.27368	valid_1's auc: 0.906937	valid_1's binary_logloss: 0.31906
[110]	valid_0's auc: 0.936928	valid_0's binary_logloss: 0.273228	valid_1's auc: 0.906933	valid_1's binary_logloss: 0.319065
[111]	valid_0's auc: 0.937121	valid_0's binary_logloss: 0.272903	valid_1's auc: 0.906868	valid_1's binary_logloss: 0.319174
[112]	valid_0's auc: 0.937365	valid_0's binary_logloss: 0.272505	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.319228
[113]	valid_0's auc: 0.937533	valid_0's binary_logloss: 0.272191	valid_1's auc: 0.906793	valid_1's binary_logloss: 0.31931
[114]	valid_0's auc: 0.937767	valid_0's binary_logloss: 0.271783	valid_1's auc: 0.906681	valid_1's binary_logloss: 0.319502
[115]	valid_0's auc: 0.93798	valid_0's binary_logloss: 0.271401	valid_1's auc: 0.906652	valid_1's binary_logloss: 0.319567
[116]	valid_0's auc: 0.938155	valid_0's binary_logloss: 0.271111	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.319629
[117]	valid_0's auc: 0.938397	valid_0's binary_logloss: 0.270719	valid_1's auc: 0.906698	valid_1's binary_logloss: 0.319521
[118]	valid_0's auc: 0.938548	valid_0's binary_logloss: 0.270404	valid_1's auc: 0.90674	valid_1's binary_logloss: 0.319482
[119]	valid_0's auc: 0.93874	valid_0's binary_logloss: 0.270057	valid_1's auc: 0.906734	valid_1's binary_logloss: 0.31953
[120]	valid_0's auc: 0.938987	valid_0's binary_logloss: 0.269649	valid_1's auc: 0.906597	valid_1's binary_logloss: 0.319805
[121]	valid_0's auc: 0.939129	valid_0's binary_logloss: 0.26937	valid_1's auc: 0.906581	valid_1's binary_logloss: 0.319901
[122]	valid_0's auc: 0.939315	valid_0's binary_logloss: 0.269006	valid_1's auc: 0.906624	valid_1's binary_logloss: 0.319893
[123]	valid_0's auc: 0.939443	valid_0's binary_logloss: 0.268753	valid_1's auc: 0.90651	valid_1's binary_logloss: 0.320144
[124]	valid_0's auc: 0.939606	valid_0's binary_logloss: 0.268419	valid_1's auc: 0.906561	valid_1's binary_logloss: 0.320071
[125]	valid_0's auc: 0.939788	valid_0's binary_logloss: 0.268089	valid_1's auc: 0.906616	valid_1's binary_logloss: 0.320088
[126]	valid_0's auc: 0.939941	valid_0's binary_logloss: 0.267795	valid_1's auc: 0.906622	valid_1's binary_logloss: 0.320135
[127]	valid_0's auc: 0.940169	valid_0's binary_logloss: 0.267365	valid_1's auc: 0.906579	valid_1's binary_logloss: 0.320254
[128]	valid_0's auc: 0.940277	valid_0's binary_logloss: 0.267128	valid_1's auc: 0.906565	valid_1's binary_logloss: 0.320342
[129]	valid_0's auc: 0.940457	valid_0's binary_logloss: 0.266809	valid_1's auc: 0.906544	valid_1's binary_logloss: 0.320434
[130]	valid_0's auc: 0.94066	valid_0's binary_logloss: 0.266418	valid_1's auc: 0.906484	valid_1's binary_logloss: 0.320587
[131]	valid_0's auc: 0.940815	valid_0's binary_logloss: 0.266143	valid_1's auc: 0.90647	valid_1's binary_logloss: 0.320657
[132]	valid_0's auc: 0.940931	valid_0's binary_logloss: 0.26592	valid_1's auc: 0.906438	valid_1's binary_logloss: 0.320704
[133]	valid_0's auc: 0.941143	valid_0's binary_logloss: 0.265556	valid_1's auc: 0.906309	valid_1's binary_logloss: 0.3209
[134]	valid_0's auc: 0.941287	valid_0's binary_logloss: 0.265275	valid_1's auc: 0.906412	valid_1's binary_logloss: 0.320812
[135]	valid_0's auc: 0.941466	valid_0's binary_logloss: 0.26494	valid_1's auc: 0.906203	valid_1's binary_logloss: 0.321193
[136]	valid_0's auc: 0.941604	valid_0's binary_logloss: 0.264672	valid_1's auc: 0.906174	valid_1's binary_logloss: 0.321245
[137]	valid_0's auc: 0.94182	valid_0's binary_logloss: 0.26432	valid_1's auc: 0.906018	valid_1's binary_logloss: 0.32151
[138]	valid_0's auc: 0.94196	valid_0's binary_logloss: 0.264038	valid_1's auc: 0.905925	valid_1's binary_logloss: 0.321609
[139]	valid_0's auc: 0.94213	valid_0's binary_logloss: 0.263743	valid_1's auc: 0.905936	valid_1's binary_logloss: 0.321641
[140]	valid_0's auc: 0.942273	valid_0's binary_logloss: 0.263462	valid_1's auc: 0.905934	valid_1's binary_logloss: 0.321726
[141]	valid_0's auc: 0.942418	valid_0's binary_logloss: 0.263207	valid_1's auc: 0.905948	valid_1's binary_logloss: 0.321718
[142]	valid_0's auc: 0.942541	valid_0's binary_logloss: 0.262979	valid_1's auc: 0.905949	valid_1's binary_logloss: 0.321744
[143]	valid_0's auc: 0.942702	valid_0's binary_logloss: 0.262686	valid_1's auc: 0.905857	valid_1's binary_logloss: 0.321916
[144]	valid_0's auc: 0.942871	valid_0's binary_logloss: 0.26238	valid_1's auc: 0.905858	valid_1's binary_logloss: 0.321956
[145]	valid_0's auc: 0.94303	valid_0's binary_logloss: 0.262047	valid_1's auc: 0.905853	valid_1's binary_logloss: 0.321925
[146]	valid_0's auc: 0.943192	valid_0's binary_logloss: 0.261758	valid_1's auc: 0.905865	valid_1's binary_logloss: 0.322018
[147]	valid_0's auc: 0.943327	valid_0's binary_logloss: 0.261482	valid_1's auc: 0.905834	valid_1's binary_logloss: 0.322122
[148]	valid_0's auc: 0.943455	valid_0's binary_logloss: 0.261228	valid_1's auc: 0.905812	valid_1's binary_logloss: 0.322145
[149]	valid_0's auc: 0.943598	valid_0's binary_logloss: 0.260969	valid_1's auc: 0.905716	valid_1's binary_logloss: 0.322296
[150]	valid_0's auc: 0.943787	valid_0's binary_logloss: 0.26064	valid_1's auc: 0.905712	valid_1's binary_logloss: 0.322313
[151]	valid_0's auc: 0.943937	valid_0's binary_logloss: 0.26036	valid_1's auc: 0.905646	valid_1's binary_logloss: 0.32245
[152]	valid_0's auc: 0.944091	valid_0's binary_logloss: 0.260083	valid_1's auc: 0.905594	valid_1's binary_logloss: 0.322579
Early stopping, best iteration is:
[52]	valid_0's auc: 0.922541	valid_0's binary_logloss: 0.298515	valid_1's auc: 0.91019	valid_1's binary_logloss: 0.313611
[1]	training's auc: 0.888505	training's binary_logloss: 0.517052	valid_1's auc: 0.895779	valid_1's binary_logloss: 0.508106
Training until validation scores don't improve for 100 rounds
[2]	training's auc: 0.891818	training's binary_logloss: 0.487784	valid_1's auc: 0.899289	valid_1's binary_logloss: 0.477948
[3]	training's auc: 0.894904	training's binary_logloss: 0.464154	valid_1's auc: 0.900975	valid_1's binary_logloss: 0.454474
[4]	training's auc: 0.896031	training's binary_logloss: 0.444857	valid_1's auc: 0.900657	valid_1's binary_logloss: 0.43531
[5]	training's auc: 0.89714	training's binary_logloss: 0.428698	valid_1's auc: 0.901422	valid_1's binary_logloss: 0.419402
[6]	training's auc: 0.900672	training's binary_logloss: 0.41493	valid_1's auc: 0.90405	valid_1's binary_logloss: 0.405626
[7]	training's auc: 0.90179	training's binary_logloss: 0.403243	valid_1's auc: 0.904217	valid_1's binary_logloss: 0.39443
[8]	training's auc: 0.902671	training's binary_logloss: 0.392984	valid_1's auc: 0.90417	valid_1's binary_logloss: 0.384728
[9]	training's auc: 0.903269	training's binary_logloss: 0.384184	valid_1's auc: 0.904799	valid_1's binary_logloss: 0.376088
[10]	training's auc: 0.904076	training's binary_logloss: 0.37644	valid_1's auc: 0.90513	valid_1's binary_logloss: 0.368923
[11]	training's auc: 0.904643	training's binary_logloss: 0.369689	valid_1's auc: 0.905411	valid_1's binary_logloss: 0.362419
[12]	training's auc: 0.905271	training's binary_logloss: 0.363586	valid_1's auc: 0.905651	valid_1's binary_logloss: 0.356895
[13]	training's auc: 0.90598	training's binary_logloss: 0.358101	valid_1's auc: 0.905956	valid_1's binary_logloss: 0.351883
[14]	training's auc: 0.907145	training's binary_logloss: 0.353195	valid_1's auc: 0.906494	valid_1's binary_logloss: 0.347633
[15]	training's auc: 0.908113	training's binary_logloss: 0.348789	valid_1's auc: 0.906924	valid_1's binary_logloss: 0.343951
[16]	training's auc: 0.908708	training's binary_logloss: 0.3449	valid_1's auc: 0.907179	valid_1's binary_logloss: 0.34066
[17]	training's auc: 0.909621	training's binary_logloss: 0.341278	valid_1's auc: 0.907505	valid_1's binary_logloss: 0.337749
[18]	training's auc: 0.910316	training's binary_logloss: 0.337978	valid_1's auc: 0.907675	valid_1's binary_logloss: 0.3352
[19]	training's auc: 0.911022	training's binary_logloss: 0.334959	valid_1's auc: 0.907855	valid_1's binary_logloss: 0.332958
[20]	training's auc: 0.911829	training's binary_logloss: 0.33214	valid_1's auc: 0.908032	valid_1's binary_logloss: 0.330885
[21]	training's auc: 0.912562	training's binary_logloss: 0.329532	valid_1's auc: 0.908297	valid_1's binary_logloss: 0.32905
[22]	training's auc: 0.913271	training's binary_logloss: 0.327028	valid_1's auc: 0.908562	valid_1's binary_logloss: 0.327175
[23]	training's auc: 0.913911	training's binary_logloss: 0.324856	valid_1's auc: 0.908506	valid_1's binary_logloss: 0.325912
[24]	training's auc: 0.914742	training's binary_logloss: 0.32259	valid_1's auc: 0.908394	valid_1's binary_logloss: 0.324984
[25]	training's auc: 0.915457	training's binary_logloss: 0.320599	valid_1's auc: 0.90857	valid_1's binary_logloss: 0.32377
[26]	training's auc: 0.915975	training's binary_logloss: 0.318791	valid_1's auc: 0.908696	valid_1's binary_logloss: 0.322656
[27]	training's auc: 0.916652	training's binary_logloss: 0.316968	valid_1's auc: 0.908769	valid_1's binary_logloss: 0.321871
[28]	training's auc: 0.917274	training's binary_logloss: 0.315251	valid_1's auc: 0.908888	valid_1's binary_logloss: 0.321002
[29]	training's auc: 0.917896	training's binary_logloss: 0.313649	valid_1's auc: 0.908946	valid_1's binary_logloss: 0.320364
[30]	training's auc: 0.918538	training's binary_logloss: 0.312163	valid_1's auc: 0.909021	valid_1's binary_logloss: 0.319797
[31]	training's auc: 0.919074	training's binary_logloss: 0.310764	valid_1's auc: 0.909098	valid_1's binary_logloss: 0.319225
[32]	training's auc: 0.91962	training's binary_logloss: 0.309388	valid_1's auc: 0.90902	valid_1's binary_logloss: 0.318907
[33]	training's auc: 0.920183	training's binary_logloss: 0.308021	valid_1's auc: 0.909069	valid_1's binary_logloss: 0.3185
[34]	training's auc: 0.920687	training's binary_logloss: 0.306752	valid_1's auc: 0.909018	valid_1's binary_logloss: 0.318255
[35]	training's auc: 0.92117	training's binary_logloss: 0.305505	valid_1's auc: 0.909021	valid_1's binary_logloss: 0.317883
[36]	training's auc: 0.92168	training's binary_logloss: 0.30436	valid_1's auc: 0.909072	valid_1's binary_logloss: 0.317603
[37]	training's auc: 0.922259	training's binary_logloss: 0.303127	valid_1's auc: 0.909194	valid_1's binary_logloss: 0.317164
[38]	training's auc: 0.922786	training's binary_logloss: 0.301997	valid_1's auc: 0.9092	valid_1's binary_logloss: 0.316957
[39]	training's auc: 0.923211	training's binary_logloss: 0.300991	valid_1's auc: 0.909255	valid_1's binary_logloss: 0.316717
[40]	training's auc: 0.923688	training's binary_logloss: 0.300015	valid_1's auc: 0.90935	valid_1's binary_logloss: 0.316419
[41]	training's auc: 0.924157	training's binary_logloss: 0.298986	valid_1's auc: 0.909434	valid_1's binary_logloss: 0.316099
[42]	training's auc: 0.924592	training's binary_logloss: 0.29804	valid_1's auc: 0.909471	valid_1's binary_logloss: 0.315905
[43]	training's auc: 0.925012	training's binary_logloss: 0.297202	valid_1's auc: 0.909432	valid_1's binary_logloss: 0.315809
[44]	training's auc: 0.92541	training's binary_logloss: 0.296385	valid_1's auc: 0.909404	valid_1's binary_logloss: 0.315695
[45]	training's auc: 0.925834	training's binary_logloss: 0.295513	valid_1's auc: 0.9093	valid_1's binary_logloss: 0.315753
[46]	training's auc: 0.926295	training's binary_logloss: 0.294571	valid_1's auc: 0.909169	valid_1's binary_logloss: 0.315876
[47]	training's auc: 0.926821	training's binary_logloss: 0.293606	valid_1's auc: 0.909198	valid_1's binary_logloss: 0.31574
[48]	training's auc: 0.927292	training's binary_logloss: 0.292771	valid_1's auc: 0.909281	valid_1's binary_logloss: 0.31549
[49]	training's auc: 0.927813	training's binary_logloss: 0.291832	valid_1's auc: 0.90911	valid_1's binary_logloss: 0.315624
[50]	training's auc: 0.928264	training's binary_logloss: 0.291068	valid_1's auc: 0.909113	valid_1's binary_logloss: 0.31557
[51]	training's auc: 0.928656	training's binary_logloss: 0.29035	valid_1's auc: 0.909097	valid_1's binary_logloss: 0.315565
[52]	training's auc: 0.929114	training's binary_logloss: 0.289567	valid_1's auc: 0.909182	valid_1's binary_logloss: 0.31547
[53]	training's auc: 0.929423	training's binary_logloss: 0.288924	valid_1's auc: 0.90916	valid_1's binary_logloss: 0.315452
[54]	training's auc: 0.92982	training's binary_logloss: 0.288265	valid_1's auc: 0.909151	valid_1's binary_logloss: 0.315413
[55]	training's auc: 0.930224	training's binary_logloss: 0.287495	valid_1's auc: 0.909199	valid_1's binary_logloss: 0.315328
[56]	training's auc: 0.930622	training's binary_logloss: 0.286832	valid_1's auc: 0.909314	valid_1's binary_logloss: 0.315127
[57]	training's auc: 0.930993	training's binary_logloss: 0.286157	valid_1's auc: 0.90924	valid_1's binary_logloss: 0.315217
[58]	training's auc: 0.931446	training's binary_logloss: 0.2854	valid_1's auc: 0.909292	valid_1's binary_logloss: 0.315107
[59]	training's auc: 0.931865	training's binary_logloss: 0.284664	valid_1's auc: 0.90935	valid_1's binary_logloss: 0.314998
[60]	training's auc: 0.932304	training's binary_logloss: 0.283893	valid_1's auc: 0.909479	valid_1's binary_logloss: 0.314774
[61]	training's auc: 0.932596	training's binary_logloss: 0.283324	valid_1's auc: 0.909569	valid_1's binary_logloss: 0.314606
[62]	training's auc: 0.932942	training's binary_logloss: 0.282717	valid_1's auc: 0.909465	valid_1's binary_logloss: 0.314791
[63]	training's auc: 0.933279	training's binary_logloss: 0.282051	valid_1's auc: 0.9095	valid_1's binary_logloss: 0.314703
[64]	training's auc: 0.933617	training's binary_logloss: 0.281464	valid_1's auc: 0.909429	valid_1's binary_logloss: 0.314762
[65]	training's auc: 0.934009	training's binary_logloss: 0.280806	valid_1's auc: 0.909537	valid_1's binary_logloss: 0.31462
[66]	training's auc: 0.934364	training's binary_logloss: 0.280166	valid_1's auc: 0.909726	valid_1's binary_logloss: 0.314341
[67]	training's auc: 0.934781	training's binary_logloss: 0.279463	valid_1's auc: 0.909589	valid_1's binary_logloss: 0.314605
[68]	training's auc: 0.935231	training's binary_logloss: 0.278684	valid_1's auc: 0.909585	valid_1's binary_logloss: 0.314598
[69]	training's auc: 0.935626	training's binary_logloss: 0.278005	valid_1's auc: 0.909444	valid_1's binary_logloss: 0.314833
[70]	training's auc: 0.936035	training's binary_logloss: 0.277256	valid_1's auc: 0.909443	valid_1's binary_logloss: 0.314793
[71]	training's auc: 0.93643	training's binary_logloss: 0.276571	valid_1's auc: 0.909407	valid_1's binary_logloss: 0.314828
[72]	training's auc: 0.936715	training's binary_logloss: 0.276016	valid_1's auc: 0.909323	valid_1's binary_logloss: 0.314963
[73]	training's auc: 0.937037	training's binary_logloss: 0.275412	valid_1's auc: 0.909398	valid_1's binary_logloss: 0.314832
[74]	training's auc: 0.937423	training's binary_logloss: 0.274768	valid_1's auc: 0.909333	valid_1's binary_logloss: 0.314935
[75]	training's auc: 0.937769	training's binary_logloss: 0.274171	valid_1's auc: 0.909337	valid_1's binary_logloss: 0.314937
[76]	training's auc: 0.938045	training's binary_logloss: 0.273678	valid_1's auc: 0.909288	valid_1's binary_logloss: 0.314991
[77]	training's auc: 0.938324	training's binary_logloss: 0.273147	valid_1's auc: 0.90926	valid_1's binary_logloss: 0.315062
[78]	training's auc: 0.938639	training's binary_logloss: 0.272622	valid_1's auc: 0.909123	valid_1's binary_logloss: 0.3153
[79]	training's auc: 0.93896	training's binary_logloss: 0.272031	valid_1's auc: 0.909044	valid_1's binary_logloss: 0.315419
[80]	training's auc: 0.939432	training's binary_logloss: 0.271281	valid_1's auc: 0.909027	valid_1's binary_logloss: 0.315424
[81]	training's auc: 0.939875	training's binary_logloss: 0.270501	valid_1's auc: 0.908981	valid_1's binary_logloss: 0.315514
[82]	training's auc: 0.940153	training's binary_logloss: 0.270039	valid_1's auc: 0.908864	valid_1's binary_logloss: 0.315708
[83]	training's auc: 0.940425	training's binary_logloss: 0.269556	valid_1's auc: 0.908727	valid_1's binary_logloss: 0.315929
[84]	training's auc: 0.940654	training's binary_logloss: 0.269151	valid_1's auc: 0.908764	valid_1's binary_logloss: 0.315832
[85]	training's auc: 0.940965	training's binary_logloss: 0.268638	valid_1's auc: 0.908752	valid_1's binary_logloss: 0.315893
[86]	training's auc: 0.941263	training's binary_logloss: 0.268093	valid_1's auc: 0.908947	valid_1's binary_logloss: 0.315631
[87]	training's auc: 0.941556	training's binary_logloss: 0.267515	valid_1's auc: 0.908812	valid_1's binary_logloss: 0.315914
[88]	training's auc: 0.94193	training's binary_logloss: 0.266831	valid_1's auc: 0.90865	valid_1's binary_logloss: 0.31613
[89]	training's auc: 0.9422	training's binary_logloss: 0.266364	valid_1's auc: 0.90852	valid_1's binary_logloss: 0.316352
[90]	training's auc: 0.94247	training's binary_logloss: 0.265916	valid_1's auc: 0.908552	valid_1's binary_logloss: 0.316321
[91]	training's auc: 0.942837	training's binary_logloss: 0.265269	valid_1's auc: 0.908468	valid_1's binary_logloss: 0.316465
[92]	training's auc: 0.943187	training's binary_logloss: 0.264657	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316514
[93]	training's auc: 0.943439	training's binary_logloss: 0.264184	valid_1's auc: 0.908392	valid_1's binary_logloss: 0.316535
[94]	training's auc: 0.943703	training's binary_logloss: 0.263641	valid_1's auc: 0.908361	valid_1's binary_logloss: 0.316592
[95]	training's auc: 0.944094	training's binary_logloss: 0.262963	valid_1's auc: 0.9084	valid_1's binary_logloss: 0.316508
[96]	training's auc: 0.944384	training's binary_logloss: 0.262452	valid_1's auc: 0.908366	valid_1's binary_logloss: 0.316614
[97]	training's auc: 0.944689	training's binary_logloss: 0.2619	valid_1's auc: 0.908298	valid_1's binary_logloss: 0.316732
[98]	training's auc: 0.944953	training's binary_logloss: 0.261448	valid_1's auc: 0.90823	valid_1's binary_logloss: 0.316862
[99]	training's auc: 0.945213	training's binary_logloss: 0.260992	valid_1's auc: 0.908218	valid_1's binary_logloss: 0.316893
[100]	training's auc: 0.945487	training's binary_logloss: 0.260485	valid_1's auc: 0.908295	valid_1's binary_logloss: 0.316756
[101]	training's auc: 0.945726	training's binary_logloss: 0.26005	valid_1's auc: 0.908266	valid_1's binary_logloss: 0.316797
[102]	training's auc: 0.945943	training's binary_logloss: 0.259651	valid_1's auc: 0.90811	valid_1's binary_logloss: 0.317032
[103]	training's auc: 0.946185	training's binary_logloss: 0.25918	valid_1's auc: 0.908188	valid_1's binary_logloss: 0.316924
[104]	training's auc: 0.946497	training's binary_logloss: 0.258627	valid_1's auc: 0.908227	valid_1's binary_logloss: 0.316884
[105]	training's auc: 0.946725	training's binary_logloss: 0.258143	valid_1's auc: 0.908166	valid_1's binary_logloss: 0.316992
[106]	training's auc: 0.946894	training's binary_logloss: 0.257835	valid_1's auc: 0.908153	valid_1's binary_logloss: 0.317012
[107]	training's auc: 0.94723	training's binary_logloss: 0.257227	valid_1's auc: 0.908204	valid_1's binary_logloss: 0.316854
[108]	training's auc: 0.947424	training's binary_logloss: 0.256817	valid_1's auc: 0.908166	valid_1's binary_logloss: 0.316962
[109]	training's auc: 0.947633	training's binary_logloss: 0.25643	valid_1's auc: 0.908041	valid_1's binary_logloss: 0.317193
[110]	training's auc: 0.947945	training's binary_logloss: 0.255922	valid_1's auc: 0.908059	valid_1's binary_logloss: 0.317178
[111]	training's auc: 0.948162	training's binary_logloss: 0.255529	valid_1's auc: 0.908079	valid_1's binary_logloss: 0.317194
[112]	training's auc: 0.948374	training's binary_logloss: 0.255138	valid_1's auc: 0.908034	valid_1's binary_logloss: 0.317263
[113]	training's auc: 0.948584	training's binary_logloss: 0.254786	valid_1's auc: 0.908038	valid_1's binary_logloss: 0.317234
[114]	training's auc: 0.948853	training's binary_logloss: 0.254291	valid_1's auc: 0.907864	valid_1's binary_logloss: 0.317574
[115]	training's auc: 0.949121	training's binary_logloss: 0.253819	valid_1's auc: 0.907855	valid_1's binary_logloss: 0.317591
[116]	training's auc: 0.949336	training's binary_logloss: 0.25338	valid_1's auc: 0.907823	valid_1's binary_logloss: 0.317672
[117]	training's auc: 0.949636	training's binary_logloss: 0.25288	valid_1's auc: 0.907811	valid_1's binary_logloss: 0.317668
[118]	training's auc: 0.949914	training's binary_logloss: 0.252344	valid_1's auc: 0.907767	valid_1's binary_logloss: 0.317711
[119]	training's auc: 0.950208	training's binary_logloss: 0.251852	valid_1's auc: 0.907734	valid_1's binary_logloss: 0.317789
[120]	training's auc: 0.950432	training's binary_logloss: 0.251449	valid_1's auc: 0.907705	valid_1's binary_logloss: 0.317855
[121]	training's auc: 0.950663	training's binary_logloss: 0.251025	valid_1's auc: 0.907681	valid_1's binary_logloss: 0.317905
[122]	training's auc: 0.950878	training's binary_logloss: 0.250611	valid_1's auc: 0.907667	valid_1's binary_logloss: 0.317918
[123]	training's auc: 0.951111	training's binary_logloss: 0.250187	valid_1's auc: 0.907709	valid_1's binary_logloss: 0.317874
[124]	training's auc: 0.951316	training's binary_logloss: 0.249772	valid_1's auc: 0.907627	valid_1's binary_logloss: 0.317965
[125]	training's auc: 0.951555	training's binary_logloss: 0.24932	valid_1's auc: 0.907581	valid_1's binary_logloss: 0.318063
[126]	training's auc: 0.951737	training's binary_logloss: 0.248949	valid_1's auc: 0.907574	valid_1's binary_logloss: 0.318086
[127]	training's auc: 0.951942	training's binary_logloss: 0.248552	valid_1's auc: 0.907585	valid_1's binary_logloss: 0.318097
[128]	training's auc: 0.952183	training's binary_logloss: 0.248129	valid_1's auc: 0.907612	valid_1's binary_logloss: 0.318042
[129]	training's auc: 0.952448	training's binary_logloss: 0.247679	valid_1's auc: 0.907655	valid_1's binary_logloss: 0.317964
[130]	training's auc: 0.95271	training's binary_logloss: 0.247194	valid_1's auc: 0.907679	valid_1's binary_logloss: 0.317926
[131]	training's auc: 0.952958	training's binary_logloss: 0.246708	valid_1's auc: 0.907601	valid_1's binary_logloss: 0.318025
[132]	training's auc: 0.953213	training's binary_logloss: 0.24625	valid_1's auc: 0.90753	valid_1's binary_logloss: 0.318149
[133]	training's auc: 0.953412	training's binary_logloss: 0.245885	valid_1's auc: 0.907488	valid_1's binary_logloss: 0.318216
[134]	training's auc: 0.95354	training's binary_logloss: 0.245598	valid_1's auc: 0.907452	valid_1's binary_logloss: 0.318283
[135]	training's auc: 0.953754	training's binary_logloss: 0.245197	valid_1's auc: 0.907404	valid_1's binary_logloss: 0.318365
[136]	training's auc: 0.953993	training's binary_logloss: 0.244711	valid_1's auc: 0.907231	valid_1's binary_logloss: 0.318664
[137]	training's auc: 0.954225	training's binary_logloss: 0.244277	valid_1's auc: 0.907203	valid_1's binary_logloss: 0.318703
[138]	training's auc: 0.954535	training's binary_logloss: 0.243717	valid_1's auc: 0.907218	valid_1's binary_logloss: 0.31866
[139]	training's auc: 0.954771	training's binary_logloss: 0.243284	valid_1's auc: 0.907204	valid_1's binary_logloss: 0.318721
[140]	training's auc: 0.954957	training's binary_logloss: 0.242917	valid_1's auc: 0.907165	valid_1's binary_logloss: 0.318779
[141]	training's auc: 0.955104	training's binary_logloss: 0.242613	valid_1's auc: 0.90709	valid_1's binary_logloss: 0.318913
[142]	training's auc: 0.955442	training's binary_logloss: 0.242062	valid_1's auc: 0.907151	valid_1's binary_logloss: 0.318808
[143]	training's auc: 0.955742	training's binary_logloss: 0.241528	valid_1's auc: 0.907134	valid_1's binary_logloss: 0.318834
[144]	training's auc: 0.955965	training's binary_logloss: 0.241089	valid_1's auc: 0.907162	valid_1's binary_logloss: 0.318833
[145]	training's auc: 0.956213	training's binary_logloss: 0.240658	valid_1's auc: 0.907118	valid_1's binary_logloss: 0.318904
[146]	training's auc: 0.956461	training's binary_logloss: 0.240184	valid_1's auc: 0.907155	valid_1's binary_logloss: 0.318863
[147]	training's auc: 0.956638	training's binary_logloss: 0.239832	valid_1's auc: 0.907099	valid_1's binary_logloss: 0.318944
[148]	training's auc: 0.956868	training's binary_logloss: 0.239396	valid_1's auc: 0.907084	valid_1's binary_logloss: 0.318997
[149]	training's auc: 0.957153	training's binary_logloss: 0.238905	valid_1's auc: 0.907108	valid_1's binary_logloss: 0.319003
[150]	training's auc: 0.957382	training's binary_logloss: 0.238464	valid_1's auc: 0.907142	valid_1's binary_logloss: 0.318934
[151]	training's auc: 0.957563	training's binary_logloss: 0.238067	valid_1's auc: 0.907105	valid_1's binary_logloss: 0.319055
[152]	training's auc: 0.957759	training's binary_logloss: 0.237697	valid_1's auc: 0.907033	valid_1's binary_logloss: 0.319198
[153]	training's auc: 0.957981	training's binary_logloss: 0.237269	valid_1's auc: 0.906977	valid_1's binary_logloss: 0.319328
[154]	training's auc: 0.958179	training's binary_logloss: 0.236876	valid_1's auc: 0.906876	valid_1's binary_logloss: 0.319479
[155]	training's auc: 0.958337	training's binary_logloss: 0.236558	valid_1's auc: 0.906882	valid_1's binary_logloss: 0.319505
[156]	training's auc: 0.958625	training's binary_logloss: 0.236041	valid_1's auc: 0.906925	valid_1's binary_logloss: 0.319485
[157]	training's auc: 0.958786	training's binary_logloss: 0.235728	valid_1's auc: 0.906889	valid_1's binary_logloss: 0.319568
[158]	training's auc: 0.959018	training's binary_logloss: 0.235225	valid_1's auc: 0.906888	valid_1's binary_logloss: 0.31959
[159]	training's auc: 0.959208	training's binary_logloss: 0.234848	valid_1's auc: 0.906899	valid_1's binary_logloss: 0.319614
[160]	training's auc: 0.959393	training's binary_logloss: 0.23445	valid_1's auc: 0.906857	valid_1's binary_logloss: 0.319723
[161]	training's auc: 0.959552	training's binary_logloss: 0.234133	valid_1's auc: 0.906803	valid_1's binary_logloss: 0.319883
[162]	training's auc: 0.959699	training's binary_logloss: 0.233826	valid_1's auc: 0.906785	valid_1's binary_logloss: 0.319909
[163]	training's auc: 0.959831	training's binary_logloss: 0.233545	valid_1's auc: 0.906779	valid_1's binary_logloss: 0.319956
[164]	training's auc: 0.960036	training's binary_logloss: 0.233065	valid_1's auc: 0.906827	valid_1's binary_logloss: 0.319847
[165]	training's auc: 0.96031	training's binary_logloss: 0.232586	valid_1's auc: 0.906835	valid_1's binary_logloss: 0.31986
[166]	training's auc: 0.960421	training's binary_logloss: 0.232342	valid_1's auc: 0.906856	valid_1's binary_logloss: 0.319882
Early stopping, best iteration is:
[66]	training's auc: 0.934364	training's binary_logloss: 0.280166	valid_1's auc: 0.909726	valid_1's binary_logloss: 0.314341
최적 파라미터:  {'max_depth': 20, 'min_child_samples': 20, 'subsample': 0.8}
ROC AUC: 0.9097

lgbm = LGBMClassifier(n_estimators=1000, num_leaves=50, subsample=0.8,
                      min_child_samples=20, max_depth=20)
evals = [(X_test, y_test)]
lgbm.fit(X_train, y_train, early_stopping_rounds=100, eval_metric='auc',
         eval_set=evals, verbose=True)

score = roc_auc_score(y_test, grid.predict_proba(X_test)[:, 1], average='macro')
print("ROC AUC: {0:.4f}".format(score))

[1]	valid_0's auc: 0.895779	valid_0's binary_logloss: 0.508106
Training until validation scores don't improve for 100 rounds
[2]	valid_0's auc: 0.899289	valid_0's binary_logloss: 0.477948
[3]	valid_0's auc: 0.900975	valid_0's binary_logloss: 0.454474
[4]	valid_0's auc: 0.900657	valid_0's binary_logloss: 0.43531
[5]	valid_0's auc: 0.901422	valid_0's binary_logloss: 0.419402
[6]	valid_0's auc: 0.90405	valid_0's binary_logloss: 0.405626
[7]	valid_0's auc: 0.904217	valid_0's binary_logloss: 0.39443
[8]	valid_0's auc: 0.90417	valid_0's binary_logloss: 0.384728
[9]	valid_0's auc: 0.904799	valid_0's binary_logloss: 0.376088
[10]	valid_0's auc: 0.90513	valid_0's binary_logloss: 0.368923
[11]	valid_0's auc: 0.905411	valid_0's binary_logloss: 0.362419
[12]	valid_0's auc: 0.905651	valid_0's binary_logloss: 0.356895
[13]	valid_0's auc: 0.905956	valid_0's binary_logloss: 0.351883
[14]	valid_0's auc: 0.906494	valid_0's binary_logloss: 0.347633
[15]	valid_0's auc: 0.906924	valid_0's binary_logloss: 0.343951
[16]	valid_0's auc: 0.907179	valid_0's binary_logloss: 0.34066
[17]	valid_0's auc: 0.907505	valid_0's binary_logloss: 0.337749
[18]	valid_0's auc: 0.907675	valid_0's binary_logloss: 0.3352
[19]	valid_0's auc: 0.907855	valid_0's binary_logloss: 0.332958
[20]	valid_0's auc: 0.908032	valid_0's binary_logloss: 0.330885
[21]	valid_0's auc: 0.908297	valid_0's binary_logloss: 0.32905
[22]	valid_0's auc: 0.908562	valid_0's binary_logloss: 0.327175
[23]	valid_0's auc: 0.908506	valid_0's binary_logloss: 0.325912
[24]	valid_0's auc: 0.908394	valid_0's binary_logloss: 0.324984
[25]	valid_0's auc: 0.90857	valid_0's binary_logloss: 0.32377
[26]	valid_0's auc: 0.908696	valid_0's binary_logloss: 0.322656
[27]	valid_0's auc: 0.908769	valid_0's binary_logloss: 0.321871
[28]	valid_0's auc: 0.908888	valid_0's binary_logloss: 0.321002
[29]	valid_0's auc: 0.908946	valid_0's binary_logloss: 0.320364
[30]	valid_0's auc: 0.909021	valid_0's binary_logloss: 0.319797
[31]	valid_0's auc: 0.909098	valid_0's binary_logloss: 0.319225
[32]	valid_0's auc: 0.90902	valid_0's binary_logloss: 0.318907
[33]	valid_0's auc: 0.909069	valid_0's binary_logloss: 0.3185
[34]	valid_0's auc: 0.909018	valid_0's binary_logloss: 0.318255
[35]	valid_0's auc: 0.909021	valid_0's binary_logloss: 0.317883
[36]	valid_0's auc: 0.909072	valid_0's binary_logloss: 0.317603
[37]	valid_0's auc: 0.909194	valid_0's binary_logloss: 0.317164
[38]	valid_0's auc: 0.9092	valid_0's binary_logloss: 0.316957
[39]	valid_0's auc: 0.909255	valid_0's binary_logloss: 0.316717
[40]	valid_0's auc: 0.90935	valid_0's binary_logloss: 0.316419
[41]	valid_0's auc: 0.909434	valid_0's binary_logloss: 0.316099
[42]	valid_0's auc: 0.909471	valid_0's binary_logloss: 0.315905
[43]	valid_0's auc: 0.909432	valid_0's binary_logloss: 0.315809
[44]	valid_0's auc: 0.909404	valid_0's binary_logloss: 0.315695
[45]	valid_0's auc: 0.9093	valid_0's binary_logloss: 0.315753
[46]	valid_0's auc: 0.909169	valid_0's binary_logloss: 0.315876
[47]	valid_0's auc: 0.909198	valid_0's binary_logloss: 0.31574
[48]	valid_0's auc: 0.909281	valid_0's binary_logloss: 0.31549
[49]	valid_0's auc: 0.90911	valid_0's binary_logloss: 0.315624
[50]	valid_0's auc: 0.909113	valid_0's binary_logloss: 0.31557
[51]	valid_0's auc: 0.909097	valid_0's binary_logloss: 0.315565
[52]	valid_0's auc: 0.909182	valid_0's binary_logloss: 0.31547
[53]	valid_0's auc: 0.90916	valid_0's binary_logloss: 0.315452
[54]	valid_0's auc: 0.909151	valid_0's binary_logloss: 0.315413
[55]	valid_0's auc: 0.909199	valid_0's binary_logloss: 0.315328
[56]	valid_0's auc: 0.909314	valid_0's binary_logloss: 0.315127
[57]	valid_0's auc: 0.90924	valid_0's binary_logloss: 0.315217
[58]	valid_0's auc: 0.909292	valid_0's binary_logloss: 0.315107
[59]	valid_0's auc: 0.90935	valid_0's binary_logloss: 0.314998
[60]	valid_0's auc: 0.909479	valid_0's binary_logloss: 0.314774
[61]	valid_0's auc: 0.909569	valid_0's binary_logloss: 0.314606
[62]	valid_0's auc: 0.909465	valid_0's binary_logloss: 0.314791
[63]	valid_0's auc: 0.9095	valid_0's binary_logloss: 0.314703
[64]	valid_0's auc: 0.909429	valid_0's binary_logloss: 0.314762
[65]	valid_0's auc: 0.909537	valid_0's binary_logloss: 0.31462
[66]	valid_0's auc: 0.909726	valid_0's binary_logloss: 0.314341
[67]	valid_0's auc: 0.909589	valid_0's binary_logloss: 0.314605
[68]	valid_0's auc: 0.909585	valid_0's binary_logloss: 0.314598
[69]	valid_0's auc: 0.909444	valid_0's binary_logloss: 0.314833
[70]	valid_0's auc: 0.909443	valid_0's binary_logloss: 0.314793
[71]	valid_0's auc: 0.909407	valid_0's binary_logloss: 0.314828
[72]	valid_0's auc: 0.909323	valid_0's binary_logloss: 0.314963
[73]	valid_0's auc: 0.909398	valid_0's binary_logloss: 0.314832
[74]	valid_0's auc: 0.909333	valid_0's binary_logloss: 0.314935
[75]	valid_0's auc: 0.909337	valid_0's binary_logloss: 0.314937
[76]	valid_0's auc: 0.909288	valid_0's binary_logloss: 0.314991
[77]	valid_0's auc: 0.90926	valid_0's binary_logloss: 0.315062
[78]	valid_0's auc: 0.909123	valid_0's binary_logloss: 0.3153
[79]	valid_0's auc: 0.909044	valid_0's binary_logloss: 0.315419
[80]	valid_0's auc: 0.909027	valid_0's binary_logloss: 0.315424
[81]	valid_0's auc: 0.908981	valid_0's binary_logloss: 0.315514
[82]	valid_0's auc: 0.908864	valid_0's binary_logloss: 0.315708
[83]	valid_0's auc: 0.908727	valid_0's binary_logloss: 0.315929
[84]	valid_0's auc: 0.908764	valid_0's binary_logloss: 0.315832
[85]	valid_0's auc: 0.908752	valid_0's binary_logloss: 0.315893
[86]	valid_0's auc: 0.908947	valid_0's binary_logloss: 0.315631
[87]	valid_0's auc: 0.908812	valid_0's binary_logloss: 0.315914
[88]	valid_0's auc: 0.90865	valid_0's binary_logloss: 0.31613
[89]	valid_0's auc: 0.90852	valid_0's binary_logloss: 0.316352
[90]	valid_0's auc: 0.908552	valid_0's binary_logloss: 0.316321
[91]	valid_0's auc: 0.908468	valid_0's binary_logloss: 0.316465
[92]	valid_0's auc: 0.9084	valid_0's binary_logloss: 0.316514
[93]	valid_0's auc: 0.908392	valid_0's binary_logloss: 0.316535
[94]	valid_0's auc: 0.908361	valid_0's binary_logloss: 0.316592
[95]	valid_0's auc: 0.9084	valid_0's binary_logloss: 0.316508
[96]	valid_0's auc: 0.908366	valid_0's binary_logloss: 0.316614
[97]	valid_0's auc: 0.908298	valid_0's binary_logloss: 0.316732
[98]	valid_0's auc: 0.90823	valid_0's binary_logloss: 0.316862
[99]	valid_0's auc: 0.908218	valid_0's binary_logloss: 0.316893
[100]	valid_0's auc: 0.908295	valid_0's binary_logloss: 0.316756
[101]	valid_0's auc: 0.908266	valid_0's binary_logloss: 0.316797
[102]	valid_0's auc: 0.90811	valid_0's binary_logloss: 0.317032
[103]	valid_0's auc: 0.908188	valid_0's binary_logloss: 0.316924
[104]	valid_0's auc: 0.908227	valid_0's binary_logloss: 0.316884
[105]	valid_0's auc: 0.908166	valid_0's binary_logloss: 0.316992
[106]	valid_0's auc: 0.908153	valid_0's binary_logloss: 0.317012
[107]	valid_0's auc: 0.908204	valid_0's binary_logloss: 0.316854
[108]	valid_0's auc: 0.908166	valid_0's binary_logloss: 0.316962
[109]	valid_0's auc: 0.908041	valid_0's binary_logloss: 0.317193
[110]	valid_0's auc: 0.908059	valid_0's binary_logloss: 0.317178
[111]	valid_0's auc: 0.908079	valid_0's binary_logloss: 0.317194
[112]	valid_0's auc: 0.908034	valid_0's binary_logloss: 0.317263
[113]	valid_0's auc: 0.908038	valid_0's binary_logloss: 0.317234
[114]	valid_0's auc: 0.907864	valid_0's binary_logloss: 0.317574
[115]	valid_0's auc: 0.907855	valid_0's binary_logloss: 0.317591
[116]	valid_0's auc: 0.907823	valid_0's binary_logloss: 0.317672
[117]	valid_0's auc: 0.907811	valid_0's binary_logloss: 0.317668
[118]	valid_0's auc: 0.907767	valid_0's binary_logloss: 0.317711
[119]	valid_0's auc: 0.907734	valid_0's binary_logloss: 0.317789
[120]	valid_0's auc: 0.907705	valid_0's binary_logloss: 0.317855
[121]	valid_0's auc: 0.907681	valid_0's binary_logloss: 0.317905
[122]	valid_0's auc: 0.907667	valid_0's binary_logloss: 0.317918
[123]	valid_0's auc: 0.907709	valid_0's binary_logloss: 0.317874
[124]	valid_0's auc: 0.907627	valid_0's binary_logloss: 0.317965
[125]	valid_0's auc: 0.907581	valid_0's binary_logloss: 0.318063
[126]	valid_0's auc: 0.907574	valid_0's binary_logloss: 0.318086
[127]	valid_0's auc: 0.907585	valid_0's binary_logloss: 0.318097
[128]	valid_0's auc: 0.907612	valid_0's binary_logloss: 0.318042
[129]	valid_0's auc: 0.907655	valid_0's binary_logloss: 0.317964
[130]	valid_0's auc: 0.907679	valid_0's binary_logloss: 0.317926
[131]	valid_0's auc: 0.907601	valid_0's binary_logloss: 0.318025
[132]	valid_0's auc: 0.90753	valid_0's binary_logloss: 0.318149
[133]	valid_0's auc: 0.907488	valid_0's binary_logloss: 0.318216
[134]	valid_0's auc: 0.907452	valid_0's binary_logloss: 0.318283
[135]	valid_0's auc: 0.907404	valid_0's binary_logloss: 0.318365
[136]	valid_0's auc: 0.907231	valid_0's binary_logloss: 0.318664
[137]	valid_0's auc: 0.907203	valid_0's binary_logloss: 0.318703
[138]	valid_0's auc: 0.907218	valid_0's binary_logloss: 0.31866
[139]	valid_0's auc: 0.907204	valid_0's binary_logloss: 0.318721
[140]	valid_0's auc: 0.907165	valid_0's binary_logloss: 0.318779
[141]	valid_0's auc: 0.90709	valid_0's binary_logloss: 0.318913
[142]	valid_0's auc: 0.907151	valid_0's binary_logloss: 0.318808
[143]	valid_0's auc: 0.907134	valid_0's binary_logloss: 0.318834
[144]	valid_0's auc: 0.907162	valid_0's binary_logloss: 0.318833
[145]	valid_0's auc: 0.907118	valid_0's binary_logloss: 0.318904
[146]	valid_0's auc: 0.907155	valid_0's binary_logloss: 0.318863
[147]	valid_0's auc: 0.907099	valid_0's binary_logloss: 0.318944
[148]	valid_0's auc: 0.907084	valid_0's binary_logloss: 0.318997
[149]	valid_0's auc: 0.907108	valid_0's binary_logloss: 0.319003
[150]	valid_0's auc: 0.907142	valid_0's binary_logloss: 0.318934
[151]	valid_0's auc: 0.907105	valid_0's binary_logloss: 0.319055
[152]	valid_0's auc: 0.907033	valid_0's binary_logloss: 0.319198
[153]	valid_0's auc: 0.906977	valid_0's binary_logloss: 0.319328
[154]	valid_0's auc: 0.906876	valid_0's binary_logloss: 0.319479
[155]	valid_0's auc: 0.906882	valid_0's binary_logloss: 0.319505
[156]	valid_0's auc: 0.906925	valid_0's binary_logloss: 0.319485
[157]	valid_0's auc: 0.906889	valid_0's binary_logloss: 0.319568
[158]	valid_0's auc: 0.906888	valid_0's binary_logloss: 0.31959
[159]	valid_0's auc: 0.906899	valid_0's binary_logloss: 0.319614
[160]	valid_0's auc: 0.906857	valid_0's binary_logloss: 0.319723
[161]	valid_0's auc: 0.906803	valid_0's binary_logloss: 0.319883
[162]	valid_0's auc: 0.906785	valid_0's binary_logloss: 0.319909
[163]	valid_0's auc: 0.906779	valid_0's binary_logloss: 0.319956
[164]	valid_0's auc: 0.906827	valid_0's binary_logloss: 0.319847
[165]	valid_0's auc: 0.906835	valid_0's binary_logloss: 0.31986
[166]	valid_0's auc: 0.906856	valid_0's binary_logloss: 0.319882
Early stopping, best iteration is:
[66]	valid_0's auc: 0.909726	valid_0's binary_logloss: 0.314341
ROC AUC: 0.9097

# LOAD LIBRARY
import gc
import os
import random
import numpy as np
import pandas as pd

import matplotlib.pyplot as plt
plt.style.use('fivethirtyeight')
plt.show()

import seaborn as sns
sns.set(style="whitegrid")

import warnings
warnings.filterwarnings('ignore')


import lightgbm as lgb

from time import time
from tqdm import tqdm_notebook
from sklearn import preprocessing
from sklearn.model_selection import GridSearchCV
from sklearn.preprocessing import LabelEncoder
from sklearn.model_selection import KFold
from sklearn.metrics import f1_score
warnings.simplefilter('ignore')
sns.set()
%matplotlib inline

# X_train = df_num[features]
# X_test = df_num_t[features]
# y_train = df_num[target]

X_train = pd.concat([preprocessed, encoded], axis=1)
X_test = pd.concat([preprocessed_t, encoded_t], axis=1)
y_train = df[target]

print(X_train.shape)
print(X_test.shape)
print(y_train.shape)

(26049, 93)
(6512, 93)
(26049,)

def lgb_f1_score(y_hat, data):
    y_true = data.get_label()
    y_hat  = np.round(y_hat)
    
    return 'f1', f1_score(y_true, y_hat, average='weighted'), True

params = {
          'objective': 'binary',
          'max_depth': -1,
          'learning_rate': 0.001,
          'num_leaves': 50,
          'min_data_in_leaf': 30,
          "boosting_type": 'gbdt',
          "verbosity": -1,
          'random_state': 15,
          }

%%time
NFOLDS = 5
folds = KFold(n_splits=NFOLDS)

columns = X_train.columns
splits = folds.split(X_train, y_train)
y_preds = np.zeros(X_test.shape[0])
y_oof = np.zeros(X_train.shape[0])
score = 0

feature_importances = pd.DataFrame()
feature_importances['feature'] = columns

for fold_n, (trn_idx, val_idx) in enumerate(splits):
    X_trn, X_val = X_train[columns].iloc[trn_idx], X_train[columns].iloc[val_idx]
    y_trn, y_val = y_train.iloc[trn_idx], y_train.iloc[val_idx]
    
    dtrain = lgb.Dataset(X_trn, label=y_trn)
    dvalid = lgb.Dataset(X_val, label=y_val)
    
    clf = lgb.train(
        params,
        dtrain,
        10000,
        valid_sets = [dtrain, dvalid],
        verbose_eval=200,
        early_stopping_rounds=500,
        feval=lgb_f1_score
    )
    
    feature_importances[f'fold_{fold_n+1}'] = clf.feature_importance()
    
    y_pred_val = clf.predict(X_val) 
#     y_pred_val = np.where(y_pred_val >= 0.5, 1, 0)
    y_pred_val = [int(v >= 0.5) for v in y_pred_val]
    
    y_oof[val_idx] = y_pred_val
    print(f"Fold {fold_n + 1} | F1 Score: {f1_score(y_val, y_pred_val, average='weighted')}")
    
    score += f1_score(y_val, y_pred_val, average='weighted') / NFOLDS
    y_preds += clf.predict(X_test) / NFOLDS
    
    del X_trn, X_val, y_trn, y_val
    gc.collect()
    
print(f"\nMean F1 score = {score}")
print(f"OOF F1 score = {f1_score(y, y_oof, average='weighted')}")

Training until validation scores don't improve for 500 rounds
[200]	training's binary_logloss: 0.49018	training's f1: 0.65275	valid_1's binary_logloss: 0.488304	valid_1's f1: 0.656988
[400]	training's binary_logloss: 0.447484	training's f1: 0.65275	valid_1's binary_logloss: 0.447439	valid_1's f1: 0.656988
[600]	training's binary_logloss: 0.417084	training's f1: 0.706591	valid_1's binary_logloss: 0.418608	valid_1's f1: 0.709204
[800]	training's binary_logloss: 0.394414	training's f1: 0.795454	valid_1's binary_logloss: 0.397444	valid_1's f1: 0.798806
[1000]	training's binary_logloss: 0.377151	training's f1: 0.815671	valid_1's binary_logloss: 0.381516	valid_1's f1: 0.812287
[1200]	training's binary_logloss: 0.363729	training's f1: 0.824873	valid_1's binary_logloss: 0.369244	valid_1's f1: 0.817793
[1400]	training's binary_logloss: 0.353029	training's f1: 0.833841	valid_1's binary_logloss: 0.360287	valid_1's f1: 0.824087
[1600]	training's binary_logloss: 0.344452	training's f1: 0.839705	valid_1's binary_logloss: 0.353462	valid_1's f1: 0.829114
[1800]	training's binary_logloss: 0.337282	training's f1: 0.844985	valid_1's binary_logloss: 0.347895	valid_1's f1: 0.833192
[2000]	training's binary_logloss: 0.331302	training's f1: 0.847519	valid_1's binary_logloss: 0.343328	valid_1's f1: 0.834919
[2200]	training's binary_logloss: 0.32594	training's f1: 0.849774	valid_1's binary_logloss: 0.339494	valid_1's f1: 0.83601
[2400]	training's binary_logloss: 0.321554	training's f1: 0.850402	valid_1's binary_logloss: 0.336783	valid_1's f1: 0.835467
[2600]	training's binary_logloss: 0.317744	training's f1: 0.851801	valid_1's binary_logloss: 0.334419	valid_1's f1: 0.837583
[2800]	training's binary_logloss: 0.314344	training's f1: 0.853115	valid_1's binary_logloss: 0.332749	valid_1's f1: 0.83832
[3000]	training's binary_logloss: 0.311336	training's f1: 0.853516	valid_1's binary_logloss: 0.331519	valid_1's f1: 0.840123
[3200]	training's binary_logloss: 0.308566	training's f1: 0.855436	valid_1's binary_logloss: 0.330264	valid_1's f1: 0.841077
[3400]	training's binary_logloss: 0.305983	training's f1: 0.85708	valid_1's binary_logloss: 0.329169	valid_1's f1: 0.842187
[3600]	training's binary_logloss: 0.30355	training's f1: 0.858415	valid_1's binary_logloss: 0.328291	valid_1's f1: 0.843528
[3800]	training's binary_logloss: 0.301316	training's f1: 0.859074	valid_1's binary_logloss: 0.327632	valid_1's f1: 0.844112
[4000]	training's binary_logloss: 0.299259	training's f1: 0.860246	valid_1's binary_logloss: 0.327221	valid_1's f1: 0.845393
[4200]	training's binary_logloss: 0.29736	training's f1: 0.860747	valid_1's binary_logloss: 0.326856	valid_1's f1: 0.845957
[4400]	training's binary_logloss: 0.295594	training's f1: 0.86141	valid_1's binary_logloss: 0.326532	valid_1's f1: 0.846721
[4600]	training's binary_logloss: 0.293897	training's f1: 0.861764	valid_1's binary_logloss: 0.326197	valid_1's f1: 0.845765
[4800]	training's binary_logloss: 0.292286	training's f1: 0.862314	valid_1's binary_logloss: 0.326005	valid_1's f1: 0.845986
Early stopping, best iteration is:
[4422]	training's binary_logloss: 0.295401	training's f1: 0.861378	valid_1's binary_logloss: 0.3265	valid_1's f1: 0.846992
Fold 1 | F1 Score: 0.8469915498748064
Training until validation scores don't improve for 500 rounds
[200]	training's binary_logloss: 0.488536	training's f1: 0.653724	valid_1's binary_logloss: 0.491646	valid_1's f1: 0.65309
[400]	training's binary_logloss: 0.445727	training's f1: 0.653724	valid_1's binary_logloss: 0.450443	valid_1's f1: 0.65309
[600]	training's binary_logloss: 0.415441	training's f1: 0.734602	valid_1's binary_logloss: 0.421429	valid_1's f1: 0.729038
[800]	training's binary_logloss: 0.393131	training's f1: 0.788118	valid_1's binary_logloss: 0.400625	valid_1's f1: 0.787025
[1000]	training's binary_logloss: 0.376033	training's f1: 0.814894	valid_1's binary_logloss: 0.384908	valid_1's f1: 0.81082
[1200]	training's binary_logloss: 0.362676	training's f1: 0.828471	valid_1's binary_logloss: 0.373064	valid_1's f1: 0.823724
[1400]	training's binary_logloss: 0.35195	training's f1: 0.833583	valid_1's binary_logloss: 0.364134	valid_1's f1: 0.828125
[1600]	training's binary_logloss: 0.343256	training's f1: 0.841209	valid_1's binary_logloss: 0.356807	valid_1's f1: 0.830383
[1800]	training's binary_logloss: 0.336303	training's f1: 0.845126	valid_1's binary_logloss: 0.351188	valid_1's f1: 0.832363
[2000]	training's binary_logloss: 0.330474	training's f1: 0.848011	valid_1's binary_logloss: 0.346645	valid_1's f1: 0.835041
[2200]	training's binary_logloss: 0.325215	training's f1: 0.849904	valid_1's binary_logloss: 0.34284	valid_1's f1: 0.836989
[2400]	training's binary_logloss: 0.320736	training's f1: 0.85222	valid_1's binary_logloss: 0.339976	valid_1's f1: 0.838718
[2600]	training's binary_logloss: 0.316815	training's f1: 0.853914	valid_1's binary_logloss: 0.337785	valid_1's f1: 0.839459
[2800]	training's binary_logloss: 0.313421	training's f1: 0.854973	valid_1's binary_logloss: 0.336096	valid_1's f1: 0.840308
[3000]	training's binary_logloss: 0.310315	training's f1: 0.855574	valid_1's binary_logloss: 0.334647	valid_1's f1: 0.841432
[3200]	training's binary_logloss: 0.307474	training's f1: 0.856154	valid_1's binary_logloss: 0.333328	valid_1's f1: 0.841477
[3400]	training's binary_logloss: 0.304942	training's f1: 0.857571	valid_1's binary_logloss: 0.332146	valid_1's f1: 0.841638
Early stopping, best iteration is:
[2910]	training's binary_logloss: 0.311645	training's f1: 0.855147	valid_1's binary_logloss: 0.335274	valid_1's f1: 0.841782
Fold 2 | F1 Score: 0.8417820282013694
Training until validation scores don't improve for 500 rounds
[200]	training's binary_logloss: 0.490334	training's f1: 0.652491	valid_1's binary_logloss: 0.486639	valid_1's f1: 0.658028
[400]	training's binary_logloss: 0.447862	training's f1: 0.652491	valid_1's binary_logloss: 0.445129	valid_1's f1: 0.658028
[600]	training's binary_logloss: 0.41755	training's f1: 0.705363	valid_1's binary_logloss: 0.415361	valid_1's f1: 0.710759
[800]	training's binary_logloss: 0.395205	training's f1: 0.791873	valid_1's binary_logloss: 0.393693	valid_1's f1: 0.797815
[1000]	training's binary_logloss: 0.37819	training's f1: 0.810904	valid_1's binary_logloss: 0.377324	valid_1's f1: 0.815564
[1200]	training's binary_logloss: 0.364996	training's f1: 0.825585	valid_1's binary_logloss: 0.364652	valid_1's f1: 0.829087
[1400]	training's binary_logloss: 0.354501	training's f1: 0.831982	valid_1's binary_logloss: 0.355092	valid_1's f1: 0.83494
[1600]	training's binary_logloss: 0.34621	training's f1: 0.836224	valid_1's binary_logloss: 0.34777	valid_1's f1: 0.83841
[1800]	training's binary_logloss: 0.339226	training's f1: 0.841468	valid_1's binary_logloss: 0.342006	valid_1's f1: 0.84364
[2000]	training's binary_logloss: 0.333325	training's f1: 0.844836	valid_1's binary_logloss: 0.337261	valid_1's f1: 0.84672
[2200]	training's binary_logloss: 0.328164	training's f1: 0.847302	valid_1's binary_logloss: 0.333076	valid_1's f1: 0.847939
[2400]	training's binary_logloss: 0.323806	training's f1: 0.84831	valid_1's binary_logloss: 0.329822	valid_1's f1: 0.847189
[2600]	training's binary_logloss: 0.319958	training's f1: 0.849823	valid_1's binary_logloss: 0.327461	valid_1's f1: 0.847292
Early stopping, best iteration is:
[2228]	training's binary_logloss: 0.327504	training's f1: 0.847301	valid_1's binary_logloss: 0.332539	valid_1's f1: 0.848455
Fold 3 | F1 Score: 0.8484554123226871
Training until validation scores don't improve for 500 rounds
[200]	training's binary_logloss: 0.488909	training's f1: 0.652815	valid_1's binary_logloss: 0.489571	valid_1's f1: 0.656728
[400]	training's binary_logloss: 0.445827	training's f1: 0.652815	valid_1's binary_logloss: 0.449646	valid_1's f1: 0.656728
[600]	training's binary_logloss: 0.41505	training's f1: 0.74538	valid_1's binary_logloss: 0.421508	valid_1's f1: 0.746262
[800]	training's binary_logloss: 0.392274	training's f1: 0.800741	valid_1's binary_logloss: 0.401296	valid_1's f1: 0.787408
[1000]	training's binary_logloss: 0.375074	training's f1: 0.811481	valid_1's binary_logloss: 0.386118	valid_1's f1: 0.797524
[1200]	training's binary_logloss: 0.361674	training's f1: 0.830625	valid_1's binary_logloss: 0.374421	valid_1's f1: 0.815734
[1400]	training's binary_logloss: 0.351117	training's f1: 0.836293	valid_1's binary_logloss: 0.365393	valid_1's f1: 0.822253
[1600]	training's binary_logloss: 0.342317	training's f1: 0.841612	valid_1's binary_logloss: 0.358359	valid_1's f1: 0.827829
[1800]	training's binary_logloss: 0.335152	training's f1: 0.845708	valid_1's binary_logloss: 0.352881	valid_1's f1: 0.829354
[2000]	training's binary_logloss: 0.329288	training's f1: 0.848455	valid_1's binary_logloss: 0.348634	valid_1's f1: 0.831919
[2200]	training's binary_logloss: 0.324294	training's f1: 0.851024	valid_1's binary_logloss: 0.345284	valid_1's f1: 0.833123
[2400]	training's binary_logloss: 0.31973	training's f1: 0.851969	valid_1's binary_logloss: 0.342407	valid_1's f1: 0.834648
[2600]	training's binary_logloss: 0.315835	training's f1: 0.854501	valid_1's binary_logloss: 0.340234	valid_1's f1: 0.836318
[2800]	training's binary_logloss: 0.31247	training's f1: 0.855511	valid_1's binary_logloss: 0.338556	valid_1's f1: 0.836214
[3000]	training's binary_logloss: 0.309369	training's f1: 0.856453	valid_1's binary_logloss: 0.337003	valid_1's f1: 0.837929
[3200]	training's binary_logloss: 0.30658	training's f1: 0.857674	valid_1's binary_logloss: 0.335948	valid_1's f1: 0.838953
[3400]	training's binary_logloss: 0.303976	training's f1: 0.858795	valid_1's binary_logloss: 0.335038	valid_1's f1: 0.838555
[3600]	training's binary_logloss: 0.301561	training's f1: 0.859674	valid_1's binary_logloss: 0.3343	valid_1's f1: 0.838724
[3800]	training's binary_logloss: 0.299344	training's f1: 0.860702	valid_1's binary_logloss: 0.333808	valid_1's f1: 0.837872
[4000]	training's binary_logloss: 0.297319	training's f1: 0.862039	valid_1's binary_logloss: 0.333462	valid_1's f1: 0.838436
Early stopping, best iteration is:
[3561]	training's binary_logloss: 0.302016	training's f1: 0.859421	valid_1's binary_logloss: 0.334409	valid_1's f1: 0.839517
Fold 4 | F1 Score: 0.8395172669821812
Training until validation scores don't improve for 500 rounds
[200]	training's binary_logloss: 0.486324	training's f1: 0.656208	valid_1's binary_logloss: 0.500517	valid_1's f1: 0.64318
[400]	training's binary_logloss: 0.443495	training's f1: 0.656208	valid_1's binary_logloss: 0.459741	valid_1's f1: 0.64318
[600]	training's binary_logloss: 0.412884	training's f1: 0.750738	valid_1's binary_logloss: 0.431218	valid_1's f1: 0.730152
[800]	training's binary_logloss: 0.390353	training's f1: 0.791122	valid_1's binary_logloss: 0.410655	valid_1's f1: 0.774816
[1000]	training's binary_logloss: 0.373311	training's f1: 0.816283	valid_1's binary_logloss: 0.395422	valid_1's f1: 0.796819
[1200]	training's binary_logloss: 0.359997	training's f1: 0.830249	valid_1's binary_logloss: 0.383845	valid_1's f1: 0.809809
[1400]	training's binary_logloss: 0.349522	training's f1: 0.838345	valid_1's binary_logloss: 0.375031	valid_1's f1: 0.816099
[1600]	training's binary_logloss: 0.341006	training's f1: 0.843629	valid_1's binary_logloss: 0.367995	valid_1's f1: 0.818691
[1800]	training's binary_logloss: 0.333877	training's f1: 0.848481	valid_1's binary_logloss: 0.362413	valid_1's f1: 0.822911
[2000]	training's binary_logloss: 0.328001	training's f1: 0.851576	valid_1's binary_logloss: 0.357743	valid_1's f1: 0.824524
[2200]	training's binary_logloss: 0.323039	training's f1: 0.852416	valid_1's binary_logloss: 0.354009	valid_1's f1: 0.827316
[2400]	training's binary_logloss: 0.318596	training's f1: 0.855185	valid_1's binary_logloss: 0.350955	valid_1's f1: 0.827719
[2600]	training's binary_logloss: 0.314837	training's f1: 0.856033	valid_1's binary_logloss: 0.348378	valid_1's f1: 0.828423
[2800]	training's binary_logloss: 0.311502	training's f1: 0.857668	valid_1's binary_logloss: 0.34625	valid_1's f1: 0.829752
[3000]	training's binary_logloss: 0.30851	training's f1: 0.858457	valid_1's binary_logloss: 0.344681	valid_1's f1: 0.830676
[3200]	training's binary_logloss: 0.305802	training's f1: 0.859638	valid_1's binary_logloss: 0.343434	valid_1's f1: 0.831019
Early stopping, best iteration is:
[2890]	training's binary_logloss: 0.310104	training's f1: 0.858016	valid_1's binary_logloss: 0.345462	valid_1's f1: 0.831756
Fold 5 | F1 Score: 0.831755789323932

Mean F1 score = 0.8417004093409953
OOF F1 score = 0.8417275249279862
CPU times: user 21min 1s, sys: 17.7 s, total: 21min 18s
Wall time: 5min 27s

submission = pd.read_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/sample_submission.csv')

y_preds = np.where(y_preds >= 0.5, 1, 0)
submission["prediction_bool"] = y_preds

submission.loc[submission["prediction_bool"] == True, 'prediction'] = 1
submission.loc[submission["prediction_bool"] == False, 'prediction'] = 0

submission = submission.drop("prediction_bool", axis = 1)

print(submission.shape)
submission.head()

(6512, 2)

	id	prediction
0	0	0
1	1	1
2	2	0
3	3	1
4	4	1

submission.to_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/submission_201022_2.csv', index = False)

Fit

# X_test = df_num_t[features]
# print(X_test.shape)
# X_test.head()

X_test = pd.concat([preprocessed_t, encoded_t], axis=1)
print(X_test.shape)
X_test.head()

(6512, 93)

	fnlwgt_log	age_bin	hours_per_week_log	Male_married_14y_edu	ceo_prof_m	capital_gain_bool	education_num	workclass_?	workclass_Federal-gov	workclass_Local-gov	...	native_country_Portugal	native_country_Puerto-Rico	native_country_Scotland	native_country_South	native_country_Taiwan	native_country_Thailand	native_country_Trinadad&Tobago	native_country_United-States	native_country_Vietnam	native_country_Yugoslavia
0	11.122280	2	3.713572	False	False	False	10	0	0	0	...	0	0	0	0	0	0	0	1	0	0
1	10.541915	5	3.931826	False	True	False	9	0	0	0	...	0	0	0	0	0	0	0	1	0	0
2	11.607808	0	3.258097	False	False	False	10	0	0	0	...	0	0	0	0	0	0	0	1	0	0
3	11.648662	5	3.931826	False	True	False	11	0	0	0	...	0	0	0	0	0	0	0	1	0	0
4	10.844764	4	4.605170	True	True	False	16	0	0	0	...	0	0	0	0	0	0	0	0	0	0

5 rows × 93 columns

y_pred = lgbm.predict(X_test)
print(y_pred.shape)
y_pred[0:10]

(6512,)

array([False, False, False,  True,  True, False, False, False, False,
       False])

Submission

submission = pd.read_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/sample_submission.csv')
print(submission.shape)
submission.head()

(6512, 2)

	id	prediction
0	0	0
1	1	0
2	2	0
3	3	0
4	4	0

submission["prediction_bool"] = y_pred

submission.loc[submission["prediction_bool"] == True, 'prediction'] = 1
submission.loc[submission["prediction_bool"] == False, 'prediction'] = 0

submission = submission.drop("prediction_bool", axis = 1)

print(submission.shape)
submission.head()

(6512, 2)

	id	prediction
0	0	0
1	1	0
2	2	0
3	3	1
4	4	1

submission.to_csv('/home/theo/aiffel/data_represent/data/kakr-4th-competition/submission_201022.csv', index = False)